Commit Graph

82 Commits (4fc449dad5c739e7ffb1e80109d6d76893d5638d)

Author SHA1 Message Date
Raymond Yee b1ccf6832b Add the setup_selenium method to allow for headless running of selenium 2012-03-13 11:01:49 -07:00
Raymond Yee c698827d81 Rewriting of simple Google selenium example in WebDriver 2012-03-13 10:37:19 -07:00
Raymond Yee e1fc176031 Merge branch 'master' of github.com:Gluejar/regluit into payment 2012-03-02 09:32:01 -08:00
Raymond Yee 359ff71984 Add g_seed_isbn.json which hold the Gutenberg editions I'm loading. 2012-02-27 13:19:58 -08:00
Raymond Yee e5988b468e Need to fix print statement to emit only ascii 2012-02-24 14:08:14 -08:00
Raymond Yee f7220d9812 Programs and data for fighting Frankenworks 2012-02-24 12:06:24 -08:00
Raymond Yee 9dd2a07f9a Changing xpath for the google search box 2012-02-23 14:49:27 -08:00
Raymond Yee 1d001f33ba Now I think I'm able to calculate the timedate of when the latest "frankenwork" merging is happening 2012-02-21 08:54:12 -08:00
Raymond Yee 2e079b2c2e Now I have booktests to recalculate clusters 2012-02-17 10:30:09 -08:00
eric 471cb62fd2 changed core.tasks to not use models 2012-02-16 13:19:36 -05:00
Raymond Yee 4752181ace Move add_missing_isbn_to_editions to bookloader.py 2012-02-15 19:36:18 -08:00
Raymond Yee a8f1c157be Check current progress in so that I can focus on a change in the master branch to add missing isbns to Editions 2012-02-15 16:06:40 -08:00
Raymond Yee 2f09d21fae Don't load gutenberg book if seed_isbn is None 2012-02-15 09:09:24 -08:00
Raymond Yee 9fb57a6b4e At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though. 2012-02-14 18:01:13 -08:00
Raymond Yee c04aacec4a Putting away my work for ry...hope it's ok 2012-02-13 11:28:21 -08:00
Raymond Yee fa0a363ad6 THIS VERSION OF parallel_with_manager is broken....I'm putting it away for now 2012-02-07 10:16:44 -08:00
Raymond Yee af9aa5ab19 A working version before I try to have more than one queue of works 2012-02-07 07:50:07 -08:00
Raymond Yee 9334ab0cdb I've learned how to use a multiprocessing.Manager and dict to share results. Now can I extend it? 2012-02-06 20:16:37 -08:00
Raymond Yee 278701c56b FAILED attempt to use Pool to process tripler, negator, etc. Now changing gears 2012-02-06 17:10:56 -08:00
Raymond Yee 1a23862321 parallel.py: still working towards how to run a series of calculations in parallel to support calculating the seed isbn for Gutenberg books
load_test.py:  a simple program to make simulaneous calls to unglue.it to see how it performs under load
2012-02-06 09:21:23 -08:00
Raymond Yee bf6fb65bc4 Things working: next step -- enqueue doubler, tripler, negator 2012-02-05 09:42:07 -08:00
Raymond Yee af6d98383b Now we have a Task class and a queue for the tasks and a group of Consumers to pull work off the task queue 2012-02-04 14:57:57 -08:00
Raymond Yee 35d8f576a4 First draft of a parallel processed program to calculate seed ISBNs 2012-02-04 14:15:00 -08:00
Raymond Yee 568a4fb4db Getting close to implementing Gutenberg loading for at least one book Moby Dick 2012-02-01 17:09:04 -08:00
Raymond Yee da552d75db Two tests to demonstrate that the queryset queries using distinct() and order_by() generate the correct results 2012-02-01 17:41:22 +00:00
Raymond Yee 17c8de9473 Add a bit more detail to querytests.list_new 2012-02-01 08:33:11 -08:00
Raymond Yee 020f4266d3 Adding a test to make sure that new and popular are correct 2012-02-01 08:27:21 -08:00
Raymond Yee 3a30e22814 A stepping stone towards loading Gutenberg books. Loading Moby Dick seems to be working more or less 2012-01-31 18:09:01 -08:00
Raymond Yee 069985e02c Comment on the "tests" 2012-01-27 17:06:10 -08:00
Raymond Yee 5fba8be6a6 Changed the URL so that "all collections" loaded from Librarything, not just "my library"
In add_related, make sure edition is not None before trying to add related editions
A demo test
2012-01-27 16:16:46 -08:00
Raymond Yee c5e84d7006 Moved campaigntest.py to test/campaigntest.py
Added a simple selenium test to campaigntest to illustrate how to do a google search and test for the presence of text
Updated payment.tests to use the right settings for PayPal sandbox accounts
payment.tests.AuthorizeTest working for RY on laptop.  PledgeTest is going through the motions but not quite working yet
2012-01-04 10:52:19 -05:00
Raymond Yee 88f9fc6a1d This commit is not complete but I want to do so as a stepping stone. 2011-10-04 15:12:59 -07:00