Commit Graph

153 Commits (a9825888086c57ac086641009a3f5cfc757870f9)

Author SHA1 Message Date
Raymond Yee 30543c6135 Change ebook.provider from 'gutenberg' to 'Project Gutenberg' for PG books 2012-02-28 13:39:08 -08:00
Raymond Yee 538d225ad0 Merge branch 'production' 2012-02-24 14:56:45 -08:00
eric 4b943d1acb fixed bug where edition.public_domain never gets set 2012-02-23 18:51:29 -05:00
Raymond Yee 09ab830c20 Return the list of google books ids that are not recognized any more when trying to add ISBNs corresponding to isbn-less Editions that have Google Books IDs 2012-02-16 13:18:22 -08:00
Raymond Yee cf2e937969 Merge branch 'master' into ry 2012-02-16 10:45:53 -08:00
Raymond Yee fb5ad2da76 Add tracking for google_id_not_found to add_missing_isbn_to_editions
Add a django-admin command to run add_missing_isbn_to_editions
2012-02-16 10:44:13 -08:00
eric 471cb62fd2 changed core.tasks to not use models 2012-02-16 13:19:36 -05:00
Raymond Yee 4752181ace Move add_missing_isbn_to_editions to bookloader.py 2012-02-15 19:36:18 -08:00
Raymond Yee 8c397f4953 Merge branch 'master' of github.com:Gluejar/regluit into ry 2012-02-15 13:23:58 -08:00
Raymond Yee b7f47bfee5 Add a few comments to explain how various parts of our bookloading process works 2012-02-15 13:23:10 -08:00
Raymond Yee 25f6bd5e07 Merge branch 'master' of github.com:Gluejar/regluit into ry 2012-02-15 08:46:17 -08:00
Raymond Yee 9fb57a6b4e At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though. 2012-02-14 18:01:13 -08:00
Raymond Yee 4024d9d3c9 book_loader was calling a merge_works more than once on the same pair of works, causing an integrity exception in WasWorks.
Changes made in add_related so that merge_works called only once for a given pair of works.   Also put in some safeguards in merge_works to prevent from self-merging and from merging when either works is missing an id (which should happen if a work has been deleted.)  Maybe we should check also to see whether the id for was is already in WasWorks
2012-02-13 14:35:08 -08:00
eric 07e578699d Added WasWork model to track deleted works. Apply migrations! 2012-02-09 22:30:33 -05:00
eric 346bb79e38 merge comments when works are merged 2012-02-09 20:51:10 -05:00
eric 6215a7c8d8 turns out some records in googlebooks have no title!
https://www.googleapis.com/books/v1/volumes/?q=isbn:9780867130768
2012-02-02 11:33:51 -05:00
eric b584684390 add "update edition" method in bookloader 2012-02-02 09:05:41 -05:00
eric c354dcb41b fixed sloppiness in setting .new on editions. headslap. 2012-01-31 15:07:31 -05:00
eric d79bf7fb6b this should stop the generation of orphan works 2012-01-31 10:01:10 -05:00
eric e10e8e2842 catch lookup failures so as not to ruin clustering 2012-01-30 23:57:42 -05:00
eric 2d8210785f smarter handling of null titles 2012-01-30 23:57:42 -05:00
eric 85366cc21a handle locale in language 2012-01-28 22:16:14 -05:00
eric efa8da19ff pass isbn to add_by_googlebooks_id to address occasional missing isbns 2012-01-27 21:44:02 -05:00
Raymond Yee 4bd25d4ea0 Merge branch 'production2' 2012-01-27 17:19:40 -08:00
Raymond Yee 5fba8be6a6 Changed the URL so that "all collections" loaded from Librarything, not just "my library"
In add_related, make sure edition is not None before trying to add related editions
A demo test
2012-01-27 16:16:46 -08:00
eric 6fffbcd3d0 added guard against concurrent threads adding same googlebooks id 2012-01-27 09:35:00 -05:00
Ed Summers db576571bb minor formatting changes 2012-01-17 23:22:07 -05:00
Ed Summers 23c3758e84 log content from http responses that are errors 2012-01-17 23:15:24 -05:00
eric 0d19018e62 api tests working; non-google id's working 2012-01-10 15:20:02 -05:00
eric 0b91017dd5 Did what edso told me not to do- re-architected db to use generic ids 2012-01-09 13:55:22 -05:00
eric 68d6ef93fd General cleanup and optimization of goodreads loading 2011-12-22 14:29:46 -05:00
eric f81a4e8e6d removed isbn_10 column and fixed many isbn13 non-compliance issues
apply migrations!
2011-12-19 23:26:55 -05:00
Ed Summers 55656e2d3d now getting subjects from openlibrary instead of from googlebooks. You will need to APPLY MIGRATIONS! 2011-12-19 01:33:13 -05:00
Ed Summers e8339697f6 works are mono-lingual now. language is now a property of Work instead of Edition. YOU WILL NEED TO APPLY MIGRATIONS! 2011-12-13 09:55:26 -05:00
eric 167dccf574 Wishlists are now filled using the Wishes intermediate table. It's named the same as previous intermediate table, and I've edited the migration so data is not lost.
Also, I've added methods od Wishlists to add and remove Works. There
are "source" and created columns on the Wishes table
2011-12-08 18:22:20 -05:00
Ed Summers 3b777f87aa allow empty publication date, also make sure test database uses charset utf8 or else tests will fail 2011-11-21 14:13:29 -05:00
Raymond Yee f73aa1b570 Added grabbing of pdf ebooks corresponding to edition 2011-11-06 17:49:25 -05:00
Ed Summers e1ea725d0f ebooks must have a downloadUrl 2011-11-06 17:42:09 -05:00
Ed Summers 22d904f1bf added ebook model and add_b_oclc 2011-11-06 16:33:04 -05:00
Ed Summers 2e83847fa7 rolling back the add_related option on add_by_isbn until it is better thought out, and does not break the build... 2011-10-20 18:43:40 +00:00
Ed Summers 9901408b00 added list of supporters to the work page, just as a proof of concept more than anything. 2011-10-20 18:16:42 +00:00
Ed Summers 07073f8620 have tasks return bookloader return values 2011-10-20 05:23:30 +00:00
Ed Summers 0c1411f2e8 added celery async task for add_related that gets exercised when a book is added to a wishlist. includes new settings for the djkombu celery backend 2011-10-19 23:31:16 -04:00
Ed Summers 7bfb7c3f7f need to trap errors when looking up a LibraryThing ISBN in GoogleBooks and getting no hit 2011-10-18 23:45:02 -04:00
Ed Summers 5c88878a30 added merge_works function for merging the one work into another when adding related editions based on ThingISBN. also added a test that makes sure related campaigns and wishlists are appropriately updated. 2011-10-18 23:00:07 -04:00
Ed Summers 5b102a6685 wiping migrations again and hoping they work this time. also catch exceptions when adding related editions. 2011-10-14 16:03:43 -04:00
Ed Summers 44449f56a3 added some comments 2011-10-14 00:12:20 -04:00
Ed Summers ffe84fa46a got bookloader.add_related working w/ some tests. also added Edition.language because it looks like it will be useful to know. 2011-10-14 00:02:19 -04:00
Ed Summers 983c045a8c added bookloader.thingisbn and a test 2011-10-12 21:59:46 -04:00
Ed Summers 1b54ba5f6b make sure there are some hits when adding a book by isbn 2011-10-10 17:26:38 -04:00
Ed Summers e25894d549 added X-Forwarded-For for gluejar.com for the moment 2011-10-10 15:57:12 -04:00
Ed Summers 70a620b27f moved to using googlebooks api for data. required moving authors and subjects to be associated to editions, since we google books does not have a notion of a work 2011-10-10 12:57:10 -04:00
Ed Summers 2c7f858125 handle duplicates using openlibrary ids for edition, work and author 2011-09-10 11:36:38 +00:00