Raymond Yee
30543c6135
Change ebook.provider from 'gutenberg' to 'Project Gutenberg' for PG books
2012-02-28 13:39:08 -08:00
Raymond Yee
538d225ad0
Merge branch 'production'
2012-02-24 14:56:45 -08:00
eric
4b943d1acb
fixed bug where edition.public_domain never gets set
2012-02-23 18:51:29 -05:00
Raymond Yee
09ab830c20
Return the list of google books ids that are not recognized any more when trying to add ISBNs corresponding to isbn-less Editions that have Google Books IDs
2012-02-16 13:18:22 -08:00
Raymond Yee
cf2e937969
Merge branch 'master' into ry
2012-02-16 10:45:53 -08:00
Raymond Yee
fb5ad2da76
Add tracking for google_id_not_found to add_missing_isbn_to_editions
...
Add a django-admin command to run add_missing_isbn_to_editions
2012-02-16 10:44:13 -08:00
eric
471cb62fd2
changed core.tasks to not use models
2012-02-16 13:19:36 -05:00
Raymond Yee
4752181ace
Move add_missing_isbn_to_editions to bookloader.py
2012-02-15 19:36:18 -08:00
Raymond Yee
8c397f4953
Merge branch 'master' of github.com:Gluejar/regluit into ry
2012-02-15 13:23:58 -08:00
Raymond Yee
b7f47bfee5
Add a few comments to explain how various parts of our bookloading process works
2012-02-15 13:23:10 -08:00
Raymond Yee
25f6bd5e07
Merge branch 'master' of github.com:Gluejar/regluit into ry
2012-02-15 08:46:17 -08:00
Raymond Yee
9fb57a6b4e
At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though.
2012-02-14 18:01:13 -08:00
Raymond Yee
4024d9d3c9
book_loader was calling a merge_works more than once on the same pair of works, causing an integrity exception in WasWorks.
...
Changes made in add_related so that merge_works called only once for a given pair of works. Also put in some safeguards in merge_works to prevent from self-merging and from merging when either works is missing an id (which should happen if a work has been deleted.) Maybe we should check also to see whether the id for was is already in WasWorks
2012-02-13 14:35:08 -08:00
eric
07e578699d
Added WasWork model to track deleted works. Apply migrations!
2012-02-09 22:30:33 -05:00
eric
346bb79e38
merge comments when works are merged
2012-02-09 20:51:10 -05:00
eric
6215a7c8d8
turns out some records in googlebooks have no title!
...
https://www.googleapis.com/books/v1/volumes/?q=isbn:9780867130768
2012-02-02 11:33:51 -05:00
eric
b584684390
add "update edition" method in bookloader
2012-02-02 09:05:41 -05:00
eric
c354dcb41b
fixed sloppiness in setting .new on editions. headslap.
2012-01-31 15:07:31 -05:00
eric
d79bf7fb6b
this should stop the generation of orphan works
2012-01-31 10:01:10 -05:00
eric
e10e8e2842
catch lookup failures so as not to ruin clustering
2012-01-30 23:57:42 -05:00
eric
2d8210785f
smarter handling of null titles
2012-01-30 23:57:42 -05:00
eric
85366cc21a
handle locale in language
2012-01-28 22:16:14 -05:00
eric
efa8da19ff
pass isbn to add_by_googlebooks_id to address occasional missing isbns
2012-01-27 21:44:02 -05:00
Raymond Yee
4bd25d4ea0
Merge branch 'production2'
2012-01-27 17:19:40 -08:00
Raymond Yee
5fba8be6a6
Changed the URL so that "all collections" loaded from Librarything, not just "my library"
...
In add_related, make sure edition is not None before trying to add related editions
A demo test
2012-01-27 16:16:46 -08:00
eric
6fffbcd3d0
added guard against concurrent threads adding same googlebooks id
2012-01-27 09:35:00 -05:00
Ed Summers
db576571bb
minor formatting changes
2012-01-17 23:22:07 -05:00
Ed Summers
23c3758e84
log content from http responses that are errors
2012-01-17 23:15:24 -05:00
eric
0d19018e62
api tests working; non-google id's working
2012-01-10 15:20:02 -05:00
eric
0b91017dd5
Did what edso told me not to do- re-architected db to use generic ids
2012-01-09 13:55:22 -05:00
eric
68d6ef93fd
General cleanup and optimization of goodreads loading
2011-12-22 14:29:46 -05:00
eric
f81a4e8e6d
removed isbn_10 column and fixed many isbn13 non-compliance issues
...
apply migrations!
2011-12-19 23:26:55 -05:00
Ed Summers
55656e2d3d
now getting subjects from openlibrary instead of from googlebooks. You will need to APPLY MIGRATIONS!
2011-12-19 01:33:13 -05:00
Ed Summers
e8339697f6
works are mono-lingual now. language is now a property of Work instead of Edition. YOU WILL NEED TO APPLY MIGRATIONS!
2011-12-13 09:55:26 -05:00
eric
167dccf574
Wishlists are now filled using the Wishes intermediate table. It's named the same as previous intermediate table, and I've edited the migration so data is not lost.
...
Also, I've added methods od Wishlists to add and remove Works. There
are "source" and created columns on the Wishes table
2011-12-08 18:22:20 -05:00
Ed Summers
3b777f87aa
allow empty publication date, also make sure test database uses charset utf8 or else tests will fail
2011-11-21 14:13:29 -05:00
Raymond Yee
f73aa1b570
Added grabbing of pdf ebooks corresponding to edition
2011-11-06 17:49:25 -05:00
Ed Summers
e1ea725d0f
ebooks must have a downloadUrl
2011-11-06 17:42:09 -05:00
Ed Summers
22d904f1bf
added ebook model and add_b_oclc
2011-11-06 16:33:04 -05:00
Ed Summers
2e83847fa7
rolling back the add_related option on add_by_isbn until it is better thought out, and does not break the build...
2011-10-20 18:43:40 +00:00
Ed Summers
9901408b00
added list of supporters to the work page, just as a proof of concept more than anything.
2011-10-20 18:16:42 +00:00
Ed Summers
07073f8620
have tasks return bookloader return values
2011-10-20 05:23:30 +00:00
Ed Summers
0c1411f2e8
added celery async task for add_related that gets exercised when a book is added to a wishlist. includes new settings for the djkombu celery backend
2011-10-19 23:31:16 -04:00
Ed Summers
7bfb7c3f7f
need to trap errors when looking up a LibraryThing ISBN in GoogleBooks and getting no hit
2011-10-18 23:45:02 -04:00
Ed Summers
5c88878a30
added merge_works function for merging the one work into another when adding related editions based on ThingISBN. also added a test that makes sure related campaigns and wishlists are appropriately updated.
2011-10-18 23:00:07 -04:00
Ed Summers
5b102a6685
wiping migrations again and hoping they work this time. also catch exceptions when adding related editions.
2011-10-14 16:03:43 -04:00
Ed Summers
44449f56a3
added some comments
2011-10-14 00:12:20 -04:00
Ed Summers
ffe84fa46a
got bookloader.add_related working w/ some tests. also added Edition.language because it looks like it will be useful to know.
2011-10-14 00:02:19 -04:00
Ed Summers
983c045a8c
added bookloader.thingisbn and a test
2011-10-12 21:59:46 -04:00
Ed Summers
1b54ba5f6b
make sure there are some hits when adding a book by isbn
2011-10-10 17:26:38 -04:00
Ed Summers
e25894d549
added X-Forwarded-For for gluejar.com for the moment
2011-10-10 15:57:12 -04:00
Ed Summers
70a620b27f
moved to using googlebooks api for data. required moving authors and subjects to be associated to editions, since we google books does not have a notion of a work
2011-10-10 12:57:10 -04:00
Ed Summers
2c7f858125
handle duplicates using openlibrary ids for edition, work and author
2011-09-10 11:36:38 +00:00