Commit Graph

76 Commits (33e652881cba903520d446a6483841b9a7d8c359)

Author SHA1 Message Date
eric 3bdde8f936 finally I understand how reclustering should work 2012-08-05 18:30:13 -04:00
eric cbb40f5511 added a safer relate editions method which won't cause big clusters to merge 2012-08-05 13:05:35 -04:00
eric 05767741d6 take extra care for null works 2012-08-05 13:03:37 -04:00
eric 05eb26d2cb use correct syntax for exception lists 2012-08-02 22:36:11 -04:00
eric c0af96784b catch the exception that really occurs when there's no isbn 2012-08-02 18:35:52 -04:00
eric 1c4c0b0958 fix google all of a sudden throwing ip geolocation errors 2012-07-31 16:06:11 -04:00
eric 184dfedda9 added override of one month OL cache [#33377581] 2012-07-27 15:58:53 -04:00
eric 12671ddcdf unpack openlibrary descriptions delivered as dicts [#33377581] 2012-07-26 12:07:16 -04:00
eric 4ec7fef25c log adding book only if it's new to the database 2012-05-25 13:13:15 -04:00
eric a32b09a4cb Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""
This reverts commit 2d344a09c6.
2012-05-07 01:18:11 -04:00
eric c0cb99e040 Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"""
This reverts commit c8be251ffa.
2012-05-07 01:18:11 -04:00
eric d334fa58b0 Revert "Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""""
This reverts commit b21787a590.
2012-05-07 01:18:11 -04:00
eric e10136f1b2 Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"""
This reverts commit 1bbac102a2.
2012-05-07 01:18:11 -04:00
eric 1bbac102a2 Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""
This reverts commit 2d344a09c6.
2012-05-07 01:14:47 -04:00
eric b21787a590 Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"""
This reverts commit c8be251ffa.
2012-05-07 01:14:47 -04:00
eric c8be251ffa Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""
This reverts commit 2d344a09c6.
2012-05-07 01:14:01 -04:00
eric 2d344a09c6 Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"
This reverts commit 7043e71c39.
2012-05-07 01:11:26 -04:00
eric 7043e71c39 [#28945859] removed description from edition. Be sure to do data migration before applying this schema migration
also fixed issues with tests failing in add_openlibrary
2012-05-07 00:42:11 -04:00
eric e93a6d7523 [#28945859] now pulling description from OL, looking for all editions 2012-05-06 22:31:38 -04:00
eric 4d13953e41 We're not allowed to store descriptions from google 2012-05-01 16:25:38 -04:00
Raymond Yee a252f9d173 [#22561067] Implemented regluit.utils.localdatetime.now is by default datetime.datetime.now() (in Django 1.3) and django.utils.timezone.now() in Django 1.4+
One overrides regluit.utils.localdatetime._now to do "time travel" -- useful for testing scenarios requiring time changes (such as Campaigns)
Get rid of call references to datetime.datetime.now() or utcnow() and datetime.date.today() in favor of regluit.utils.localdatetime.now() and date_today().
2012-03-09 00:45:39 +00:00
Raymond Yee cb3027ef2a Merge branch 'master' of github.com:Gluejar/regluit 2012-02-28 15:58:25 -08:00
eric 039f617f17 implemented ebook contribution, included non pdf/epub, license and provider in UI
many changes, couldn't run all test- some failing for unrelated reasons
2012-02-28 17:28:58 -05:00
Raymond Yee 30543c6135 Change ebook.provider from 'gutenberg' to 'Project Gutenberg' for PG books 2012-02-28 13:39:08 -08:00
Raymond Yee 538d225ad0 Merge branch 'production' 2012-02-24 14:56:45 -08:00
eric 4b943d1acb fixed bug where edition.public_domain never gets set 2012-02-23 18:51:29 -05:00
Raymond Yee 09ab830c20 Return the list of google books ids that are not recognized any more when trying to add ISBNs corresponding to isbn-less Editions that have Google Books IDs 2012-02-16 13:18:22 -08:00
Raymond Yee cf2e937969 Merge branch 'master' into ry 2012-02-16 10:45:53 -08:00
Raymond Yee fb5ad2da76 Add tracking for google_id_not_found to add_missing_isbn_to_editions
Add a django-admin command to run add_missing_isbn_to_editions
2012-02-16 10:44:13 -08:00
eric 471cb62fd2 changed core.tasks to not use models 2012-02-16 13:19:36 -05:00
Raymond Yee 4752181ace Move add_missing_isbn_to_editions to bookloader.py 2012-02-15 19:36:18 -08:00
Raymond Yee 8c397f4953 Merge branch 'master' of github.com:Gluejar/regluit into ry 2012-02-15 13:23:58 -08:00
Raymond Yee b7f47bfee5 Add a few comments to explain how various parts of our bookloading process works 2012-02-15 13:23:10 -08:00
Raymond Yee 25f6bd5e07 Merge branch 'master' of github.com:Gluejar/regluit into ry 2012-02-15 08:46:17 -08:00
Raymond Yee 9fb57a6b4e At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though. 2012-02-14 18:01:13 -08:00
Raymond Yee 4024d9d3c9 book_loader was calling a merge_works more than once on the same pair of works, causing an integrity exception in WasWorks.
Changes made in add_related so that merge_works called only once for a given pair of works.   Also put in some safeguards in merge_works to prevent from self-merging and from merging when either works is missing an id (which should happen if a work has been deleted.)  Maybe we should check also to see whether the id for was is already in WasWorks
2012-02-13 14:35:08 -08:00
eric 07e578699d Added WasWork model to track deleted works. Apply migrations! 2012-02-09 22:30:33 -05:00
eric 346bb79e38 merge comments when works are merged 2012-02-09 20:51:10 -05:00
eric 6215a7c8d8 turns out some records in googlebooks have no title!
https://www.googleapis.com/books/v1/volumes/?q=isbn:9780867130768
2012-02-02 11:33:51 -05:00
eric b584684390 add "update edition" method in bookloader 2012-02-02 09:05:41 -05:00
eric c354dcb41b fixed sloppiness in setting .new on editions. headslap. 2012-01-31 15:07:31 -05:00
eric d79bf7fb6b this should stop the generation of orphan works 2012-01-31 10:01:10 -05:00
eric e10e8e2842 catch lookup failures so as not to ruin clustering 2012-01-30 23:57:42 -05:00
eric 2d8210785f smarter handling of null titles 2012-01-30 23:57:42 -05:00
eric 85366cc21a handle locale in language 2012-01-28 22:16:14 -05:00
eric efa8da19ff pass isbn to add_by_googlebooks_id to address occasional missing isbns 2012-01-27 21:44:02 -05:00
Raymond Yee 4bd25d4ea0 Merge branch 'production2' 2012-01-27 17:19:40 -08:00
Raymond Yee 5fba8be6a6 Changed the URL so that "all collections" loaded from Librarything, not just "my library"
In add_related, make sure edition is not None before trying to add related editions
A demo test
2012-01-27 16:16:46 -08:00
eric 6fffbcd3d0 added guard against concurrent threads adding same googlebooks id 2012-01-27 09:35:00 -05:00
Ed Summers db576571bb minor formatting changes 2012-01-17 23:22:07 -05:00