Commit Graph

84 Commits (30f7f2c4ba0fa353a62f6cc091bee90187370abf)

Author SHA1 Message Date
eric d740d98e51 turned off requests logging from bookloader
the messages from requests were more than useful
2013-10-30 12:42:59 -04:00
eric 3ea697c768 create offers
must migrate core schema!
2013-06-17 18:53:28 -04:00
Andromeda Yelton ad69580b2d PEP 8, PEP 328. I feel better now. 2013-06-03 12:31:39 -04:00
eric 31a1f46666 add split works funtionality 2013-04-16 16:46:25 -04:00
eric 1881660089 intoduce Publisher and PublisherName Models
Also change our by publisher lists to key on the new name ids rather
than the names, which was yucky.
Migrations!
Data migration takes a while, don't be allarmed if it sits a while.
2013-03-25 23:41:19 -04:00
eric 05d37163ea despam descriptions in db
wasn't real happy with this: https://unglue.it/work/66938/ so I looked
for other spammy descriptions in the db
2013-03-07 11:37:40 -05:00
eric 99c434d940 [fix #45405325] fix merge subjects, also added test 2013-03-01 13:13:14 -05:00
eric 7f1dc2d3ca merge works wasn't merging claims 2012-10-05 17:55:14 -04:00
eric 3bdde8f936 finally I understand how reclustering should work 2012-08-05 18:30:13 -04:00
eric cbb40f5511 added a safer relate editions method which won't cause big clusters to merge 2012-08-05 13:05:35 -04:00
eric 05767741d6 take extra care for null works 2012-08-05 13:03:37 -04:00
eric 05eb26d2cb use correct syntax for exception lists 2012-08-02 22:36:11 -04:00
eric c0af96784b catch the exception that really occurs when there's no isbn 2012-08-02 18:35:52 -04:00
eric 1c4c0b0958 fix google all of a sudden throwing ip geolocation errors 2012-07-31 16:06:11 -04:00
eric 184dfedda9 added override of one month OL cache [#33377581] 2012-07-27 15:58:53 -04:00
eric 12671ddcdf unpack openlibrary descriptions delivered as dicts [#33377581] 2012-07-26 12:07:16 -04:00
eric 4ec7fef25c log adding book only if it's new to the database 2012-05-25 13:13:15 -04:00
eric a32b09a4cb Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""
This reverts commit 2d344a09c6.
2012-05-07 01:18:11 -04:00
eric c0cb99e040 Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"""
This reverts commit c8be251ffa.
2012-05-07 01:18:11 -04:00
eric d334fa58b0 Revert "Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""""
This reverts commit b21787a590.
2012-05-07 01:18:11 -04:00
eric e10136f1b2 Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"""
This reverts commit 1bbac102a2.
2012-05-07 01:18:11 -04:00
eric 1bbac102a2 Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""
This reverts commit 2d344a09c6.
2012-05-07 01:14:47 -04:00
eric b21787a590 Revert "Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"""
This reverts commit c8be251ffa.
2012-05-07 01:14:47 -04:00
eric c8be251ffa Revert "Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration""
This reverts commit 2d344a09c6.
2012-05-07 01:14:01 -04:00
eric 2d344a09c6 Revert "[#28945859] removed description from edition. Be sure to do data migration before applying this schema migration"
This reverts commit 7043e71c39.
2012-05-07 01:11:26 -04:00
eric 7043e71c39 [#28945859] removed description from edition. Be sure to do data migration before applying this schema migration
also fixed issues with tests failing in add_openlibrary
2012-05-07 00:42:11 -04:00
eric e93a6d7523 [#28945859] now pulling description from OL, looking for all editions 2012-05-06 22:31:38 -04:00
eric 4d13953e41 We're not allowed to store descriptions from google 2012-05-01 16:25:38 -04:00
Raymond Yee a252f9d173 [#22561067] Implemented regluit.utils.localdatetime.now is by default datetime.datetime.now() (in Django 1.3) and django.utils.timezone.now() in Django 1.4+
One overrides regluit.utils.localdatetime._now to do "time travel" -- useful for testing scenarios requiring time changes (such as Campaigns)
Get rid of call references to datetime.datetime.now() or utcnow() and datetime.date.today() in favor of regluit.utils.localdatetime.now() and date_today().
2012-03-09 00:45:39 +00:00
Raymond Yee cb3027ef2a Merge branch 'master' of github.com:Gluejar/regluit 2012-02-28 15:58:25 -08:00
eric 039f617f17 implemented ebook contribution, included non pdf/epub, license and provider in UI
many changes, couldn't run all test- some failing for unrelated reasons
2012-02-28 17:28:58 -05:00
Raymond Yee 30543c6135 Change ebook.provider from 'gutenberg' to 'Project Gutenberg' for PG books 2012-02-28 13:39:08 -08:00
Raymond Yee 538d225ad0 Merge branch 'production' 2012-02-24 14:56:45 -08:00
eric 4b943d1acb fixed bug where edition.public_domain never gets set 2012-02-23 18:51:29 -05:00
Raymond Yee 09ab830c20 Return the list of google books ids that are not recognized any more when trying to add ISBNs corresponding to isbn-less Editions that have Google Books IDs 2012-02-16 13:18:22 -08:00
Raymond Yee cf2e937969 Merge branch 'master' into ry 2012-02-16 10:45:53 -08:00
Raymond Yee fb5ad2da76 Add tracking for google_id_not_found to add_missing_isbn_to_editions
Add a django-admin command to run add_missing_isbn_to_editions
2012-02-16 10:44:13 -08:00
eric 471cb62fd2 changed core.tasks to not use models 2012-02-16 13:19:36 -05:00
Raymond Yee 4752181ace Move add_missing_isbn_to_editions to bookloader.py 2012-02-15 19:36:18 -08:00
Raymond Yee 8c397f4953 Merge branch 'master' of github.com:Gluejar/regluit into ry 2012-02-15 13:23:58 -08:00
Raymond Yee b7f47bfee5 Add a few comments to explain how various parts of our bookloading process works 2012-02-15 13:23:10 -08:00
Raymond Yee 25f6bd5e07 Merge branch 'master' of github.com:Gluejar/regluit into ry 2012-02-15 08:46:17 -08:00
Raymond Yee 9fb57a6b4e At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though. 2012-02-14 18:01:13 -08:00
Raymond Yee 4024d9d3c9 book_loader was calling a merge_works more than once on the same pair of works, causing an integrity exception in WasWorks.
Changes made in add_related so that merge_works called only once for a given pair of works.   Also put in some safeguards in merge_works to prevent from self-merging and from merging when either works is missing an id (which should happen if a work has been deleted.)  Maybe we should check also to see whether the id for was is already in WasWorks
2012-02-13 14:35:08 -08:00
eric 07e578699d Added WasWork model to track deleted works. Apply migrations! 2012-02-09 22:30:33 -05:00
eric 346bb79e38 merge comments when works are merged 2012-02-09 20:51:10 -05:00
eric 6215a7c8d8 turns out some records in googlebooks have no title!
https://www.googleapis.com/books/v1/volumes/?q=isbn:9780867130768
2012-02-02 11:33:51 -05:00
eric b584684390 add "update edition" method in bookloader 2012-02-02 09:05:41 -05:00
eric c354dcb41b fixed sloppiness in setting .new on editions. headslap. 2012-01-31 15:07:31 -05:00
eric d79bf7fb6b this should stop the generation of orphan works 2012-01-31 10:01:10 -05:00