d69921c109
loader now aware that agent_name is reversed
2015-09-12 19:20:08 -04:00
fa440d7935
wrong code for gutenberg id
2015-08-21 18:13:50 -04:00
779ba45d97
don't add v to version string
...
don't load ebook if version string starts with 0.0.
add test with local version
2015-08-18 06:57:14 -04:00
42c66c29b6
fix rights lookup
...
also sync cc.py in core with cc.py in gitenberg metadata. Will DRY
later.
2015-08-07 01:21:15 -04:00
f79daf09db
use gitenberg.metadata
2015-08-03 10:04:07 -04:00
c9ae756743
add url to loaded ids
2015-07-31 16:34:47 -04:00
7932e047d7
basic api wiring
2015-07-30 00:34:05 -04:00
098eddc327
work in progress
2015-07-29 23:01:43 -04:00
5185410825
get tests to pass
2015-07-28 09:41:55 -04:00
a9d4a71912
fixed an incorrect reference, uncovered by the tests!
2015-02-03 15:41:38 -08:00
53b62642cd
more idiomatic increment
2015-02-02 13:31:10 -05:00
7cb0f473de
remove many-commas subjects, prevent their addition
2015-01-30 11:33:22 -05:00
b54b21fdfe
keep is_free up to date
2014-12-13 12:37:35 -05:00
a5d3dfdf4f
add_author method
2014-10-20 16:54:19 -04:00
bc7850a2a9
add featured column, use it
2014-07-01 10:07:07 -07:00
7e72a8fff6
remove code that was truncating language codes
2014-06-06 14:47:36 -04:00
0ef460b09e
book loader was stomping on selected edition selections
2014-04-14 17:43:06 -04:00
8a5d92adaf
remove public_domain
...
never used, not accurate
2014-03-10 15:48:53 -04:00
0840a1fd71
implement holds. Also fix borrow view that didn't specify work.
2013-11-08 12:13:34 -05:00
d740d98e51
turned off requests logging from bookloader
...
the messages from requests were more than useful
2013-10-30 12:42:59 -04:00
3ea697c768
create offers
...
must migrate core schema!
2013-06-17 18:53:28 -04:00
ad69580b2d
PEP 8, PEP 328. I feel better now.
2013-06-03 12:31:39 -04:00
31a1f46666
add split works funtionality
2013-04-16 16:46:25 -04:00
1881660089
intoduce Publisher and PublisherName Models
...
Also change our by publisher lists to key on the new name ids rather
than the names, which was yucky.
Migrations!
Data migration takes a while, don't be allarmed if it sits a while.
2013-03-25 23:41:19 -04:00
05d37163ea
despam descriptions in db
...
wasn't real happy with this: https://unglue.it/work/66938/ so I looked
for other spammy descriptions in the db
2013-03-07 11:37:40 -05:00
99c434d940
[ fix #45405325 ] fix merge subjects, also added test
2013-03-01 13:13:14 -05:00
7f1dc2d3ca
merge works wasn't merging claims
2012-10-05 17:55:14 -04:00
3bdde8f936
finally I understand how reclustering should work
2012-08-05 18:30:13 -04:00
cbb40f5511
added a safer relate editions method which won't cause big clusters to merge
2012-08-05 13:05:35 -04:00
05767741d6
take extra care for null works
2012-08-05 13:03:37 -04:00
05eb26d2cb
use correct syntax for exception lists
2012-08-02 22:36:11 -04:00
c0af96784b
catch the exception that really occurs when there's no isbn
2012-08-02 18:35:52 -04:00
1c4c0b0958
fix google all of a sudden throwing ip geolocation errors
2012-07-31 16:06:11 -04:00
184dfedda9
added override of one month OL cache [ #33377581 ]
2012-07-27 15:58:53 -04:00
12671ddcdf
unpack openlibrary descriptions delivered as dicts [ #33377581 ]
2012-07-26 12:07:16 -04:00
4ec7fef25c
log adding book only if it's new to the database
2012-05-25 13:13:15 -04:00
a32b09a4cb
Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration""
...
This reverts commit 2d344a09c6
2012-05-07 01:18:11 -04:00
c0cb99e040
Revert "Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration"""
...
This reverts commit c8be251ffa
2012-05-07 01:18:11 -04:00
d334fa58b0
Revert "Revert "Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration""""
...
This reverts commit b21787a590
2012-05-07 01:18:11 -04:00
e10136f1b2
Revert "Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration"""
...
This reverts commit 1bbac102a2
2012-05-07 01:18:11 -04:00
1bbac102a2
Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration""
...
This reverts commit 2d344a09c6
2012-05-07 01:14:47 -04:00
b21787a590
Revert "Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration"""
...
This reverts commit c8be251ffa
2012-05-07 01:14:47 -04:00
c8be251ffa
Revert "Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration""
...
This reverts commit 2d344a09c6
2012-05-07 01:14:01 -04:00
2d344a09c6
Revert "[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration"
...
This reverts commit 7043e71c39
2012-05-07 01:11:26 -04:00
7043e71c39
[ #28945859 ] removed description from edition. Be sure to do data migration before applying this schema migration
...
also fixed issues with tests failing in add_openlibrary
2012-05-07 00:42:11 -04:00
e93a6d7523
[ #28945859 ] now pulling description from OL, looking for all editions
2012-05-06 22:31:38 -04:00
4d13953e41
We're not allowed to store descriptions from google
2012-05-01 16:25:38 -04:00
a252f9d173
[ #22561067 ] Implemented regluit.utils.localdatetime.now is by default datetime.datetime.now() (in Django 1.3) and django.utils.timezone.now() in Django 1.4+
...
One overrides regluit.utils.localdatetime._now to do "time travel" -- useful for testing scenarios requiring time changes (such as Campaigns)
Get rid of call references to datetime.datetime.now() or utcnow() and datetime.date.today() in favor of regluit.utils.localdatetime.now() and date_today().
2012-03-09 00:45:39 +00:00
cb3027ef2a
Merge branch 'master' of github.com:Gluejar/regluit
2012-02-28 15:58:25 -08:00
039f617f17
implemented ebook contribution, included non pdf/epub, license and provider in UI
...
many changes, couldn't run all test- some failing for unrelated reasons
2012-02-28 17:28:58 -05:00
30543c6135
Change ebook.provider from 'gutenberg' to 'Project Gutenberg' for PG books
2012-02-28 13:39:08 -08:00
538d225ad0
Merge branch 'production'
2012-02-24 14:56:45 -08:00
4b943d1acb
fixed bug where edition.public_domain never gets set
2012-02-23 18:51:29 -05:00
09ab830c20
Return the list of google books ids that are not recognized any more when trying to add ISBNs corresponding to isbn-less Editions that have Google Books IDs
2012-02-16 13:18:22 -08:00
cf2e937969
Merge branch 'master' into ry
2012-02-16 10:45:53 -08:00
fb5ad2da76
Add tracking for google_id_not_found to add_missing_isbn_to_editions
...
Add a django-admin command to run add_missing_isbn_to_editions
2012-02-16 10:44:13 -08:00
471cb62fd2
changed core.tasks to not use models
2012-02-16 13:19:36 -05:00
4752181ace
Move add_missing_isbn_to_editions to bookloader.py
2012-02-15 19:36:18 -08:00
8c397f4953
Merge branch 'master' of github.com:Gluejar/regluit into ry
2012-02-15 13:23:58 -08:00
b7f47bfee5
Add a few comments to explain how various parts of our bookloading process works
2012-02-15 13:23:10 -08:00
25f6bd5e07
Merge branch 'master' of github.com:Gluejar/regluit into ry
2012-02-15 08:46:17 -08:00
9fb57a6b4e
At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though.
2012-02-14 18:01:13 -08:00
4024d9d3c9
book_loader was calling a merge_works more than once on the same pair of works, causing an integrity exception in WasWorks.
...
Changes made in add_related so that merge_works called only once for a given pair of works. Also put in some safeguards in merge_works to prevent from self-merging and from merging when either works is missing an id (which should happen if a work has been deleted.) Maybe we should check also to see whether the id for was is already in WasWorks
2012-02-13 14:35:08 -08:00
07e578699d
Added WasWork model to track deleted works. Apply migrations!
2012-02-09 22:30:33 -05:00
346bb79e38
merge comments when works are merged
2012-02-09 20:51:10 -05:00
6215a7c8d8
turns out some records in googlebooks have no title!
...
https://www.googleapis.com/books/v1/volumes/?q=isbn:9780867130768
2012-02-02 11:33:51 -05:00
b584684390
add "update edition" method in bookloader
2012-02-02 09:05:41 -05:00
c354dcb41b
fixed sloppiness in setting .new on editions. headslap.
2012-01-31 15:07:31 -05:00
d79bf7fb6b
this should stop the generation of orphan works
2012-01-31 10:01:10 -05:00
e10e8e2842
catch lookup failures so as not to ruin clustering
2012-01-30 23:57:42 -05:00
2d8210785f
smarter handling of null titles
2012-01-30 23:57:42 -05:00
85366cc21a
handle locale in language
2012-01-28 22:16:14 -05:00
efa8da19ff
pass isbn to add_by_googlebooks_id to address occasional missing isbns
2012-01-27 21:44:02 -05:00
4bd25d4ea0
Merge branch 'production2'
2012-01-27 17:19:40 -08:00
5fba8be6a6
Changed the URL so that "all collections" loaded from Librarything, not just "my library"
...
In add_related, make sure edition is not None before trying to add related editions
A demo test
2012-01-27 16:16:46 -08:00
6fffbcd3d0
added guard against concurrent threads adding same googlebooks id
2012-01-27 09:35:00 -05:00
db576571bb
minor formatting changes
2012-01-17 23:22:07 -05:00
23c3758e84
log content from http responses that are errors
2012-01-17 23:15:24 -05:00
0d19018e62
api tests working; non-google id's working
2012-01-10 15:20:02 -05:00
0b91017dd5
Did what edso told me not to do- re-architected db to use generic ids
2012-01-09 13:55:22 -05:00
68d6ef93fd
General cleanup and optimization of goodreads loading
2011-12-22 14:29:46 -05:00
f81a4e8e6d
removed isbn_10 column and fixed many isbn13 non-compliance issues
...
apply migrations!
2011-12-19 23:26:55 -05:00
55656e2d3d
now getting subjects from openlibrary instead of from googlebooks. You will need to APPLY MIGRATIONS!
2011-12-19 01:33:13 -05:00
e8339697f6
works are mono-lingual now. language is now a property of Work instead of Edition. YOU WILL NEED TO APPLY MIGRATIONS!
2011-12-13 09:55:26 -05:00
167dccf574
Wishlists are now filled using the Wishes intermediate table. It's named the same as previous intermediate table, and I've edited the migration so data is not lost.
...
Also, I've added methods od Wishlists to add and remove Works. There
are "source" and created columns on the Wishes table
2011-12-08 18:22:20 -05:00
3b777f87aa
allow empty publication date, also make sure test database uses charset utf8 or else tests will fail
2011-11-21 14:13:29 -05:00
f73aa1b570
Added grabbing of pdf ebooks corresponding to edition
2011-11-06 17:49:25 -05:00
e1ea725d0f
ebooks must have a downloadUrl
2011-11-06 17:42:09 -05:00
22d904f1bf
added ebook model and add_b_oclc
2011-11-06 16:33:04 -05:00
2e83847fa7
rolling back the add_related option on add_by_isbn until it is better thought out, and does not break the build...
2011-10-20 18:43:40 +00:00
9901408b00
added list of supporters to the work page, just as a proof of concept more than anything.
2011-10-20 18:16:42 +00:00
07073f8620
have tasks return bookloader return values
2011-10-20 05:23:30 +00:00
0c1411f2e8
added celery async task for add_related that gets exercised when a book is added to a wishlist. includes new settings for the djkombu celery backend
2011-10-19 23:31:16 -04:00
7bfb7c3f7f
need to trap errors when looking up a LibraryThing ISBN in GoogleBooks and getting no hit
2011-10-18 23:45:02 -04:00
5c88878a30
added merge_works function for merging the one work into another when adding related editions based on ThingISBN. also added a test that makes sure related campaigns and wishlists are appropriately updated.
2011-10-18 23:00:07 -04:00
5b102a6685
wiping migrations again and hoping they work this time. also catch exceptions when adding related editions.
2011-10-14 16:03:43 -04:00
44449f56a3
added some comments
2011-10-14 00:12:20 -04:00
ffe84fa46a
got bookloader.add_related working w/ some tests. also added Edition.language because it looks like it will be useful to know.
2011-10-14 00:02:19 -04:00
983c045a8c
added bookloader.thingisbn and a test
2011-10-12 21:59:46 -04:00
1b54ba5f6b
make sure there are some hits when adding a book by isbn
2011-10-10 17:26:38 -04:00
eric
Raymond Yee
Andromeda Yelton
Ed Summers