Commit Graph

44 Commits (e757eae0a3f6589c0001af2d3b9595892ec91092)

Author SHA1 Message Date
Raymond Yee 8a85aa88d3 first cut at producing iterator interfaces to Stripe objects -- here I implement one for events
don't yield empty page in bookdata.py's grouper
remove extraneous import in gutenberg.py
expose stripe test key as a module variable to make it easier to create a StripeClient that will be in test mode (sc=StipeClient(api_key=TEST_STRIPE_SK))
2012-10-18 06:59:08 -07:00
Raymond Yee f7e49edfcb Continuing work on collecting info for OLA pledges 2012-07-18 10:49:25 -07:00
Raymond Yee d0fb4c8f59 Added some starter code to export data about unglue.it activity 2012-05-30 14:44:48 -07:00
Raymond Yee b9c272ae74 Removing stuff I had put into ry branch, specifically the experimental branch 2012-04-18 15:12:15 -07:00
Raymond Yee 5a9c8fe207 Simple experimental view 2012-03-02 09:31:13 -08:00
Raymond Yee f4e2960ae1 Putting in a skeleton to build views in experimental 2012-03-01 20:06:00 -08:00
Raymond Yee ddd60f5a34 Deleting lt_data.json.gz from git repo 2012-02-27 14:16:23 -08:00
Raymond Yee c98258e459 Add g_seed_isbn.json which hold the Gutenberg editions I'm loading. 2012-02-27 13:58:47 -08:00
Raymond Yee 446907109f Compute similarity measures and allow filtering of Gutenberg editions by these measures 2012-02-27 13:58:34 -08:00
Raymond Yee 86fb15b8bc Code to repick the seed isbn to find isbns that are more likely to be found in a wide variety of data sources 2012-02-27 13:58:17 -08:00
Raymond Yee f7220d9812 Programs and data for fighting Frankenworks 2012-02-24 12:06:24 -08:00
Raymond Yee 1d001f33ba Now I think I'm able to calculate the timedate of when the latest "frankenwork" merging is happening 2012-02-21 08:54:12 -08:00
Raymond Yee e4c23500fb Putting a copy of the Librarything data into the repo 2012-02-17 13:48:57 -08:00
Raymond Yee 2e079b2c2e Now I have booktests to recalculate clusters 2012-02-17 10:30:09 -08:00
eric 471cb62fd2 changed core.tasks to not use models 2012-02-16 13:19:36 -05:00
Raymond Yee a8f1c157be Check current progress in so that I can focus on a change in the master branch to add missing isbns to Editions 2012-02-15 16:06:40 -08:00
Raymond Yee 9fb57a6b4e At this point, I have logic in regluit.test.bookloader.load_gutenberg_books to read the data from regluit/experimental/gutenberg/g_seed_isbn.json and load books into the db. Still shaking out bugs from the process though. 2012-02-14 18:01:13 -08:00
Raymond Yee c04aacec4a Putting away my work for ry...hope it's ok 2012-02-13 11:28:21 -08:00
Raymond Yee a9c91bf9c8 Changed the number of Gutenberg books to process 2012-02-11 18:01:37 -08:00
Raymond Yee cfc3dd3549 Code that I'm now running in quasi-production on my laptop to compute the seed isbn. Let's see how it goes 2012-02-10 19:15:35 -08:00
Raymond Yee b5c663f82f basics of database structure for running through all the Gutenberg books.
Generating a report on each seed isbn calc
2012-02-10 10:56:08 -08:00
Raymond Yee d3a183bc61 OK: I'm able to return a single candidate isbn seed now while at the same time caching the results 2012-02-08 14:28:46 -08:00
Raymond Yee 3bc5da4685 Now able to cluster isbns by language of work 2012-02-08 10:44:18 -08:00
Raymond Yee d06ee6a67e Progress towards calculating the seed isbn: calculating a union of Freebase + OpenLibrary ISBNs -- then clustered with thingisbn an feeding these ISBNs to Google Books 2012-02-07 22:52:50 -08:00
Raymond Yee 2d98cf9b0a Now looking at thingisbn data and printing out more data from Google Books (publication data, publisher) 2012-02-03 10:08:48 -08:00
Raymond Yee 9cf875c62a ol.xisbn working now. Running a test comparing OL, Freebase and Google Books on editions for Surfacing 2012-02-03 09:00:52 -08:00
Raymond Yee 6e5f52db4b work in progress, especially openlibrary xisbn 2012-02-02 23:07:25 -08:00
Raymond Yee 6d6f9a2724 Small change to the basic hello world tests 2012-01-13 09:39:46 -08:00
Raymond Yee a08944c465 Make sure there are creators before printing them 2012-01-13 09:36:40 -08:00
Raymond Yee 33b5548b41 Changing Zotero.items() -> Zotero.top() and put exception handling to see what does work vs what doesn't. 2012-01-13 09:20:54 -08:00
Raymond Yee 16d8716f87 Adding a "hello world" test file to test basic functionality of pyzotero 2012-01-13 07:37:25 -08:00
Raymond Yee 6c21074ee7 Added some comments to gutenberg.py
Trying to debug zotero_books.py -- pyzotero seems to be quite broken now
2012-01-12 17:52:10 -08:00
Ed Summers 55656e2d3d now getting subjects from openlibrary instead of from googlebooks. You will need to APPLY MIGRATIONS! 2011-12-19 01:33:13 -05:00
Raymond Yee 4818e92ba2 Writing out the mapping of Gutenberg epub file to OpenLibrary workid 2011-12-12 10:49:33 -08:00
Raymond Yee d1b58c89ad Added bookdata.json_for_olid to pull out metadata for any given OpenLibrary ID (olid), including work, edition, author
Added map_refine_fb_links_to_openlibrary_work_ids in gutenberg.py to do the mapping of Freebase IDs -> OpenLibrary work ids and capture in database
2011-12-10 14:18:22 -08:00
eric 167dccf574 Wishlists are now filled using the Wishes intermediate table. It's named the same as previous intermediate table, and I've edited the migration so data is not lost.
Also, I've added methods od Wishlists to add and remove Works. There
are "source" and created columns on the Wishes table
2011-12-08 18:22:20 -05:00
Raymond Yee a349cb0adf Current results post-Refine processing of Gutenberg etext_id -> Freebase IDs (via Wikipedia links) 2011-12-05 09:47:52 -08:00
Raymond Yee 810e8ac3e7 Code so far to parse Project Gutenberg catalog, extract Wikipedia links, do some Google Refine munging, and then map Freebase ids to OpenLibrary Work IDs 2011-12-05 09:23:17 -08:00
Raymond Yee e121e07e72 Added xisbn-like method based on Freebase data; Added a Freebase /book/book id to OpenLibrary work id mapper 2011-12-05 09:19:07 -08:00
Ed Summers 30e6dc38cd experimental scripts to try to match metadata in oai-pmh feeds (online books page) to googlebooks 2011-12-04 21:45:53 -05:00
Raymond Yee 31edebe769 Fleshing out Freebase book data search 2011-11-09 09:09:58 -08:00
Raymond Yee 68b4da17d1 Some code for OpenLibrary, Freebase, HathiTrust to explore the nature of the data available in those sources 2011-11-06 07:55:07 -05:00
Raymond Yee 820107bd4d Got oauth signing to work with goodreads reviews_list 2011-11-04 14:04:32 -07:00
Raymond Yee 29104f6347 Setting up an experimental folder to hold proof of concept code 2011-11-02 17:48:38 -07:00