Commit Graph

43 Commits (cb7eb017868f201437db51d75406d36dc7afdb2e)

Author SHA1 Message Date
Raymond Yee 5572608b39 Merge pull request #641 from Gluejar/improve-doab-import
Improve doab import
2016-11-02 06:06:41 -07:00
Raymond Yee 77e47821f4 a Jupyter notebook in which I've tried the utilities 2016-10-28 10:42:09 -07:00
Raymond Yee 5e82fa81f0 committing doab.json from 441c203baa/doab.json 2016-10-24 10:00:58 -07:00
eric 3ac7769656 move doab.py into loaders 2016-10-11 15:46:03 -04:00
Raymond Yee 59d9ed4a17 change the various crontabs
add notebooks/fix_build_3550.ipynb, which is not directly related to celery
2016-06-24 14:23:03 -07:00
Raymond Yee 3cb6553933 add notebook I used to find a good substitute 2016-03-25 15:13:09 -07:00
eric 1ccdc144ba display publication range
needs a migration
2015-10-05 19:17:16 -04:00
Raymond Yee 0fbb4f702c work in progress on parameterizing config_name 2015-07-03 11:06:55 -07:00
Raymond Yee 0c91a328be added a notebook I used to check the work for PR 483 2015-04-30 11:30:48 -07:00
Raymond Yee b61a4a0e0c 1) updated settings/dev.py to reflect new parameters needed for python-social-auth
2) added an IPython notebook to run Selenium test
2015-04-10 16:05:12 -07:00
Raymond Yee 53a37b1b31 Merge branch 'master' into mobigen_integrate 2015-04-03 10:05:02 -07:00
Raymond Yee edd65c08c3 make sure the campaigns for the editions returned by editions_to_convert are not b2u. 2015-02-02 15:05:36 -08:00
Raymond Yee b7229eabbe add the ipynb used to test this PR 2015-01-28 11:52:38 -08:00
Raymond Yee e9d8080c3b First cut of celery tasks for converting to mobi 2015-01-23 15:52:35 -08:00
Raymond Yee 7fa97fbf83 The code for converting a book w/o mobi and writing it to S3 works....
The main problem is we need to make the process of doing the conversion asynchronous.
2015-01-20 15:41:40 -08:00
Raymond Yee eb7bba0eaa work in progress 2014-12-18 14:52:06 -05:00
Raymond Yee 12450db418 work in progress 2014-12-16 13:46:24 -08:00
Raymond Yee 0577b4f825 work in progress 2014-12-11 08:43:03 -08:00
Raymond Yee 5995ae610a Moved code to call the mobigen service from .ipynb to regluit.core.mobigen (may eventually want to move core/mobigen.py to external package) 2014-12-09 11:56:27 -08:00
Raymond Yee 0f2dfaa487 first pass at writing integration (prototyped in ipynb format) 2014-12-03 07:53:56 -08:00
Raymond Yee a80edecb4e starting a notebook to figure out where to apply mobigen 2014-11-24 15:39:13 -08:00
Raymond Yee 307db5a995 Merge branch 'master' into doab_load 2014-07-25 14:45:22 -07:00
Raymond Yee 6b7749b6be in active_campaigns feed, exclude books w/o ebooks 2014-07-25 13:49:12 -07:00
Raymond Yee 967bd2dcae code can now load description, subjects and covers for the pdf files 2014-07-24 16:29:28 -07:00
Raymond Yee 0fad9dd102 code that is basically working in IPython notebook for loading work.description, edition.publication_date, work.subjects, and edition.publisher_name 2014-07-23 16:09:18 -07:00
Raymond Yee 45a89ee055 Merge branch 'master' into doab_load 2014-07-22 15:36:40 -07:00
Raymond Yee 7f02fcd126 The doab_load_books django command is working again -- I had to fix the signatures of some methods 2014-07-16 15:26:19 -07:00
Raymond Yee 359b7f003f I think I have a pretty good cut at code for uploading DOAB covers to our S3 space and integrating that code into uploading the DOAB records 2014-07-16 13:30:16 -07:00
Raymond Yee c3cfffe5eb Now I have a function to take a doab_id and upload the cover to S3 (if the cover is not already there.) 2014-07-14 15:09:16 -07:00
Raymond Yee ce05d4e5ba start of writing code to download and write DOAB covers to local file storage 2014-07-08 14:30:17 -07:00
Raymond Yee 4201d2dcc0 doab_loading.ipynb has some code now for loading DOAB cover images 2014-07-08 12:48:32 -07:00
Raymond Yee d14a0dc497 Fixed bug in load_doab_edition: new Work needs to be saved before attaching IDs to it.
code in doab_load.ipynb to load books and test the integrity of the load.  Big surprise (to me):  to find invalid ISBNs in the DOAB data
2014-07-08 09:29:31 -07:00
Raymond Yee 5b3a8d7b13 I've moved the new version of load_doab_edition into core/doab.py from notebook.
Code in doab_loading.ipynb for testing the loading
2014-07-07 11:00:52 -07:00
Raymond Yee 0794545d09 first draft of a rewrite of load_doab_edition to handle multiple ISBNs --> at least in ipynb form 2014-07-03 15:50:22 -07:00
Raymond Yee 833f077de1 With the new arguments in doab.json, I needed to add a catch-all **kwargs to load_doab_edition
functions in regluit.core.doab and regluit.core.tasks.
2014-07-03 10:45:57 -07:00
Raymond Yee fbc6c61587 The notebook is a bit out of date but I want to put it under git control before updating it. 2014-07-03 09:57:30 -07:00
Raymond Yee b356699c9b First pass at /opds/{facet} --> now with active_campaigns too 2014-06-25 18:05:57 -07:00
Raymond Yee 8830919318 Add feed=opds to download URLs for ebooks in OPDS feed 2014-06-25 16:54:01 -07:00
Raymond Yee 49133935a0 First draft of opds/creativecommons.xml 2014-06-24 15:27:40 -07:00
Raymond Yee 3552e02031 Now able to create static versions of the navigation and acquisition feeds for all CC books. 2014-06-17 17:48:00 -04:00
Raymond Yee 847c065d0b now starting to generate part of nav opds 2014-06-16 15:58:16 -04:00
Raymond Yee f6e7c834de A notebook to parse some existing OPDS feeds and to start creating ones too. 2014-06-13 18:47:20 -04:00
eric 99c24f5fbf move notebooks and dev code into notebooks folder 2013-08-05 12:21:06 -04:00