Commit Graph

6484 Commits (604260363faa90c069f729bef3c35dc082480cca)

Author SHA1 Message Date
eshellman 28c9aaa9b9
Merge pull request #766 from Gluejar/doab
Doab OAI harvest
2018-04-16 13:47:08 -04:00
eric 5671856daa ... and the management command 2018-04-16 13:46:33 -04:00
eric 8dd1fb1822 remove doab author loader
now uses oai functionality
2018-04-16 13:44:10 -04:00
eric b849f3a6ef finish mapping languages 2018-04-16 12:32:21 -04:00
eric a6039e4015 better handling of language codes 2018-04-13 14:39:03 -04:00
eric e433c13108 fix online_to_download bugs 2018-04-13 14:38:39 -04:00
eric 9a6b1efd0d fix bugs for records with missing fields 2018-04-13 14:37:50 -04:00
eric add1ed54e7 improve logging for bookloader 2018-04-13 14:35:38 -04:00
eric ba7b02b939 add alternate url pattern for doab_id 2018-04-12 15:09:07 -04:00
eric bf7a9d8106 patch for missing language 2018-04-12 15:08:29 -04:00
eric 748b0eaa63 add test 2018-04-09 17:26:04 -04:00
eric cdcd322210 added harvest_online_ebooks management command 2018-04-09 16:59:35 -04:00
eric c26e365a64 fixed imports 2018-04-09 16:58:58 -04:00
eric ca94c128de online to download handling
+ fix bug that made everythong 'online'
+ handle online ebooks with multiple format downloads
+ download ebooks with volatile links
+ move contenttyper to core.loaders.utils
+ add handling for really html ebooks
2018-04-09 16:32:52 -04:00
eric 9e101fcd99 inconsequential bug 2018-04-09 16:29:04 -04:00
eric 07fd095b9a fix bugs 2018-04-09 11:54:16 -04:00
eric a982588808 bugfix
handle librarything outage
2018-04-09 11:52:39 -04:00
eric 4f7f3c566c Merge remote-tracking branch 'Gluejar/master' into doab 2018-04-07 18:39:18 -04:00
eric 0ba2906c62 delint 2018-04-07 18:38:33 -04:00
eric e03fa239b4 revamp doab loading
- doab loading now done primarily by oai, no processing of csv.
- added pyoai and updated lxml
- doab ids or urls in ebook submission now handled by oai scrape
- doab_load_books removed
- doab_utils moved from Gluejar/DOAB
- licenses now recognizes OpenEdition
- new ebook type "online" will implement in UI after mobile launch;
ebooks now creaded for html contenttype
2018-04-07 17:11:36 -04:00
eshellman edc8ddcb94
Merge pull request #696 from Gluejar/clean-requirements
remove unneeded requirements
2018-04-06 12:32:19 -04:00
eshellman 892c923ed7
Merge branch 'master' into clean-requirements 2018-04-06 12:31:37 -04:00
eric 21b20d9b8e Merge remote-tracking branch 'Gluejar/master' into production 2018-04-02 11:19:36 -04:00
eshellman 42e1672d2a
Merge pull request #765 from Gluejar/claim-ebook-edit
don't return error for empty claim
2018-04-02 10:55:05 -04:00
eric 5598b154c5 don't return error for empty claim 2018-04-01 18:27:18 -04:00
eshellman 007307f411
Merge pull request #764 from Gluejar/springer-option
load springer improvements
2018-03-22 16:14:29 -04:00
eric 533eb94152 load springer improvements
We've loaded about half the Springer Open books catalog, adding 20
books at a time. I wanted to load page 23 of results without having to
load pages 1-22. Also added some exception handling.
2018-03-22 16:13:55 -04:00
eric e92236315a Merge remote-tracking branch 'Gluejar/master' into production 2018-03-15 12:28:56 -04:00
eshellman 3c7327ccfb
Merge pull request #763 from Gluejar/switch-prod-db
update prod db endpoint
2018-03-15 12:27:54 -04:00
eric a37cb8a749 try again 2018-03-15 12:05:26 -04:00
eric 879c7077b9 update prod db endpoint 2018-03-14 19:48:15 -04:00
eric d7f8c26882 Merge remote-tracking branch 'Gluejar/master' into production 2018-02-22 12:04:30 -05:00
eshellman 6a2d1a074b
Merge pull request #762 from Gluejar/all-sitemap
fix All sitemap command
2018-02-22 11:49:29 -05:00
eric 957cf615b4 delint 2018-02-22 11:29:52 -05:00
eric 1425b29d49 [unrelated] fix librarything error handling 2018-02-22 11:11:04 -05:00
eric fae854cd57 fix max == none 2018-02-22 11:06:40 -05:00
eric a6def2171d Merge remote-tracking branch 'Gluejar/master' into production 2018-02-21 12:47:58 -05:00
eshellman 53d904dfc6
Merge pull request #761 from Gluejar/bugfix
Misc Bugfix
2018-02-21 12:08:13 -05:00
eshellman f8c04a2ce1
Merge pull request #760 from Gluejar/execute-credit
Execute credit
2018-02-21 12:07:55 -05:00
eric 98e484cf55 enable seeing seen notices 2018-02-21 12:03:01 -05:00
eric 2f4b28f4b3 notices.css left out of scss 2018-02-21 11:12:19 -05:00
eric 466d3b5716 update wording of new files available notice 2018-02-21 11:03:52 -05:00
eric b88d678058 add loading from sitemap list 2018-02-20 13:35:00 -05:00
eric ad9523314d fix bug in ubiquity scraper 2018-02-20 13:07:44 -05:00
eric 16488b9b1d Merge remote-tracking branch 'Gluejar/master' into production 2018-02-17 14:02:43 -05:00
eshellman 8c5a41bf27
Merge pull request #759 from Gluejar/fix-unicode-payment
failed when campaign name is not ascii
2018-02-17 13:58:17 -05:00
eric 5305b08e10 failed when campaign name is not ascii 2018-02-17 13:57:52 -05:00
eric 6dbe9bdaeb clean up 2018-02-07 18:34:05 -05:00
eric cb50e931bd delint 2018-02-07 17:42:37 -05:00
eric 3084ab837c handle pledges on credit 2018-02-07 16:46:44 -05:00