Commit Graph

6401 Commits (42ccc012550fb693075ca0c5546b2adc64c4a854)

Author SHA1 Message Date
eric 42ccc01255 no models loaded with app 2018-04-19 21:23:24 -04:00
eric 968c7e384d TEST_ settings deprecated 2018-04-19 21:19:40 -04:00
eshellman 8f822105fb
Merge pull request #771 from Gluejar/dj18deprecations
Dj18deprecations
2018-04-19 13:29:51 -04:00
eric 518ac07ae1 lint 2018-04-19 13:18:06 -04:00
eric f35122ec51 IPAddressField is deprecated 2018-04-19 13:13:02 -04:00
eshellman f549231d21
Merge pull request #769 from Gluejar/doab
forgot to remove debugging break
2018-04-18 22:21:59 -04:00
eric d0ffa6a002 forgot to remove debugging break 2018-04-18 22:21:41 -04:00
eshellman 2ae99c6854
Merge pull request #768 from Gluejar/doab
fix test
2018-04-18 22:01:13 -04:00
eric 29ca00277d fix test 2018-04-18 22:00:36 -04:00
eshellman 806f32b1c4
Merge pull request #767 from Gluejar/doab
Doab update #2
2018-04-18 21:40:04 -04:00
eric 6bca7f0983 bugs 2018-04-18 21:39:40 -04:00
eric bbd421d1f2 fix various bugs 2018-04-18 17:53:21 -04:00
eric c9e7d5d5ac avoid errors with using string methods on content_type 2018-04-18 14:56:26 -04:00
eric 8c1799ebc4 freshen clean_subjects 2018-04-18 14:55:26 -04:00
eric b0abceb678 deal with more punctuation in isbn string 2018-04-18 14:54:09 -04:00
eric 3590c1a59f default load_doab to last 45 days 2018-04-18 14:53:42 -04:00
eric 1d6af73cf2 handle isbns separated by '/' 2018-04-18 11:29:57 -04:00
eric fd02b5e66c allow unicode dashes in isbns 2018-04-18 11:15:46 -04:00
eric 78d66a247e don't fail if null edition 2018-04-17 14:21:21 -04:00
eric 447ed4b2d5 fix cover loading 2018-04-17 14:20:44 -04:00
eshellman 28c9aaa9b9
Merge pull request #766 from Gluejar/doab
Doab OAI harvest
2018-04-16 13:47:08 -04:00
eric 5671856daa ... and the management command 2018-04-16 13:46:33 -04:00
eric 8dd1fb1822 remove doab author loader
now uses oai functionality
2018-04-16 13:44:10 -04:00
eric b849f3a6ef finish mapping languages 2018-04-16 12:32:21 -04:00
eric a6039e4015 better handling of language codes 2018-04-13 14:39:03 -04:00
eric e433c13108 fix online_to_download bugs 2018-04-13 14:38:39 -04:00
eric 9a6b1efd0d fix bugs for records with missing fields 2018-04-13 14:37:50 -04:00
eric add1ed54e7 improve logging for bookloader 2018-04-13 14:35:38 -04:00
eric ba7b02b939 add alternate url pattern for doab_id 2018-04-12 15:09:07 -04:00
eric bf7a9d8106 patch for missing language 2018-04-12 15:08:29 -04:00
eric 748b0eaa63 add test 2018-04-09 17:26:04 -04:00
eric cdcd322210 added harvest_online_ebooks management command 2018-04-09 16:59:35 -04:00
eric c26e365a64 fixed imports 2018-04-09 16:58:58 -04:00
eric ca94c128de online to download handling
+ fix bug that made everythong 'online'
+ handle online ebooks with multiple format downloads
+ download ebooks with volatile links
+ move contenttyper to core.loaders.utils
+ add handling for really html ebooks
2018-04-09 16:32:52 -04:00
eric 9e101fcd99 inconsequential bug 2018-04-09 16:29:04 -04:00
eric 07fd095b9a fix bugs 2018-04-09 11:54:16 -04:00
eric a982588808 bugfix
handle librarything outage
2018-04-09 11:52:39 -04:00
eric 4f7f3c566c Merge remote-tracking branch 'Gluejar/master' into doab 2018-04-07 18:39:18 -04:00
eric 0ba2906c62 delint 2018-04-07 18:38:33 -04:00
eric e03fa239b4 revamp doab loading
- doab loading now done primarily by oai, no processing of csv.
- added pyoai and updated lxml
- doab ids or urls in ebook submission now handled by oai scrape
- doab_load_books removed
- doab_utils moved from Gluejar/DOAB
- licenses now recognizes OpenEdition
- new ebook type "online" will implement in UI after mobile launch;
ebooks now creaded for html contenttype
2018-04-07 17:11:36 -04:00
eshellman edc8ddcb94
Merge pull request #696 from Gluejar/clean-requirements
remove unneeded requirements
2018-04-06 12:32:19 -04:00
eshellman 892c923ed7
Merge branch 'master' into clean-requirements 2018-04-06 12:31:37 -04:00
eshellman 42e1672d2a
Merge pull request #765 from Gluejar/claim-ebook-edit
don't return error for empty claim
2018-04-02 10:55:05 -04:00
eric 5598b154c5 don't return error for empty claim 2018-04-01 18:27:18 -04:00
eshellman 007307f411
Merge pull request #764 from Gluejar/springer-option
load springer improvements
2018-03-22 16:14:29 -04:00
eric 533eb94152 load springer improvements
We've loaded about half the Springer Open books catalog, adding 20
books at a time. I wanted to load page 23 of results without having to
load pages 1-22. Also added some exception handling.
2018-03-22 16:13:55 -04:00
eshellman 3c7327ccfb
Merge pull request #763 from Gluejar/switch-prod-db
update prod db endpoint
2018-03-15 12:27:54 -04:00
eric a37cb8a749 try again 2018-03-15 12:05:26 -04:00
eric 879c7077b9 update prod db endpoint 2018-03-14 19:48:15 -04:00
eshellman 6a2d1a074b
Merge pull request #762 from Gluejar/all-sitemap
fix All sitemap command
2018-02-22 11:49:29 -05:00