Commit Graph

1489 Commits (35ca77a601117d753475048ae10f3b0ff54f09d7)

Author SHA1 Message Date
eric a0dc106f6d fix issue with merged works coming back from related editions 2018-04-26 14:57:55 -04:00
eric 8f600f1556 make it work in django 1.8 2018-04-25 17:20:44 -04:00
eric 3337de9a2e Merge remote-tracking branch 'Gluejar/master' into dj111
# Conflicts:
#	core/tests.py
#	payment/tests.py
2018-04-25 16:23:00 -04:00
eric 8d5da39e5f make populate edition synchronous for doab 2018-04-25 11:21:02 -04:00
eric fa82411921 don't load chapters 2018-04-23 15:41:42 -04:00
eric 680caad71d deprecations 2018-04-19 21:27:20 -04:00
eric 146f26c5f8 deprecate django unittest 2018-04-19 21:26:29 -04:00
eric 42ccc01255 no models loaded with app 2018-04-19 21:23:24 -04:00
eric 39fdd9683a rip out dead code 2018-04-19 12:24:34 -04:00
eric d0ffa6a002 forgot to remove debugging break 2018-04-18 22:21:41 -04:00
eric 29ca00277d fix test 2018-04-18 22:00:36 -04:00
eric 6bca7f0983 bugs 2018-04-18 21:39:40 -04:00
eric bbd421d1f2 fix various bugs 2018-04-18 17:53:21 -04:00
eric c9e7d5d5ac avoid errors with using string methods on content_type 2018-04-18 14:56:26 -04:00
eric 8c1799ebc4 freshen clean_subjects 2018-04-18 14:55:26 -04:00
eric b0abceb678 deal with more punctuation in isbn string 2018-04-18 14:54:09 -04:00
eric 3590c1a59f default load_doab to last 45 days 2018-04-18 14:53:42 -04:00
eric 1d6af73cf2 handle isbns separated by '/' 2018-04-18 11:29:57 -04:00
eric fd02b5e66c allow unicode dashes in isbns 2018-04-18 11:15:46 -04:00
eric 78d66a247e don't fail if null edition 2018-04-17 14:21:21 -04:00
eric 447ed4b2d5 fix cover loading 2018-04-17 14:20:44 -04:00
eric 5671856daa ... and the management command 2018-04-16 13:46:33 -04:00
eric 8dd1fb1822 remove doab author loader
now uses oai functionality
2018-04-16 13:44:10 -04:00
eric b849f3a6ef finish mapping languages 2018-04-16 12:32:21 -04:00
eric a6039e4015 better handling of language codes 2018-04-13 14:39:03 -04:00
eric e433c13108 fix online_to_download bugs 2018-04-13 14:38:39 -04:00
eric 9a6b1efd0d fix bugs for records with missing fields 2018-04-13 14:37:50 -04:00
eric add1ed54e7 improve logging for bookloader 2018-04-13 14:35:38 -04:00
eric ba7b02b939 add alternate url pattern for doab_id 2018-04-12 15:09:07 -04:00
eric bf7a9d8106 patch for missing language 2018-04-12 15:08:29 -04:00
eric 748b0eaa63 add test 2018-04-09 17:26:04 -04:00
eric cdcd322210 added harvest_online_ebooks management command 2018-04-09 16:59:35 -04:00
eric c26e365a64 fixed imports 2018-04-09 16:58:58 -04:00
eric ca94c128de online to download handling
+ fix bug that made everythong 'online'
+ handle online ebooks with multiple format downloads
+ download ebooks with volatile links
+ move contenttyper to core.loaders.utils
+ add handling for really html ebooks
2018-04-09 16:32:52 -04:00
eric 9e101fcd99 inconsequential bug 2018-04-09 16:29:04 -04:00
eric 07fd095b9a fix bugs 2018-04-09 11:54:16 -04:00
eric a982588808 bugfix
handle librarything outage
2018-04-09 11:52:39 -04:00
eric 0ba2906c62 delint 2018-04-07 18:38:33 -04:00
eric e03fa239b4 revamp doab loading
- doab loading now done primarily by oai, no processing of csv.
- added pyoai and updated lxml
- doab ids or urls in ebook submission now handled by oai scrape
- doab_load_books removed
- doab_utils moved from Gluejar/DOAB
- licenses now recognizes OpenEdition
- new ebook type "online" will implement in UI after mobile launch;
ebooks now creaded for html contenttype
2018-04-07 17:11:36 -04:00
eric 533eb94152 load springer improvements
We've loaded about half the Springer Open books catalog, adding 20
books at a time. I wanted to load page 23 of results without having to
load pages 1-22. Also added some exception handling.
2018-03-22 16:13:55 -04:00
eric 957cf615b4 delint 2018-02-22 11:29:52 -05:00
eric 1425b29d49 [unrelated] fix librarything error handling 2018-02-22 11:11:04 -05:00
eric fae854cd57 fix max == none 2018-02-22 11:06:40 -05:00
eshellman 53d904dfc6
Merge pull request #761 from Gluejar/bugfix
Misc Bugfix
2018-02-21 12:08:13 -05:00
eric b88d678058 add loading from sitemap list 2018-02-20 13:35:00 -05:00
eric ad9523314d fix bug in ubiquity scraper 2018-02-20 13:07:44 -05:00
eric e015539fee change language about "gift credit" 2018-02-07 16:44:29 -05:00
eric 7e69ac95eb add negative id facets 2018-02-01 21:47:29 -05:00
eric b148a1925e harden search 2018-02-01 15:18:14 -05:00
eric 33f4b75417 stricter RE 2018-01-04 16:53:29 -05:00