447ed4b2d5
fix cover loading
2018-04-17 14:20:44 -04:00
8dd1fb1822
remove doab author loader
...
now uses oai functionality
2018-04-16 13:44:10 -04:00
9a6b1efd0d
fix bugs for records with missing fields
2018-04-13 14:37:50 -04:00
bf7a9d8106
patch for missing language
2018-04-12 15:08:29 -04:00
ca94c128de
online to download handling
...
+ fix bug that made everythong 'online'
+ handle online ebooks with multiple format downloads
+ download ebooks with volatile links
+ move contenttyper to core.loaders.utils
+ add handling for really html ebooks
2018-04-09 16:32:52 -04:00
07fd095b9a
fix bugs
2018-04-09 11:54:16 -04:00
0ba2906c62
delint
2018-04-07 18:38:33 -04:00
e03fa239b4
revamp doab loading
...
- doab loading now done primarily by oai, no processing of csv.
- added pyoai and updated lxml
- doab ids or urls in ebook submission now handled by oai scrape
- doab_load_books removed
- doab_utils moved from Gluejar/DOAB
- licenses now recognizes OpenEdition
- new ebook type "online" will implement in UI after mobile launch;
ebooks now creaded for html contenttype
2018-04-07 17:11:36 -04:00
b5e52effd9
optimize id access
...
See
https://docs.djangoproject.com/en/1.11/topics/db/optimization/#use-forei
gn-key-values-directly
2017-10-28 18:33:58 -04:00
1ce4323bc4
precheck every new subject
...
fix bug with '/' in subject
interpret ';' as list delimiter
add cleaner script
2017-09-15 15:55:37 -04:00
5bbeb45053
improve merge_works
...
work_relations were not being updated
2017-09-04 16:10:24 -04:00
652d9a3456
modify doab load to handle authlists
...
also fix a few encoding issues and null data problems resulting in
non-loading and ftp redirects
2016-12-02 15:50:07 -05:00
1c52c42e60
doab author parsing and loader command
2016-11-29 15:37:02 -05:00
671017fced
pass edition to update_cover_doab
2016-11-18 13:28:59 -05:00
60e4994756
remove debugging prints
2016-11-01 13:42:40 -04:00
b82b51f358
forgot to re-enable error catching
2016-10-31 22:19:00 -04:00
1c7df5e00e
get rid of some loader issues
2016-10-28 14:40:16 -04:00
39cf8c9c0b
fix load errors
2016-10-27 20:05:43 -04:00
182887fdc2
remove async option
2016-10-12 16:19:43 -04:00
167c7fc60a
update doab loader
2016-10-12 16:07:54 -04:00
3ac7769656
move doab.py into loaders
2016-10-11 15:46:03 -04:00
eric