0ba2906c62
delint
2018-04-07 18:38:33 -04:00
e03fa239b4
revamp doab loading
...
- doab loading now done primarily by oai, no processing of csv.
- added pyoai and updated lxml
- doab ids or urls in ebook submission now handled by oai scrape
- doab_load_books removed
- doab_utils moved from Gluejar/DOAB
- licenses now recognizes OpenEdition
- new ebook type "online" will implement in UI after mobile launch;
ebooks now creaded for html contenttype
2018-04-07 17:11:36 -04:00
533eb94152
load springer improvements
...
We've loaded about half the Springer Open books catalog, adding 20
books at a time. I wanted to load page 23 of results without having to
load pages 1-22. Also added some exception handling.
2018-03-22 16:13:55 -04:00
fae854cd57
fix max == none
2018-02-22 11:06:40 -05:00
b88d678058
add loading from sitemap list
2018-02-20 13:35:00 -05:00
72ae3c73a5
trouble with mobis when title is unicode?
2017-12-27 12:20:56 -05:00
d1cf6e6fb3
fix some scraping bugs
2017-12-15 19:26:50 -05:00
15d281c988
make mobi wasn't setting provider
2017-12-14 14:19:20 -05:00
cc1c5b6ee8
add management command
2017-12-10 16:33:07 -05:00
82784778c4
add springer scraper
2017-12-06 18:13:46 -05:00
af4cac5cf8
http should be a work id
2017-11-21 15:47:02 -05:00
b5e52effd9
optimize id access
...
See
https://docs.djangoproject.com/en/1.11/topics/db/optimization/#use-forei
gn-key-values-directly
2017-10-28 18:33:58 -04:00
1ce4323bc4
precheck every new subject
...
fix bug with '/' in subject
interpret ';' as list delimiter
add cleaner script
2017-09-15 15:55:37 -04:00
0c687fdad4
add command to load from sitemaps
2017-08-23 12:21:56 -04:00
db97a98ae8
https
2017-07-27 10:33:13 -04:00
1c52c42e60
doab author parsing and loader command
2016-11-29 15:37:02 -05:00
b7f2fb196c
print current work and number of covers added so far
2016-11-21 15:51:26 -08:00
8a73ec6ecf
management command to add missing
2016-11-18 13:47:26 -05:00
5572608b39
Merge pull request #641 from Gluejar/improve-doab-import
...
Improve doab import
2016-11-02 06:06:41 -07:00
8697aec989
management command to clean the db
2016-10-20 15:25:09 -04:00
182887fdc2
remove async option
2016-10-12 16:19:43 -04:00
3ac7769656
move doab.py into loaders
2016-10-11 15:46:03 -04:00
da7b3171ce
Use django's system check instead
2016-07-24 16:28:07 -04:00
c234b0ea45
management command
...
Management command to fix subject headings with yaml tags in the
heading name
2016-06-17 17:44:40 -04:00
c3057b6aef
add code to deal with OBP, fix bugs.
2016-06-10 17:57:53 -04:00
66bd4a043e
add management command
...
this command already deployed; minimal testing required
2016-06-08 15:27:49 -04:00
cb3581e932
code for loading umich spreadsheet
2016-05-19 09:17:23 -04:00
bf41bfccc6
change bookloader to load books by names of book in release and a command to deactivate currently broken ebooks
2016-05-16 12:43:11 -07:00
ab0c8814b4
add management command
2016-03-25 23:44:18 -04:00
45cb7d4eac
[ #113378215 ] prevent a duplicate ebooks with exact same metadata from being created by /api/loader/yaml
...
add dedupe_ebooks_with_same_urls.py command for deleting duplicate ebooks
2016-02-10 11:04:06 -08:00
a3a1a72b46
add management command to convert ungluit subjects to bisac
2015-09-21 21:04:11 -04:00
53a37b1b31
Merge branch 'master' into mobigen_integrate
2015-04-03 10:05:02 -07:00
7cb0f473de
remove many-commas subjects, prevent their addition
2015-01-30 11:33:22 -05:00
0b7f522232
first pass at a command to convert all the convertible campaign ebooks to mobi
2015-01-26 12:19:26 -08:00
61c0de3fbc
add a command to delete subjects with non-xml characters
2015-01-22 15:48:04 -08:00
54c3742ce7
adding a command to load doab books
2014-06-06 11:37:10 -07:00
f27b111117
fix twitter avatars [ #66896902 ]
2014-03-06 17:53:37 -05:00
d5b9f88380
move "extra data" into a json field dict to improve payment code tidieness
...
need to install jsonfield
note: this is https://bitbucket.org/schinckel/django-jsonfield
I tried https://github.com/bradjasper/django-jsonfield but it was not
compatible with South
2013-08-18 15:21:55 -04:00
52e58daa20
move some code to indicate it's not being maintained
2013-08-18 15:16:15 -04:00
ad69580b2d
PEP 8, PEP 328. I feel better now.
2013-06-03 12:31:39 -04:00
53d23d9f18
grammar
2013-05-06 15:59:55 -04:00
0578a40798
changed the html, need to change the management command
2013-05-03 11:50:41 -04:00
5f6abec1d5
de-button the ungluers to go
2013-05-02 15:58:28 -04:00
3b44e643d5
put status information in de gruyter initialized campaigns
2013-04-24 14:26:23 -04:00
05d37163ea
despam descriptions in db
...
wasn't real happy with this: https://unglue.it/work/66938/ so I looked
for other spammy descriptions in the db
2013-03-07 11:37:40 -05:00
b7721f0fa3
management command to make sure transaction.ack_name returns something sensible for OLA on /acks/ page
2012-12-19 11:00:33 -05:00
018332d508
[ #37388341 ] First crack at displaying campaign data -- per Melinda's request
2012-10-08 17:47:55 -07:00
8611f73382
give badges to users who've pledged! [ #29340547 ]
2012-09-22 23:54:06 -04:00
3d7cd7fdae
management command to set active campaigns to UNSUCCESSFUL, trigger amazon notice
2012-08-09 09:47:10 -04:00
3bdde8f936
finally I understand how reclustering should work
2012-08-05 18:30:13 -04:00
eric
Raymond Yee
Andromeda Yelton