Commit Graph

10 Commits (dab7812da4624af11de03b5f990f9179e9cb5dee)

Author SHA1 Message Date
Celina Peralta b80d745b30
add schedule package to daemon (#48) 2023-03-31 15:33:41 -04:00
Justin O'Boyle 376545450d
Basic testing (#45)
* finished changes to stopwords and langauges

* final changes to stopwords

* basic testing

* add tests

* Remove formatter for now

* fix merge

* cd

* touch __init__

* Relative path issue \?

* run tests before app

* Move tests to inside docker

* exit when any command fails

---------

Co-authored-by: Max Zaremba <max.zaremba@gmail.com>
2023-03-22 14:52:38 -04:00
Celina Peralta f7c33c07e9
OAP-53 Fix engine Dockerfile, build psycopg2 from source not binary, write daemon (#32)
* add libpq5 to build

* remove psycopg2-binary

* add punkt as resource

* Use multiprocessing.cpu_count for max suggestion workers
2023-02-10 07:45:44 -05:00
Justin O'Boyle 535715932d
Setup docker (#26)
* basic config

* Add github action

* Fix makefile for linux and variable python (#27)

* fix makefile

* remove out

* add to gitignore

* Fix makefile for linux and variable python (#27)

* fix makefile

* remove out

* add to gitignore

* Fix dockerfile

* stash changes

* Make makefile dynamic (#28)

* Remove broken docker packages for now

* Add web

* Make Black Formatter happy?

Co-authored-by: Max Zaremba <max.zaremba@gmail.com>
2022-12-13 07:46:08 -05:00
Max Zaremba 63619d3aa9
Fix makefile for linux and variable python (#27)
* fix makefile

* remove out

* add to gitignore
2022-12-04 21:54:40 -05:00
Celina Peralta 9bfdc51e5c
Tweak seed task params (#25)
* No get text

* remove pytest

* add OAP-39 work.

* add weekly item endpoint

* get weekly items

* refresh + generate suggestions

* thread seed tasks

* fix generate_suggestions concurrency

* fix typos

* draft concurrent data ingest

* seed, refresh tasks

* change seed config params
2022-11-29 01:19:16 -05:00
Celina Peralta 0f247eac8c
OAP-15, OAP-22: Data ingest + text preprocessing (#6)
* sync upstream

* db skeleton

* update readme

* basic api calls

* api calls

* data ingest + text preprocessing

* update gitignore

* remove lib changes

* lint

* remove unused imports

* gitignore updates

* update python job

* ignore flake8 warnings
2022-10-04 08:22:55 -04:00
Celina Peralta e005787bbe
OAP-22: Set up python build job in GH actions (#4)
* sync upstream

* Add linting and testing, update to python 3.10

* push engine workflow

* fix workflow version

* fix workflow version 2

* change setup-python to v3

* workflow: cd oapen-engine

* workflow

* workflow

* workflow

* add lock file

* remove unnecessary cd

* remove unnecessary cd

* remove isort

* update workflow

* job

* job

* job

* job

* job

* job

* isort why

* isort why

* isort why

* isort why

* isort why

* isort why

* isort why

* job

* job

* job

* job

* job

* job

* job

* job

* job

* job

* job

* lint

* job

* hooks

* remove lib
2022-09-30 15:49:04 -04:00
Celina Peralta e139ce9adb
celinanperalta/oap 13 (#3)
* sync upstream

* Add pgsql connection, update pipfile

* add config files

* update gitignore

* remove cached

* remove psycopg2-binary dependency

* add sklearn and pandas to pipfile

* add readme.md
2022-09-27 18:46:58 -04:00
Celina Peralta ad263b11fc
Create mining engine boilerplate (#2)
* add oapen engine folder

* add pipenv
2022-09-27 15:07:50 -04:00