7f92b17dc2
* OAP-61: flatten suggestions database * Remove limit on items to refresh * Delete run.sh |
||
|---|---|---|
| .github/workflows | ||
| api | ||
| embed-script | ||
| oapen-engine | ||
| web | ||
| .flake8 | ||
| .gitignore | ||
| .isort.cfg | ||
| .pre-commit-config.yaml | ||
| LICENSE.md | ||
| README.md | ||
| all-dev.sh | ||
| docker-compose.yml | ||
| pyproject.toml | ||
| run-api.sh | ||
| run-web.sh | ||
| setup.cfg | ||
| setup.sh | ||
README.md
OAPEN Suggestion Engine
The OAPEN Suggestion Engine will suggest ebooks based on other books with similar content.
Running server
You can run all the servers together with ./all-dev.sh -- after installing dependencies with . ./setup.sh
Monorepo components
This project is a monorepo, with multiple pieces that can be added or removed as neccessary for deployment.
Mining Engine (Core)
This engine is written in Python, and generates the recommendation data for users. Our suggestion service is centered around the trigram semantic inferencing algorithm. This script should be run as a job on a cron schedule to periodically ingest new texts added to the OAPEN catalog through their API. It will populate the Database (see Database section) with pre-processed lists of suggestions for each entry in the catalog.
You can find the code for the mining engine in oapen-engine/.
Information about running the mining engine is in oapen-engine/README.md.
Base dependencies:
- Python v3.10
- PIP package manager
make
Automatically-installed dependencies:
nltk-- Natural language toolkit.- Maintained on GitHub by 300+ contributors.
- Most recent update: 8 days ago
requests-- HTTP request library- Maintained on GitHub by 600+ conributors, and backed by sponsors.
- Most recent update: 1 month ago.
psycopg2-- PostgreSQL Database Adapter- Maintained on GitHub by 100+ contributors, and used by 480,000+ packages.
- Most popular PostgreSQL database adapter for Python
pandas-- data analysis library- Maintained by PYData with large amounts of sponsors. 2,700+ contributors.
scikit-learn-- Scikit Learn
API Engine (Core)
This API server returns a list of recommended books from the database.
You can find the code for the API engine in api/.
Configuration info for the API engine is in api/README.md.
Base dependencies:
- NodeJS 14.x+
- NPM package manager
Automatically-installed dependencies:
express- Basic HTTP server- Maintained by the OpenJS foundation
- Largest Node HTTP server
pg-promise-- basic PostgreSQL driver- Maintained on Github
dotenv-- loads environment variables from .env- Maintained on Github
Web Demo (Optional)
This is a web-app demo that can be used to query the API engine and see suggested books. This does not have to be maintained if the API is used on another site, but is useful for development and a tech demo.
You can find the code for the web demo in web/.
Configuration info for the web demo is in web/README.md.
Base dependencies:
- NodeJS 14.x+
- NPM package manager
Automatically-installed dependencies:
next-- Framework for production-driven web apps- Maintained by Vercel and the open source community
react-- Frontend design framework- Maintained by Meta.
- Largest frontend web UI library.
- (Alternative considered: Angular -- however, was recently deprecated by Google)
pg-- basic PostgreSQL driver- Maintained on npm
typescript-- Types for JavaScript- Maintained by Microsoft and the open source community.