Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/deployment #40

Merged
merged 5 commits into from
Jan 13, 2024
Merged

Feature/deployment #40

merged 5 commits into from
Jan 13, 2024

Conversation

Dedalo314
Copy link
Contributor

@Dedalo314 Dedalo314 commented Jan 13, 2024 •
edited
Loading

What does this PR do?

Several important changes:

  • New env template with sample variables. Includes open source model example with quantized Zephyr 7B Beta.
  • MongoDB to store OpenBB PAT and other future PATs.
  • Docker Compose to facilitate the usage of GPTStonks Chat.
  • Sample embeddings included using https://huggingface.co/BAAI/bge-base-en-v1.5. Only OpenBB's instructions including "historical" are embedded as an example.
  • Env variables renaming for clarity. In particular, those involving AutoLlamaIndex.

Breaking changes

  • Old env variables will fail due to the renaming.

Before submitting

  • Did you make sure title is self-explanatory and the description concisely explains the PR?
  • Did you make sure your PR does only one thing, instead of bundling different changes together?
  • Did you list all the breaking changes introduced by this pull request?
  • Did you test your PR locally with pytest command?
  • Did you run pre-commit hooks with pre-commit run -a command?

Did you have fun?

Make sure you had fun coding 🙃

huzmgod and others added 5 commits January 8, 2024 13:20
Added docker-compose.yml for full deployment (api + front + mongodb).
5028def 
Added openbb token getter and setter endpoint. Removed PAT on-the-fly usage.
Added mongo initialization script.
Updated README to include docker-compose deployment instructions
549c9dc
@Dedalo314
Fix OpenBB PAT not visible
e7d229d 
The PAT was not visible in the backend and the code was giving errors
when calling the main processing function.
@Dedalo314
Add env variables template for LlamaCpp
898c813 
The template includes prompt examples and how to run a LlamaCpp model
using only around 6GB of CPU RAM.
@Dedalo314
Add MongoClient to API startup
0e90ad7 
Instead of creating the client as a global variable by itself, it is
added to the FastAPI's `app` global variable as a property. This unifies
the code structure to follow the same principles in all variables.
@Dedalo314 Dedalo314 merged commit 46c0086 into main Jan 13, 2024
2 of 4 checks passed
@Dedalo314 Dedalo314 deleted the feature/deployment branch January 13, 2024 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Dedalo314