This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both serving and training scripts, RayOperator to manage Ray Clusters and Karpenter to manage Node Scaling.
This Repository consists of all the Jupyter Notebook (.ipynb) files, python files, excel sheets which are a part of the BCGX's Gen AI Virtual Job Simulation that is hosted on Forage.
Sample code and notebooks for Generative AI on Google Cloud, including Gemini
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.
Add a description, image, and links to the gen-ai topic page so that developers can more easily learn about it.
To associate your repository with the gen-ai topic, visit your repo's landing page and select "manage topics."