Tech stack used includes LangChain, Private Chroma DB Deployed to AWS, Typescript, Openai, and Next.js. LangChain is a framework that makes it easier to build scalable AI/LLM apps and chatbots. Chroma is an opensource vectorstore for storing embeddings and your API data.
How to Deploy Private Chroma Vector DB to AWS video
- Clone the repo or download the ZIP
git clone [github https url]
- Install packages
First run npm install yarn -g
to install yarn globally (if you haven't already).
Then run:
yarn install
After installation, you should now see a node_modules
folder.
- Set up your
.env
file
- Copy
.env.example
into.env
Your.env
file should look like this:
OPENAI_API_KEY=
CHROMA_AWS_API_TOKEN=
CHROMA_AWS_API_GATEWAY_URL=
CHROMA_AXIOS_API_URL=
CHROMA_AXIOS_API_TOKEN=
CHROMA_COLLECTION_NAME=
Frontend of this repo is inspired by langchain-chat-nextjs Large portions of this repo is inspired by gpt4-pdf-chatbot-langchain How to Deploy Private Chroma Vector DB to AWS Deploy a PRIVATE Chroma Vector DB to AWS | Step by step tutorial | Part 2