BERTopic-as-service

Using BERTopic as a service to create easily interpretable topics.

Getting Started

Create virtual environment

Install poetry:

pip install poetry

Install project dependencies:

poetry install --no-root

Activate environment:

poetry shell

Setup pre-commit

Install pre-commit:

pip install pre-commit

Install the git hook scripts:

pre-commit install

Set up minikube

Linux:

curl -LO https://storage.googleapis.com/minikube/releases/latest/minikube-darwin-amd64
sudo install minikube-darwin-amd64 /usr/local/bin/minikube

macOS:

brew install minikube

Service management

Operations with containers

Build image:

make build

Start the service:

make up

Start all services except bertopic:

make up-dev

Stop the service:

make down

Tests and checks

Run code checks:

make check-code

Run unit tests:

make unit

Run integration tests:

make test

Deployment on k8s

Start the cluster:

minikube start
eval $(minikube -p minikube docker-env)

Deploy the service on the local k8s:

kubectl apply -f k8s/namespace/ && kubectl apply -R -f k8s/

Open MinIO Console:

minikube service minio-service -n bertopic --url

Open Swagger:

minikube service bertopic-service -n bertopic --url

Stop the cluster:

minikube stop

Delete the cluster:

minikube delete --all