Run a small BitNet model on local machine with one Docker command, and chat in browser.
- Start the LLM server with a single command
- Web UI to chat and continue conversations
- Chat history saved in browser (persists on reload)
- One-click option to clear chats
- Context-aware responses for better follow-ups
- Streaming output (see responses word by word in real-time)
Checkout the documentation for more working examples.
- Docker (with Docker Compose)
git clone https://github.com/stackblogger/BitNet-Stack.git
cd BitNet-Stackdocker compose up --build -d
This builds the LLM image and starts one container. The model is downloaded during the image build (first time can take a while).
In your browser go to:
(Port 5001 is mapped to the app inside the container on 5000; change it in docker-compose.yml if you need another port.)
This project is licensed under the MIT License. See the LICENSE file for details.