Kiri Chat

What is this project? Kiri Chat is a RAG (Retrieval-Augmented Generation) system that transforms static documentation into an interactive chat experience.

What is Kiri Chat?

Kiri Chat is a chatbot system that uses a Large Language Model (LLM) to answer questions about your documentation. It treats your documentation as a knowledge base, allowing users to have natural conversations with an AI assistant that only answers based on the content available in your docs.

Key point: This project is called Kiri Chat — a documentation-powered chatbot.

Kiri Chat runs locally using Ollama, meaning all processing happens on your machine. Ask natural language questions and get accurate answers grounded in your docs — with source links back to the exact sections used.

Features

  • Semantic search — understands the intent behind your questions, not just keywords
  • Local by design — runs entirely on your machine with Ollama and Qdrant
  • Source attribution — every answer includes links to the documentation sections used
  • Embeddable widget — floating chat button (<chat-button>) for any page
  • Markdown-native — responses preserve code blocks, lists, and formatting

Architecture

flowchart LR
    A[User] -->|Question| B[Kiri Chat<br/>Web Component]
    B -->|POST /chat| C[FastAPI<br/>RAG Backend]
    C --> D[Qdrant<br/>Vector DB]
    C <--> E[Ollama<br/>Local LLM]
    D -->|Context| C
    C -->|Answer + Sources| B

Quick Start

# Install dependencies
pnpm install

# Set up RAG (start Qdrant + index docs)
pnpm run rag:setup

# Start Kiri Chat (docfx site + chat API)
pnpm run dev

Then open http://localhost:8080 and click the chat button in the bottom-right corner.

Learn More

Edit this page