RAG

RAG-Based Chatbot Model

Visit live siteSource code

RAG-Based Chatbot ModelDemo

Retrieval-augmented chatbot answering a question with cited source passages from the indexed documents

Overview

A local chatbot system powered by Retrieval-Augmented Generation (RAG), capable of answering questions from both plain and scanned PDF files. Integrates FAISS, OCR, and LLaMA 3.1 (8B) via Ollama for offline LLM inference — making it ideal for data-sensitive or disconnected environments.

Category
RAG
Stack
  • RAG
  • FAISS
  • OCR
  • LLaMA 3.1
  • Ollama
Status
Live in production
Next step

Have an AI problem worth solving?

Tell me what you are trying to build. I will tell you honestly whether AI is the right tool, what it would take, and how I would approach it.

Typical reply within 24 hours

Working from Dhaka, Bangladesh · remote worldwide