Loading...
Back to Projects
FinSight - Financial Document Intelligence
A production-grade Retrieval-Augmented Generation system that analyses financial reports with GPT-4o, achieving 0.883 overall RAGAs score with perfect context recall, featuring semantic reranking, confidence guards, and real-time streaming.
Project Overview
FinSight is a production-ready RAG system built for financial document analysis. Users upload annual reports, 10-K filings, or earnings releases and ask natural language questions — the system retrieves the most relevant passages, reranks them using a Cohere cross-encoder, and streams cited answers token by token via GPT-4o. Built on a six-layer pipeline covering ingestion, chunking, embedding, retrieval, reranking, and generation, the system was rigorously evaluated using the RAGAs framework achieving 0.992 answer relevancy and 1.000 context recall. A confidence guard refuses to generate when retrieval scores fall below threshold, prioritising accuracy over coverage — critical in financial contexts where a wrong answer is worse than no answer.
Architecture & Use Cases
Key Features
Six-layer RAG pipeline: ingestion → chunking → embedding → retrieval → reranking → generation
Smart chunking with 600-token chunks and 80-token overlap to preserve financial context across boundaries
GPT-4o-mini query rewriting converts conversational questions into search-optimised queries before retrieval
Cohere cross-encoder reranking over top-15 vector candidates for precision-focused retrieval
Confidence guard — refuses generation when top rerank score falls below 0.5 to prevent hallucination
Strict citation enforcement — every claim cited with page number inline using GPT-4o
RAGAs evaluation suite with golden test set: 0.992 answer relevancy, 1.000 context recall, 0.883 overall
Real-time token streaming via FastAPI with NDJSON protocol
PDF upload and ingestion endpoint — supports any financial document format
Streamlit chat interface with live RAGAs metrics dashboard and source card display
Images
Technology Stack
Backend
PythonFastAPILangChainGPT-4oCohere Rerank
Frontend
Streamlit
Database
ChromaDB
Tools & Platforms
OpenAI EmbeddingsRAGAsPyPDFUvicorn