Building an Evaluation Harness for Financial RAG: What I Learned About LLM-as-Judge Calibration

I built a RAG system for financial document Q&A. It answers questions about SEC filings (revenue, margins, debt ratios) using 84 public company documents from the FinanceBench benchmark. After running...