RAG in production: retrieval quality, evaluation and the cost of getting it wrong
A retrieval-augmented generation demo takes an afternoon. A production system takes months, and the gap is not model quality. It is a specific set of problems that a demo corpus, a demo question set and a demo user never expose. Almost all of them reduce to two things: whether retrieval returns the right source, and […]
Rahul Kumar Singh
