Technology
OpenAI API
Everything on this site involving OpenAI API — projects, articles, research and tools.
AI Engineer Lab
Why Your RAG Evaluation Is Wrong
Most RAG evaluations measure the wrong thing, on the wrong data, with a judge that rewards the wrong behaviour. Here is what to measure instead.
IntermediateDifficulty: Intermediate3 min readPython · Ragas · OpenAI API
Video
AI Systems$149
RAG Evaluation System
A production-ready evaluation harness: configuration sweeps, retrieval and generation metrics measured separately, and CI regression gates.
v2.1.0Python · Ragas · DuckDB
Evaluation
Six RAG Chunking Strategies Compared
Fixed, recursive, semantic, structural, sentence-window and parent-document chunking measured on retrieval recall across three corpora.
IntermediateDifficulty: IntermediatePython · Ragas · pgvector
Notebook
AI Systems
RAG Evaluation Lab
Most RAG systems are tuned by vibes. This is a reproducible harness that measures retrieval and generation separately, so you can see which half is failing.
IntermediateDifficulty: Intermediate~12h buildPython · Ragas · DuckDB
Code