Tag

Benchmarks

Everything on this site involving Benchmarks — projects, articles, research and tools.

AI Systems

RAG Evaluation Lab

Most RAG systems are tuned by vibes. This is a reproducible harness that measures retrieval and generation separately, so you can see which half is failing.

IntermediateDifficulty: Intermediate~12h buildPython · Ragas · DuckDB
Code
Trading Systems

Algorithmic Trading Backtest Lab

A backtesting framework with transaction costs, slippage, walk-forward analysis and survivorship-bias handling — designed to stop a strategy looking better than it is. Educational research only.

AdvancedDifficulty: Advanced~24h buildPython · Polars · DuckDB
Code
AI Engineer Lab

Why Your RAG Evaluation Is Wrong

Most RAG evaluations measure the wrong thing, on the wrong data, with a judge that rewards the wrong behaviour. Here is what to measure instead.

IntermediateDifficulty: Intermediate3 min readPython · Ragas · OpenAI API
Video
Modern Data Stack

DuckDB vs pandas vs Polars: When Each One Wins

A practical decision guide based on workload shape rather than benchmark scores — because the fastest tool depends on what you are actually doing.

BeginnerDifficulty: Beginner2 min readDuckDB · Polars · pandas
Market research

Does RSI Actually Work?

Testing the classic RSI(14) mean-reversion rule across 20 years and 500 instruments, with costs included and multiple-testing accounted for.

IntermediateDifficulty: IntermediatePython · Polars · DuckDB
NotebookDataset
Benchmarks

DuckDB vs pandas vs Polars on 50 Million Rows

A reproducible benchmark across six workload shapes, reporting memory as well as time — because memory is what actually stops the job.

BeginnerDifficulty: BeginnerDuckDB · Polars · pandas
Notebook
Evaluation

Six RAG Chunking Strategies Compared

Fixed, recursive, semantic, structural, sentence-window and parent-document chunking measured on retrieval recall across three corpora.

IntermediateDifficulty: IntermediatePython · Ragas · pgvector
Notebook