DSPyOutline · dspy · Python 3.10+
0%
1
Curious builder0 XP earned · 300 to level 2
0 daysFinish a lesson to begin
Badge collection0 of 6 unlocked
5 small wins to finish your path

Overfitting: keeping the score honest

A program tuned too closely to its examples scores well on them and badly on real traffic.

Outline
This lesson is an outline of what it will teach. The full lesson, with code you can run, is being written.

What this lesson covers

  • Holding data back
  • Signs of overfitting
  • Re-checking on fresh cases

Why it matters

A customer judges the system on tomorrow's inputs, not yesterday's.

This is what real progress feels like.