DSPy Tutorial 2026: Stop Hand-Writing Prompts, Program Them Instead (36k Stars)

You have rewritten the same prompt 40 times chasing accuracy. DSPy replaces that loop with optimization that searches prompts and weights for you.

## DSPy: The Framework That Turns Prompt Tuning Into a Search Problem Stanford NLP's DSPy (36,509 GitHub stars as of August 2026) is built on a simple observation: hand-tuning prompts is slow, unrepeatable, and does not scale to multi-step pipelines. DSPy abstracts prompts away entirely. You declare a module, give it input-output examples, and let an optimizer - not you - figure out the prompt text and any few-shot demonstrations. ## The Core Idea in One Example Instead of writing a long assistant prompt, you write: ```python import dspy class ExtractDate(dspy.Signature): text: str = dspy.InputField() date: str = dspy.OutputField(desc="ISO format date") extractor = dspy.ChainOfThought(ExtractDate) ``` Then you compile it with a few labeled examples. DSPy's optimizer (MIPROv2 or BootstrapFewShot) tries different instruction phrasings and picks the demonstrations that improve your metric on the validation set. ## Why Teams Switch 1. **Metrics drive optimization.** You define accuracy once; the optimizer does not care how pretty the prompt is. 2. **Multi-step pipelines stay coherent.** A RAG pipeline with retrieval + generation + validation is one DSPy program, and every stage gets optimized together - which fixes the problem where the generator is tuned but the retriever drifted. 3. **Experiments are reproducible.** The compiled program, including the discovered prompts, is a file you can commit to git. ## The Trade-Off Nobody Mentions Compilation costs money. A serious MIPROv2 run over a 500-example set can spend $10-50 in API calls, and smaller runs with a weak optimizer can produce prompts that only work on your exact examples. Start with BootstrapFewShot (cheapest), then escalate only if your metric is plateauing. ## FAQ **Is DSPy only for Python?** Yes, Python is the supported language. **Does it replace LangChain?** It can replace prompt-management layers, but many teams use both: LangChain for integrations, DSPy for the prompt logic. **What models does it support?** Anything with an OpenAI-compatible API, plus local models via Ollama. **Is it production-stable?** Widely used in production; the API moved a lot between 2024-2025, so pin your version.