RAG vs Fine-Tuning: When to Use Each and When Neither Helps

Retrieval-augmented generation and fine-tuning solve different problems. Using the wrong one wastes money and produces confusing failures. A decision framework from production.

Overview

This note is part of the field-notes archive generated for this site. The summary below is the published excerpt; you can expand the full write-up anytime in the CMS.

Series

Part of ML in Production (installment 4).

Related notes

• Quantization War Stories Llm
• Ml Drift Monitoring Production

Tags

• rag
• fine-tuning
• llm
• machine-learning
• production