Glossary · 1 minute read
What Is Fine-Tuning?
Fine-tuning is the process of further training a pre-trained model on your own examples to change its default behavior—teaching it a consistent style, format, or specialized task. It produces a customized model but requires quality training data, costs more than prompting, and must be redone as base models improve. For most needs, prompting plus retrieval (RAG) achieves the goal more cheaply and flexibly, so fine-tuning is best reserved for specific cases where it clearly pays off.
Fine-tuning trains a model on your examples to change its behavior. Here's what it is, when it helps, and why to try prompting and RAG first.
What fine-tuning is
Fine-tuning further trains a pre-trained model on your own examples to change its default behavior—teaching a consistent style, format, or specialized task. See AI model fine-tuning.
What it costs
| Requirement | Impact |
|---|---|
| Quality training data | Effort to prepare |
| Compute | More than prompting |
| Maintenance | Redo as base models improve |
Fine-tuning produces a customized model, but at real cost.
When it's worth it
Fine-tune when you need consistent style/format, a specialized task, or shorter prompts at scale—and prompting plus retrieval isn't enough.
Why try prompting and RAG first
For most needs, prompting plus RAG achieves the goal more cheaply and flexibly—and RAG adds live knowledge fine-tuning can't. See fine-tuning vs RAG. They solve different problems and are sometimes combined.
The common mistake
Reaching for fine-tuning first—it's costlier and slower than the alternatives for most cases. Exhaust prompting and retrieval before committing.
Why FISTA
FISTA Solutions uses the cheapest approach that works—prompting and RAG first, fine-tuning only when it pays—through AI enablement, backed by 150+ projects across 12+ countries.
Deciding whether to fine-tune? Talk to FISTA.
Share-ready article cover
Download the generated social format.
Clear answers
Questions raised by this field note.
Straightforward guidance for evaluating scope, fit, and the next step.
01What is fine-tuning in AI?
Further training a pre-trained model on your own examples to change its default behavior—for consistent style, format, or a specialized task. It produces a customized model but requires quality data and ongoing maintenance.
02When should I fine-tune a model?
When you need consistent style or format, a specialized task, or shorter prompts at scale, and prompting plus retrieval isn't enough. For most use cases, try prompting and RAG first, since they're cheaper and more flexible.
03Is fine-tuning better than RAG?
Not usually. RAG grounds answers in your data without training, solving most knowledge needs more cheaply. Fine-tuning changes behavior and style but doesn't add live knowledge. They solve different problems and are sometimes combined.
Continue exploring
Related capabilities
Start with the hard problem
Need the outcome owned, not merely analyzed?
Tell us where delivery is constrained. We’ll map the fastest credible path from intent to verified production.