When to fine-tune vs RAG vs prompt engineering

Fine tuning changes the model behavior by updating its weights. RAG changes the information the model sees at inference time. Prompt engineering changes how you ask. These are not interchangeable — each solves a different class of problem. Choosing wrong wastes GPU hours and produces worse results.