When customizing Claude for your use case, you have two main approaches:
Anthropic's guidance: exhaust prompting before considering fine-tuning.
Reference:
Fine-tuning documentation
TaskLoco™ — The Sticky Note GOAT