Fine-Tuning
All articles
15 total
RLHF (Reinforcement Learning from Human Feedback) New
How RLHF aligns language models with human preferences using a reward …
Glossary
Added 2 Jul
·
Upd 2 Jul
·5 min
Catastrophic Forgetting New
Why a neural network loses previously learned capabilities when trained …
Glossary
Added 1 Jul
·
Upd 1 Jul
·4 min
LoRA and QLoRA New
Low-Rank Adaptation freezes a model and trains a small pair of low-rank …
Glossary
Added 1 Jul
·
Upd 1 Jul
·7 min
Fireworks AI New
Fireworks AI is a low-latency inference and fine-tuning platform that …
Added 29 Jun
·
Upd 29 Jun
·5 min
Together AI New
Together AI is a cloud platform for running, fine-tuning, and serving …
Added 29 Jun
·
Upd 29 Jun
·4 min
Stable Diffusion New
Open-weight image generation model from Stability AI. Run locally with …
Added 22 Jun
·
Upd 22 Jun
·5 min
What is Fine-tuning? New
Fine-tuning adapts a pre-trained AI model to a specific task or domain …
Basics
Added 22 Jun
·
Upd 22 Jun
·5 min
Direct Preference Optimization (DPO)
An alignment method that fine-tunes language models directly on …
Glossary
Added 8 May
·
Upd 30 May
·6 min
Fine-Tuning LLMs
A Practical Guide
Guides
Added 28 Mar
·
Upd 30 May
·10 min
Fine-Tuning vs Prompt Engineering Tradeoffs
Comparing fine-tuning and prompt engineering for customizing LLM …
Comparisons
Added 28 Mar
·
Upd 14 Jun
·5 min
Fine-Tuning vs Prompt Engineering vs RAG
The three main approaches to customizing LLM behavior for specific use …
Glossary
Added 24 Mar
·
Upd 30 May
·4 min
Model Distillation Patterns for Production AI
Using large model outputs to train smaller, cheaper, faster models for …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
RAG vs Fine-Tuning
When to Use Each
Comparisons
Added 24 Mar
·
Upd 14 Jun
·5 min
Transfer Learning
What transfer learning is, how pre-trained models reduce training costs, …
Glossary
Added 28 Mar
·
Upd 30 May
·2 min
Why Your AI Output Sounds Generic
And How to Fix It With Your Own Data
Guides
Added 24 Mar
·
Upd 30 May
·3 min
Open source projects