Module 06 of 10

Model Parameters & Selection

Lessons

About This Module

The same prompt can give very different results depending on the model and the settings behind it. Model parameters are the dials you send with each request that shape how the model picks its words, while model selection is choosing which model should do the job in the first place.

You'll start with the sampling settings: temperature, which controls how random the output is, and top-p and top-k, which limit which words the model can choose from. Then you'll learn how to compare models on cost, speed, and quality so you can match the right model to each task.

Once you can control and choose your model, you'll want to give it the right information to work with. That's the focus of RAG & Context Engineering, the next module in this course.

Lessons

4 videos
01

Temperature? Top-p? Top-k? A practical guide to AI parameters

A practical look at how temperature, top-p, and top-k change what a model writes, and how to tune them.

02

Top K, Top P & Temperature Explained: LLM Sampling

How the main LLM sampling strategies work and how each setting shapes the model's next-word choices.

03

The Secret Controls for your LLM: Temperature, Top-K, Top-P, etc

The key generation settings, including min-p and repeat penalties, and what each one does to the output.

04

LLM Model Comparison: Choosing the Right Model for Your Use Case

How to compare different language models on the same prompt so you can pick the one that fits your task.