Top PSampling
Top-p sampling, also called nucleus sampling, is a decoding strategy that selects the next token from the smallest set of candidates whose cumulative probability meets a specified threshold p, discarding the long tail of unlikely tokens.
3 resources across 1 library
Glossary Terms(3)
Temperature (LLM)
Temperature is a sampling parameter that controls the randomness of a language model's output by scaling the probability distribution over possible next tokens…
Top-p Sampling
Top-p sampling, also called nucleus sampling, is a decoding strategy that selects the next token from the smallest set of candidates whose cumulative probabili…
Beam Search
Beam search is a heuristic decoding algorithm that generates text by tracking the top-scoring k partial sequences (the "beam width") at each step, expanding ea…