Modules:
| Name | Description |
|---|---|
logprobs | Some utilities for logprobs, including logits. |
penalties | |
topk_topp_sampler | |
topk_topp_triton | Combined Top-K and Top-P Triton kernels. |
Modules:
| Name | Description |
|---|---|
logprobs | Some utilities for logprobs, including logits. |
penalties | |
topk_topp_sampler | |
topk_topp_triton | Combined Top-K and Top-P Triton kernels. |