Overview
>
Package klyn.llm.inference
Version 0.2.1
Overview
Index
Tree
Deprecated
Package klyn.llm.inference
Contains 2 type(s).
Types
Classes
LocalLLMProvider
- Local token-level Qwen3.5 text inference on CPU or NVIDIA GPU.
Enums
ModelQuantization
- Hub checkpoint variants.