Overview
>
Package klyn.genai.llm.inference
Version 0.2.2
Overview
Index
Tree
Deprecated
Package klyn.genai.llm.inference
Contains 2 type(s).
Types
Interfaces
LocalGenerationObserver
- Cooperative observer for local, text-only generation on the calling thread.
Classes
LocalLLMProvider
- Local token-level Qwen3.5 text inference on CPU or NVIDIA GPU.