klyn.genai.llm.inference.LocalLLMProvider.promptTokenCount
method
public promptTokenCount(request as LLMRequest) as Long
Description

Counts the exact rendered prompt, including template markers, without allocating inference states. Does not mutate or retain the request.

Throws
  • ValueException for unsupported content or a closed provider.
Example

count = provider.promptTokenCount(LLMRequest(messages))