klyn.llm.inference.hub.HubClient.availableQuantizations
method
public static availableQuantizations(repository as String, revision as String = "main") as ArrayList<ModelQuantization>
Description

Lists recognized text-model GGUF variants published by a repository, not execution backend capabilities. Vision projectors are excluded. Does not download weights or execute repository code.

Parameters
ParameterDescription
repositoryHub owner/name.
revisionBranch, tag or immutable commit.
Returns

Distinct published quantizations, excluding AUTO.

Throws
  • IOException on network/metadata errors.
Example

print(HubClient.availableQuantizations("bartowski/Qwen_Qwen3.5-9B-GGUF"))