public maxNewTokens as Long = 128l
Maximum generated tokens per complete() request, including a terminating EOS token. The prompt plus this bound must fit maxContext. Token-level generation can specify its own bound without changing this setting.
provider.maxNewTokens = 256l