-
public final class LlmGenerationConfig.BuilderBuilder class for constructing LlmGenerationConfig instances.
Provides a fluent interface for configuring generation parameters with sensible defaults. All methods return the builder instance to enable method chaining.
-
-
Method Summary
Modifier and Type Method Description final LlmGenerationConfig.Builderecho(Boolean echo)Sets whether to include the input prompt in the generated output. final LlmGenerationConfig.BuildermaxNewTokens(Integer maxNewTokens)Sets the maximum number of new tokens to generate. final LlmGenerationConfig.Builderwarming(Boolean warming)Enables or disables model warming. final LlmGenerationConfig.BuilderseqLen(Integer seqLen)Sets the maximum sequence length for generation. final LlmGenerationConfig.Buildertemperature(Float temperature)Sets the temperature for random sampling. final LlmGenerationConfig.BuildernumBos(Integer numBos)Sets the number of BOS tokens to prepend. final LlmGenerationConfig.BuildernumEos(Integer numEos)Sets the number of EOS tokens to append. final LlmGenerationConfigbuild()Constructs the LlmGenerationConfig instance with the configured parameters. -
-
Method Detail
-
echo
final LlmGenerationConfig.Builder echo(Boolean echo)
Sets whether to include the input prompt in the generated output.
-
maxNewTokens
final LlmGenerationConfig.Builder maxNewTokens(Integer maxNewTokens)
Sets the maximum number of new tokens to generate.
-
warming
final LlmGenerationConfig.Builder warming(Boolean warming)
Enables or disables model warming.
-
seqLen
final LlmGenerationConfig.Builder seqLen(Integer seqLen)
Sets the maximum sequence length for generation.
-
temperature
final LlmGenerationConfig.Builder temperature(Float temperature)
Sets the temperature for random sampling.
-
numBos
final LlmGenerationConfig.Builder numBos(Integer numBos)
Sets the number of BOS tokens to prepend.
-
numEos
final LlmGenerationConfig.Builder numEos(Integer numEos)
Sets the number of EOS tokens to append.
-
build
final LlmGenerationConfig build()
Constructs the LlmGenerationConfig instance with the configured parameters.
-
-
-
-