Package 

Class LlmGenerationConfig.Builder


  • 
    public class LlmGenerationConfig.Builder
    
                        

    Builder class for constructing LlmGenerationConfig instances.

    Provides a fluent interface for configuring generation parameters with sensible defaults.All methods return the builder instance to enable method chaining.

    • Method Detail

      • echo

         LlmGenerationConfig.Builder echo(boolean echo)

        Sets whether to include the input prompt in the generated output.

        Parameters:
        echo - true to include input prompt, false to return only new tokens
      • maxNewTokens

         LlmGenerationConfig.Builder maxNewTokens(int maxNewTokens)

        Sets the maximum number of new tokens to generate.

        Parameters:
        maxNewTokens - the token limit (-1 for unlimited generation)
      • seqLen

         LlmGenerationConfig.Builder seqLen(int seqLen)

        Sets the maximum sequence length for generation.

        Parameters:
        seqLen - maximum sequence length (-1 for default behavior)