Package org.pytorch.executorch.extension.llm
Extension for LLM related use cases for ExecuTorch Android Java/JNI package.
See: Description
-
Interface Summary Interface Description LlmCallback Callback interface for Llama model. -
Class Summary Class Description Builder Builder class for constructing LlmGenerationConfig instances. LlmGenerationConfig Configuration class for controlling text generation parameters in LLM operations. LlmModule LlmModule is a wrapper around the Executorch LLM. Builder Builder class for constructing LlmModuleConfig instances with optional parameters. LlmModuleConfig Configuration class for initializing a LlmModule.