LLMs

Learn how to export LLM models and deploy them across different platforms and runtime environments. This section covers the complete workflow from model export to running inference on mobile devices and edge hardware.

Working with LLMs

• Deploying LLMs to ExecuTorch
• Exporting LLMs
• Exporting LLMs with HuggingFace’s Optimum ExecuTorch
• Exporting custom LLMs
• Running LLMs with C++
• Run Llama 3 3B Instruct on Android (with Qualcomm AI Engine Direct Backend)
• Running LLMs on Android
• Running LLMs on iOS