Fully-managed Llama models


Llama models are available for use as managed APIs and self-deployed models on Gemini Enterprise Agent Platform. You can stream your responses to reduce the end-user latency perception. A streamed response uses server-sent events (SSE) to incrementally stream the response.

Managed Llama models

Llama models offer fully managed and serverless models as APIs. To use a Llama model on Agent Platform, send a request directly to the Agent Platform API endpoint. When using Llama models as a managed API, there's no need to provision or manage infrastructure.

The following models are available from Llama to use in Gemini Enterprise Agent Platform. To access a Llama model, go to its Model Garden model card.

Llama 4 Maverick 17B-128E The largest and most capable multimodal Llama 4 model (MoE 17B active / 400B total), optimized for coding, deep reasoning, sophisticated chat, and high-precision image understanding.
Llama 4 Scout 17B-16E High-efficiency MoE model (17B active / 109B total) delivering state-of-the-art results for long-context retrieval, document summarization, and reasoning across large codebases.
Llama 3.3 70B A text-only 70B instruction-tuned model that provides enhanced performance relative to Llama 3.1 70B and Llama 3.2 90B for text-only applications.

Use Llama models

For managed models, you can use curl commands to send requests to the Gemini Enterprise Agent Platform endpoint using the following model names. To learn how to make streaming and non-streaming calls to Llama models, see Call open model APIs.

To use a self-deployed Gemini Enterprise Agent Platform model:

  1. Navigate to the Model Garden console.
  2. Find the relevant Gemini Enterprise Agent Platform model.
  3. Click Enable and complete the provided form to get the necessary commercial use licenses.

For more information about deploying and using partner models, see Deploy a partner model and make prediction requests.

What's next

Learn how to use Llama models.