public final class GenerativeModelThis class holds a generative model that can complete what you provided.
Constructors
GenerativeModel(String modelName, VertexAI vertexAi)
public GenerativeModel(String modelName, VertexAI vertexAi)Constructs a GenerativeModel instance.
| Parameters | |
|---|---|
| Name | Description |
modelName |
Stringthe name of the generative model. Supported format: "gemini-pro", "models/gemini-pro", "publishers/google/models/gemini-pro", where "gemini-pro" is the model name. Valid model names can be found at https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models#gemini-models |
vertexAi |
VertexAI |
Methods
countTokens(Content content)
public CountTokensResponse countTokens(Content content)Counts tokens in a single content.
| Parameter | |
|---|---|
| Name | Description |
content |
Contenta com.google.cloud.vertexai.api.Content to count tokens |
| Returns | |
|---|---|
| Type | Description |
CountTokensResponse |
a com.google.cloud.vertexai.api.CountTokensResponse instance that contains the total tokens and total billable characters of the given list of contents |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
countTokens(String text)
public CountTokensResponse countTokens(String text)Counts tokens in a text message.
| Parameter | |
|---|---|
| Name | Description |
text |
Stringa text message to count tokens |
| Returns | |
|---|---|
| Type | Description |
CountTokensResponse |
a com.google.cloud.vertexai.api.CountTokensResponse instance that contains the total tokens and total billable characters of the given list of contents |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
countTokens(List<Content> contents)
public CountTokensResponse countTokens(List<Content> contents)Counts tokens in a list of contents.
| Parameter | |
|---|---|
| Name | Description |
contents |
List<Content>a list of com.google.cloud.vertexai.api.Content to count tokens |
| Returns | |
|---|---|
| Type | Description |
CountTokensResponse |
a com.google.cloud.vertexai.api.CountTokensResponse instance that contains the total tokens and total billable characters of the given list of contents |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContent(Content content)
public GenerateContentResponse generateContent(Content content)Generates content from this model given a single content.
| Parameter | |
|---|---|
| Name | Description |
content |
Contenta com.google.cloud.vertexai.api.Content to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
GenerateContentResponse |
a com.google.cloud.vertexai.api.GenerateContentResponse instance that contains response contents and other metadata |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContent(String text)
public GenerateContentResponse generateContent(String text)Generates content from generative model given a text.
| Parameter | |
|---|---|
| Name | Description |
text |
Stringa text message to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
GenerateContentResponse |
a com.google.cloud.vertexai.api.GenerateContentResponse instance that contains response contents and other metadata |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContent(List<Content> contents)
public GenerateContentResponse generateContent(List<Content> contents)Generates content from this model given a list of contents.
| Parameter | |
|---|---|
| Name | Description |
contents |
List<Content>a list of com.google.cloud.vertexai.api.Content to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
GenerateContentResponse |
a com.google.cloud.vertexai.api.GenerateContentResponse instance that contains response contents and other metadata |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContentAsync(Content content)
public ApiFuture<GenerateContentResponse> generateContentAsync(Content content)Asynchronously generates content from generative model given a single Content.
| Parameter | |
|---|---|
| Name | Description |
content |
Contenta com.google.cloud.vertexai.api.Content to send to the generative model. The role of the content is "user". |
| Returns | |
|---|---|
| Type | Description |
ApiFuture<GenerateContentResponse> |
a com.google.api.core.ApiFuture represents the response of an asynchronous generateContent request |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContentAsync(String text)
public ApiFuture<GenerateContentResponse> generateContentAsync(String text)Asynchronously generates content from generative model given a text.
| Parameter | |
|---|---|
| Name | Description |
text |
Stringa text message to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
ApiFuture<GenerateContentResponse> |
a com.google.api.core.ApiFuture represents the response of an asynchronous generateContent request |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContentAsync(List<Content> contents)
public ApiFuture<GenerateContentResponse> generateContentAsync(List<Content> contents)Asynchronously generates content from generative model given a list of contents.
| Parameter | |
|---|---|
| Name | Description |
contents |
List<Content>a list of com.google.cloud.vertexai.api.Content to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
ApiFuture<GenerateContentResponse> |
a com.google.api.core.ApiFuture represents the response of an asynchronous generateContent request |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContentStream(Content content)
public ResponseStream<GenerateContentResponse> generateContentStream(Content content)Generates content with streaming support from generative model given a single Content.
| Parameter | |
|---|---|
| Name | Description |
content |
Contenta com.google.cloud.vertexai.api.Content to send to the generative model. The role of the content is "user". |
| Returns | |
|---|---|
| Type | Description |
ResponseStream<GenerateContentResponse> |
a ResponseStream that contains a streaming of com.google.cloud.vertexai.api.GenerateContentResponse |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContentStream(String text)
public ResponseStream<GenerateContentResponse> generateContentStream(String text)Generates content with streaming support from generative model given a text.
| Parameter | |
|---|---|
| Name | Description |
text |
Stringa text message to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
ResponseStream<GenerateContentResponse> |
a ResponseStream that contains a streaming of com.google.cloud.vertexai.api.GenerateContentResponse |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
generateContentStream(List<Content> contents)
public ResponseStream<GenerateContentResponse> generateContentStream(List<Content> contents)Generates content with streaming support from generative model given a list of contents.
| Parameter | |
|---|---|
| Name | Description |
contents |
List<Content>a list of com.google.cloud.vertexai.api.Content to send to the generative model |
| Returns | |
|---|---|
| Type | Description |
ResponseStream<GenerateContentResponse> |
a ResponseStream that contains a streaming of com.google.cloud.vertexai.api.GenerateContentResponse |
| Exceptions | |
|---|---|
| Type | Description |
IOException |
if an I/O error occurs while making the API call |
getGenerationConfig()
public GenerationConfig getGenerationConfig()Returns the com.google.cloud.vertexai.api.GenerationConfig of this generative model.
| Returns | |
|---|---|
| Type | Description |
GenerationConfig |
|
getModelName()
public String getModelName()Returns the model name of this generative model.
| Returns | |
|---|---|
| Type | Description |
String |
|
getSafetySettings()
public ImmutableList<SafetySetting> getSafetySettings()Returns a list of com.google.cloud.vertexai.api.SafetySettings of this generative model.
| Returns | |
|---|---|
| Type | Description |
com.google.common.collect.ImmutableList<SafetySetting> |
|
getTools()
public ImmutableList<Tool> getTools()Returns a list of com.google.cloud.vertexai.api.Tool of this generative model.
| Returns | |
|---|---|
| Type | Description |
com.google.common.collect.ImmutableList<Tool> |
|
startChat()
public ChatSession startChat()| Returns | |
|---|---|
| Type | Description |
ChatSession |
|
withGenerationConfig(GenerationConfig generationConfig)
public GenerativeModel withGenerationConfig(GenerationConfig generationConfig)Creates a copy of the current model with updated GenerationConfig.
| Parameter | |
|---|---|
| Name | Description |
generationConfig |
GenerationConfiga com.google.cloud.vertexai.api.GenerationConfig that will be used in the new model. |
| Returns | |
|---|---|
| Type | Description |
GenerativeModel |
a new GenerativeModel instance with the specified GenerationConfig. |
withSafetySettings(List<SafetySetting> safetySettings)
public GenerativeModel withSafetySettings(List<SafetySetting> safetySettings)Creates a copy of the current model with updated safetySettings.
| Parameter | |
|---|---|
| Name | Description |
safetySettings |
List<SafetySetting>a list of com.google.cloud.vertexai.api.SafetySetting that will be used in the new model. |
| Returns | |
|---|---|
| Type | Description |
GenerativeModel |
a new GenerativeModel instance with the specified safetySettings. |
withTools(List<Tool> tools)
public GenerativeModel withTools(List<Tool> tools)Creates a copy of the current model with updated tools.
| Parameter | |
|---|---|
| Name | Description |
tools |
List<Tool> |
| Returns | |
|---|---|
| Type | Description |
GenerativeModel |
a new GenerativeModel instance with the specified tools. |