Skip to content

bodo.pandas.BodoSeries.ai.llm_generate

BodoSeries.ai.llm_generate(
        api_key: str,
        model: str | None = None,
        base_url: str | None = None,
        **generation_kwargs) -> BodoSeries

Each element in the series is passed to the LLM endpoint for generation.

Parameters

  • api_key: str: The API key for authentication with the LLM endpoint
  • model: str | None: The model to use for embedding. If None is provided, the default model from the endpoint will be used.
  • base_url: str: The URL of the OpenAI compatible LLM endpoint.
  • **generation_kwargs: dict: Additional keyword arguments for the LLM generation API.

Returns

  • BodoSeries: A series containing the generated text from the LLM.

Example

import bodo.pandas as pd

# Example series
a = pd.Series(["What is the capital of France?", "Who wrote 'To Kill a Mockingbird'?", "What is the largest mammal?"])
# Define the LLM base_url and API key
base_url = "https://api.example.com/v1"
api_key = "your_api_key_here"
# Generate responses using the LLM
b = a.ai.llm_generate(api_key=api_key, model="gpt-3.5-turbo", base_url=base_url, max_tokens=50)
print(b)

Output: 

0    The capital of France is Paris.
1    'To Kill a Mockingbird' was written by Harper Lee.
2    The largest mammal is the blue whale.
dtype: string[pyarrow]