Box Developer Documentation

Join BoxWorks 2024 to discover what's possible with content and AI!

Register now!

AI agent for text generation requests

The AI agent used for generating text.

string
ai_agent_text_gen

The type of AI agent used for generating text.

Value is always ai_agent_text_gen

object

AI agent basic tool used to generate text.

---{content}---

How the content should be included in a request to the LLM. Input for {content} is optional, depending on the use.

openai__text_embedding_ada_002

The model used for the AI agent for calculating embeddings.

basic

The strategy used for the AI agent for calculating embeddings.

641

The number of tokens per chunk.

The parameters for the LLM endpoint specific to OpenAI / Google models.

azure__openai__gpt_3_5_turbo_16k

The model used for the AI agent for basic text. For specific model values, see the available models list.

84001

The number of tokens for completion.

\{user_question\}It is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`10000

The prompt template contains contextual information of the request and the user prompt.

When using the prompt_template parameter, you must include input for {user_question}. Inputs for {current_date} and {content} are optional, depending on the use.

You are a helpful travel assistant specialized in budget travel

System messages aim at helping the LLM understand its role and what it is supposed to do. The input for {current_date} is optional, depending on the use.

Response Example

{
  "type": "ai_agent_text_gen",
  "basic_gen": {
    "content_template": "---{content}---",
    "embeddings": {
      "model": "openai__text_embedding_ada_002",
      "strategy": {
        "id": "basic",
        "num_tokens_per_chunk": 64
      }
    },
    "llm_endpoint_params": {
      "type": "openai_params",
      "frequency_penalty": 1.5,
      "presence_penalty": 1.5,
      "stop": "<|im_end|>",
      "temperature": 0,
      "top_p": 1
    },
    "model": "azure__openai__gpt_3_5_turbo_16k",
    "num_tokens_for_completion": 8400,
    "prompt_template": "It is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`",
    "system_message": "You are a helpful travel assistant specialized in budget travel"
  }
}