ai_function_* session settings

These settings are available in system.settings and are autogenerated from source.

​

ai_function_embedding_default_credentials

Name of the named collection used by aiEmbed when the call does not pass credentials in its parameter map. Empty means no default: such calls must pass credentials explicitly. aiEmbed takes model as a required positional argument, not from the named collection. Kept separate from ai_function_text_default_credentials because an embeddings endpoint differs from a chat one.

​

ai_function_embedding_max_batch_size

Maximum number of texts to include in a single HTTP request made by aiEmbed. Texts are grouped into batches of this size to reduce API call overhead. For example, 500 unique texts with a batch size of 100 result in 5 HTTP requests.

​

ai_function_max_api_calls_per_query

Maximum number of HTTP requests that AI functions may dispatch per query. Set to 0 to disable.

​

ai_function_max_input_tokens_per_query

Maximum total input (prompt) tokens across all AI function API calls in a single query. Tracked cumulatively from provider responses. Note that this limit may be exceeded by one call’s worth of input tokens, since the number of input tokens of a call are not known in advance. Set to 0 to disable. This limit is only enforced for providers that report a usage object in their response (OpenAI, Anthropic, vLLM). Providers that omit token usage (notably HuggingFace TEI) cause the counter to stay at 0 — use ai_function_max_api_calls_per_query instead to bound such calls.

​

ai_function_max_output_tokens_per_query

Maximum total output (completion) tokens across all AI function API calls in a single query. Tracked cumulatively from provider responses. Note that this limit may be exceeded by one call’s worth of output tokens, since the number of output tokens of a call are not known in advance. Set to 0 to disable. This limit is only enforced for providers that report a usage object in their response (OpenAI, Anthropic, vLLM). It does not apply to embedding functions (notably aiEmbed), which never produce output tokens.

​

ai_function_max_retries

Maximum number of retry attempts for transient errors per individual API request. Each retry uses exponential backoff starting from ai_function_retry_initial_delay_ms.

​

ai_function_request_timeout_sec

Timeout in seconds for individual HTTP requests made by AI functions (AI chat completions and embedding API calls). If a request does not complete within this time, it is considered failed and may be retried according to ai_function_max_retries.

​

ai_function_retry_initial_delay_ms

Initial delay in milliseconds before the first retry of a failed AI function API request. The delay doubles on each subsequent attempt (exponential backoff). For example, with default settings: 1000ms, 2000ms, 4000ms.

​

ai_function_text_default_credentials

Name of the named collection used by the text AI functions (aiGenerate, aiClassify, aiExtract, aiTranslate) when the call does not pass credentials in its parameter map. Empty means no default: such calls must pass credentials explicitly. A chat-completions endpoint differs from an embeddings one, so this is separate from ai_function_embedding_default_credentials.

​

ai_function_throw_on_error

If true (default), an AI function call that fails permanently after exhausting all retries aborts the query with an exception. If false, the failed row receives the default value for the column type (empty string for String) and processing continues.

​

ai_function_throw_on_quota_exceeded

If true (default), exceeding an AI function quota limit (ai_function_max_input_tokens_per_query, ai_function_max_output_tokens_per_query, or ai_function_max_api_calls_per_query) aborts the query with an exception. If false, remaining rows receive the default value for the column type (empty string for String).