- Categories:
String & binary functions (AI Functions)
COUNT_ TOKENS (SNOWFLAKE.CORTEX)¶
Notice
This page is provided for backward compatibility. For new use cases, start with %aisql-new-func-link%, which is the canonical surface going forward. This legacy function will be deprecated by the end of 2026.
Returns the number of tokens in a prompt for the large language model or the task-specific function specified in the argument. This function does not support fine-tuned models.
Syntax¶
Arguments¶
Required:
model_nameName of the model you want to base the token count on. See supported models.
input_textInput text to count the tokens in.
Returns¶
Returns an INT , INTEGER , BIGINT , SMALLINT , TINYINT , BYTEINT type that is the number of tokens in the input text based on the model or function specified.
Usage notes¶
- If a function name is specified, the token count is based on the model used by the function.
- Use lowercase letters in function names.
Note
COUNT_TOKENS does not account for the managed system prompt that is automatically added to the beginning of the input text when using a Cortex Cortex AI functions. As a result, the value returned by COUNT_TOKENS is lower than the actual number of tokens processed by these functions.
Legal notices¶
Refer to Snowflake AI and ML.