Skip to main content

Create LLM Connections

To use Large Language Models (LLMs) with your GenAI tools, you must connect Alteryx One to your LLM of choice. To do so…

  1. From your Alteryx One account, go to the Connections page.

  2. Select Create Connection. For details on connection creation, go to Create Connection Window.

  3. You can use the Search bar to find your LLM or select LLMs to filter the list to only display available LLM connections.

  4. Choose your LLM of choice and enter the configuration details.

Once you create the connection, the LLM is available via the LLM Override and Prompt tools in Designer Desktop.

重要

Each LLM connection has different configuration requirements, both in terms of what setup is needed in the LLM itself and the configuration settings in Alteryx One.

For details, review the LLM-specific configuration details below.

Amazon Bedrock

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • AWS Region Name: Enter the region of your AWS account (for example, US-West).

  • Credential Type: Currently, AWS Access Key is the only option. Enter the AWS Access Key ID and AWS Secret Access Key for the account that you want to connect. For more information, go to the AWS IAM documentation. We recommend that you create an IAM role and use the corresponding access keys.

    • For broad permissions, add AmazonBedrockFullAccess to the IAM role.

    • For minimal permission, add these permissions to the IAM role:

      • bedrock:InvokeModel

      • bedrock:InvokeModelWithResponseStream

      • bedrock:ListFoundationModels

      • bedrock:GetFoundationModel

Amazon Sagemaker

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • AWS Region Name: Enter the region of your AWS account (for example, US-West).

  • Credential Type: Currently, AWS Access Key is the only option. Enter the AWS Access Key ID and AWS Secret Access Key for the account that you want to connect. For more information, go to the AWS IAM documentation. We recommend that you create an IAM role and use the corresponding access keys.

    • For broad permissions, add AmazonSagemakerFullAccess to the IAM role.

    • For minimal permission, add these permissions to the IAM role:

      • sagemaker:InvokeEndpoint

      • sagemaker:InvokeEndpointWithResponseStream

      • sagemaker:ListEndpoints

Anthropic

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Anthropic API Key. Get your API key through the Anthropic Console.

Azure OpenAI Service

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Azure OpenAI API Key. You must first follow the Azure API Management guide to set up your model for use with Azure OpenAI API.

Cohere

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Cohere API Key. Learn how to get your API key from your Cohere account.

Databricks

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • Base URL: Enter your Databricks Base URL (for example, https://<workspace>.databricks.com/serving-endpoints).

  • API Key: Enter your Databricks Personal Access Token. This provides access to either Databricks Foundation models or custom deployed models.

DeepSeek

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your DeepSeek API Key. Learn how to get your API key from your DeepSeek account.

Google Gemini

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Google AI Studio API Key. Get your API Key from your Google AI Studio account.

Google Vertex AI

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, Vertex Credential JSON is the only option.

  • Vertex Credentials: Copy and paste the JSON that contains your service account keys. Learn how to create your service account keys from Google Cloud.

Groq

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your GroqCloud API Key. Learn how to create your API Key from your GroqCloud account.

Hugging Face

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Hugging Face User Access Token. Learn how to create your User Access Token from your Hugging Face account.

Mistral

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Mistral API Key. Learn how to create your API Key from your Minstral account.

OpenAI

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your OpenAI API Key. Learn how to create your API Key from your OpenAI account.

Perplexity

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your Perplexity API Key. Learn how to create your API Key from you Perplexity account.

xAI

Connection Information

  • Connection Name: Provide a descriptive connection name that users will reference when using this connection later.

  • Connection Description (optional): Provide a description for the connection.

Credential Information

  • Credential Type: Currently, API Key is the only option.

  • API Key: Enter your xAI API Key. Learn how to create your API Key from your xAI account.