Snowflake

This documentation describes the integration of MindsDB with Snowflake, a cloud data warehouse used to store and analyze data. The integration allows MindsDB to access data stored in the Snowflake database and enhance it with AI capabilities.

Important!

When querying data from Snowflake, MindsDB automatically converts column names to lower-case. To prevent this, users can provide an alias name as shown below.

This update is introduced with the MindsDB version 25.3.4.1. It is not backward-compatible and has the following implications:

1. Queries to Snowflake will return column names in lower-case from now on.
2. The models created with Snowflake as a data source must be recreated.

How it works

The below query presents how Snowflake columns are output when queried from MindsDB.

SELECT
       CC_NAME,                 -- converted to lower-case
       CC_CLASS AS `CC_CLASS`,  -- provided alias name in upper-case
       CC_EMPLOYEES,
       cc_employees
FROM snowflake_data.TPCDS_SF100TCL.CALL_CENTER;

Here is the output:

+--------------+----------+--------------+--------------+
| cc_name      | CC_CLASS | cc_employees | cc_employees |
+--------------+----------+--------------+--------------+
| NY Metro     | large    | 597159671    | 597159671    |
| Mid Atlantic | medium   | 944879074    | 944879074    |
+--------------+----------+--------------+--------------+

Prerequisites

Before proceeding, ensure the following prerequisites are met:

1. Install MindsDB locally via Docker or Docker Desktop.
2. To connect Snowflake to MindsDB, install the required dependencies following this instruction.

Connection

Establish a connection to your Snowflake database from MindsDB by executing the following SQL command:

CREATE DATABASE snowflake_datasource
WITH
    ENGINE = 'snowflake',
    PARAMETERS = {
        "account": "tvuibdy-vm85921",
        "user": "user",
        "password": "password",
        "database": "test_db"
    };

Required connection parameters include the following:

• account: The Snowflake account identifier. This guide will help you find your account identifier.
• user: The username for the Snowflake account.
• password: The password for the Snowflake account.
• database: The name of the Snowflake database to connect to.

Optional connection parameters include the following:

• warehouse: The Snowflake warehouse to use for running queries.
• schema: The database schema to use within the Snowflake database. Default is PUBLIC.
• role: The Snowflake role to use.

Usage

Connect to the Snowflake database:

CREATE DATABASE snowflake_datasource
WITH
    ENGINE = 'snowflake',
    PARAMETERS = {
        "account": "VHACDYL-LQ24981"
        "user": "DEMO_USER",
        "password": "Demo_Userg1"
        "database": "DENO"
        "warehouse": "DEMO_HAREHOUSE"
    };

Retrieve data from a specified table by providing the integration name, schema, and table name:

SELECT *
FROM snowflake_datasource.sample_data.orders;
LIMIT 10;

Run Snowflake SQL queries directly on the connected Snowflake database:

SELECT * FROM snowflake_datasource (

    --Native Query Goes Here
    SELECT
        employee_table.* EXCLUDE department_id,
        department_table.* RENAME department_name AS department
    FROM employee_table INNER JOIN department_table
        ON employee_table.department_id = department_table.department_id
    ORDER BY department, last_name, first_name;

);

Troubleshooting Guide

Database Connection Error

• Symptoms: Failure to connect MindsDB with the Snowflake account.
• Checklist:
  1. Make sure the Snowflake is active.
  2. Confirm that account, user, password and database are correct. Try a direct Snowflake connection using a client like DBeaver.
  3. Ensure a stable network between MindsDB and Snowflake.

SQL statement cannot be parsed by mindsdb_sql

• Symptoms: SQL queries failing or not recognizing table names containing spaces or special characters.
• Checklist:
  1. Ensure table names with spaces or special characters are enclosed in backticks.
  2. Examples:
     • Incorrect: SELECT * FROM integration.travel data
     • Incorrect: SELECT * FROM integration.‘travel data’
     • Correct: SELECT * FROM integration.`travel data`

This troubleshooting guide provided by Snowflake might also be helpful.