> ## Documentation Index
> Fetch the complete documentation index at: https://docs.elementum.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Accessing Files from Snowflake Stages

> Complete guide to accessing and processing files stored in Snowflake stages through Elementum automations

## Overview

This workflow enables you to process external files automatically, extract data, and trigger workflows based on file content.

The Snowflake stage file access workflow consists of six main steps:

1. **Create a Snowflake view** for stage files
2. **Import the view as an Elementum table**
3. **Build a Data Mine** to monitor for new or changed files
4. **Create an automation** triggered by the Data Mine
5. **Process files** using the presigned URLs in your automation
6. **Add additional actions** to your automation

<Info>
  This workflow enables you to securely access and process files stored in Snowflake stages - without duplicating the data outside of Snowflake. By default, files are not persisted or stored outside of Snowflake; your data remains protected and centralized unless you explicitly configure otherwise.
</Info>

## Prerequisites

Before starting this workflow, ensure you have:

* **Snowflake access** with permissions to create views and access stages
* **Elementum CloudLink** configured and connected to your Snowflake instance
* **Files uploaded** to a Snowflake stage (e.g., `@files_to_process`)
* **Directory Table enabled on your Snowflake stage** for file listing and metadata access
* **Understanding** of [Elementum Tables](/data/tables), [Data Mining](/data/data-mining), and [Automation System](/workflows/automation-system)

<Note>
  The stage you use must have a [Directory Table](https://docs.snowflake.com/en/user-guide/data-load-dirtables) enabled. Enable it with:

  ```sql theme={null}
  ALTER STAGE <your_stage_name> SET DIRECTORY = (ENABLE = TRUE);
  ```
</Note>

## Step 1: Create Snowflake View from a Stage

The first step is creating a Snowflake view that provides access to your stage files with presigned URLs for secure access.

Execute this SQL in your Snowflake environment:

```sql theme={null}
CREATE VIEW STAGE_FILES_VIEW AS 
SELECT RELATIVE_PATH,
        SIZE,
        LAST_MODIFIED,
        MD5,
        get_presigned_url(@files_to_process, RELATIVE_PATH, 3600) AS presigned_url
FROM DIRECTORY(@files_to_process);
```

<AccordionGroup>
  <Accordion title="Understanding the View Components">
    * **`RELATIVE_PATH`**: File path within the stage
    * **`SIZE`**: File size in bytes
    * **`LAST_MODIFIED`**: Timestamp of last file modification
    * **`MD5`**: File hash for integrity checking
    * **`presigned_url`**: Secure, time-limited URL for file access (valid for 3600 seconds = 1 hour)

    <Tip>
      The `presigned_url` is automatically regenerated every time the Data Mine runs, ensuring that URLs are always fresh and valid. This means you never have to worry about URL expiration interrupting your automated file processing.
    </Tip>
  </Accordion>
</AccordionGroup>

## Step 2: Import View as Elementum Table

Once your Snowflake view is created, import it into Elementum as a table.

1. Navigate to **Tables** → **Explore Data** → **CloudLink**
2. Select your Snowflake connection and choose the view you created
3. Click **Create Table** and fill out the details

## Step 3: Build Data Mine for File Monitoring

Create a Data Mine to automatically detect when new files arrive or existing files change.

1. In your table, go to **Data Mining** → **Create Data Mine** → **Logic-Based Rules Mining**
2. **Identifying Columns**: Select `RELATIVE_PATH`, `LAST_MODIFIED`, and `MD5`

<Tip>
  These columns work together to track individual files across Data Mine runs, detect when files are modified or replaced, and ensure accurate state management (ON/OFF transitions).
</Tip>

3. **Matching Criteria**: Set filters for file types or conditions (optional)
4. **Name and Schedule**: Give it a name and set check frequency

## Step 4: Create Automation with Data Mine Trigger

Build an automation that processes files when the Data Mine detects them.

<Note>
  Your automation will follow this logical flow: **Data Mine Trigger** → **Process File** → **Take Additional Actions** (e.g. AI Analysis)
</Note>

1. Navigate to **Automations** → **Create Automation**
2. Add **Data Mine Trigger** and select your Data Mine
3. Set trigger option to **Trigger when data meets requirement**

## Step 5: Process Files Using API Request Action

Add an API Request action to your automation to access files stored in the Snowflake stage.

**API Request** action details:

* **Request URL**: `$PRESIGNED_URL`
* **Method**: `GET`
* **Authorization**: `No Auth`
* **Response Type**: `File`

<Tip>
  **Variable Reference**: The `$PRESIGNED_URL` variable comes from the Data Mine trigger, providing access to all fields from the matching stage file record.
</Tip>

## Step 6: Add Additional Actions

After accessing the file via the API Request action, any additional actions you add will now have access to the file content.

## Summary

This workflow enables you to automatically process files stored in Snowflake stages:

1. **Snowflake View** provides secure access to stage files
2. **Elementum Table** makes stage files accessible in your workspace
3. **Data Mine** automatically detects new or changed files
4. **Automation** provides access to the file content
5. **Additional Actions** enable AI analysis, data extraction, and workflow automation

By following this guide, you can create an automated file processing system that uses your Snowflake stage as a workflow trigger so your business can respond to new data as it arrives.

***

## Appendix: Quick Test Setup in Snowflake

Use the following SQL to create a stage in Snowflake for testing purposes. Replace the `ALL_CAPS` placeholders with your actual values.

For complete configuration options, see Snowflake's [CREATE STAGE documentation](https://docs.snowflake.com/en/sql-reference/sql/create-stage).

<AccordionGroup>
  <Accordion defaultOpen title="Create Stage and View">
    ```sql theme={null}
    USE DATABASE DATABASE_NAME;
    USE SCHEMA SCHEMA_NAME;

    -- Create internal stage with directory table enabled
    CREATE OR REPLACE STAGE STAGE_NAME;
    ALTER STAGE STAGE_NAME SET DIRECTORY = (ENABLE = TRUE);

    -- Create view with presigned URLs (1-hour expiration)
    CREATE OR REPLACE VIEW VIEW_NAME AS 
    SELECT RELATIVE_PATH,
           SIZE,
           LAST_MODIFIED,
           MD5,
           get_presigned_url(@STAGE_NAME, RELATIVE_PATH, 3600) AS presigned_url
    FROM DIRECTORY(@STAGE_NAME);
    ```
  </Accordion>

  <Accordion title="Grant CloudLink Permissions">
    <Info>
      Ensure your Elementum CloudLink role has the necessary permissions to access the stage and view.
    </Info>

    ```sql theme={null}
    GRANT USAGE ON DATABASE DATABASE_NAME TO ROLE CLOUDLINK_ROLE;
    GRANT USAGE ON SCHEMA DATABASE_NAME.SCHEMA_NAME TO ROLE CLOUDLINK_ROLE;
    GRANT USAGE ON STAGE DATABASE_NAME.SCHEMA_NAME.STAGE_NAME TO ROLE CLOUDLINK_ROLE;
    GRANT SELECT ON VIEW DATABASE_NAME.SCHEMA_NAME.VIEW_NAME TO ROLE CLOUDLINK_ROLE;
    ```
  </Accordion>

  <Accordion title="Upload Test File">
    Upload a test file to verify the stage is working correctly:

    ```sql theme={null}
    -- Using SnowSQL CLI
    PUT file://path/to/test-file.csv @DATABASE_NAME.SCHEMA_NAME.STAGE_NAME 
        OVERWRITE=TRUE 
        AUTO_COMPRESS=FALSE;
    ```

    <Info>
      You can also upload files through the Snowflake web interface by navigating to your stage and using the "Upload Files" option.
    </Info>
  </Accordion>
</AccordionGroup>