Machine Learning with Snowflake: Snowpark & Cortex

Description:

The rapid evolution of artificial intelligence (AI) and machine learning (ML) is transforming industries worldwide. From personalized customer experiences to real-time fraud detection, organizations are leveraging ML to drive innovation and gain a competitive edge. Snowflake, with its powerful data platform, has emerged as a leader in enabling end-to-end ML pipelines, empowering data professionals to harness the full potential of their data.

This course equips students with the skills to navigate this transformative landscape, combining the scalability of Snowflake with advanced ML capabilities through Snowpark and Cortex. Over three days, students will learn how to build ML workflows that are seamless, scalable, and optimized for modern data engineering and analytics. With Snowflake's recent advancements in Large Language Model (LLM) integration and in-database ML, participants will gain firsthand experience with cutting-edge technologies shaping the future of AI.

Whether you're a data scientist, ML engineer, or analytics professional, this course will help you stay ahead of industry trends and enable you to deploy powerful, real-time ML models in Snowflake's unified platform.

Duration: 3 Day 

Course Code: BDT396

Learning Objectives:

After this course, students will be able to:

• Understand Snowflake’s architecture for machine learning pipelines and integration with external datasets
• Develop ML pipelines using Snowpark for scalable data preparation and modeling
• Utilize Cortex for advanced ML pipeline development, including model training and deployment
• Implement and execute ML functions and LLM functions in Cortex for real-world use cases
• Optimize end-to-end ML workflows using Snowflake’s capabilities

• Familiarity with programming language – especially Python
• Basics of using Snowflake and SQL
• Prior knowledge of Machine Learning will be useful but not required

• This course is designed for Software Developers, Data Scientists, Software Architects, Quality Assurance Engineers, Data Analysts to build and implement generative AI models. Familiarity with machine learning concepts (like neural networks) is helpful but not required.

Course Outline:

1. Snowflake Overview
   1. Quick review of Snowflake Architecture
   2. Understanding data ingestion from external sources
   3. Demos and Labs
2. Machine Learning Overview
   1. Understand the concept of machine learning
   2. Learn about data wrangling & preparing data for machine learning
   3. Understanding machine learning techniques: Classification & Regression
   4. Learn about metrics for validating these techniques
   5. Working with hyper parameters, cross validation
   6. Build machine learning pipelines
   7. Multiple Demos and Labs
3. Machine Learning pipelines with Snowpark
   1. What are Snowpark components?
   2. Snowflake Python connector vs Snowpark – what is the difference?
   3. Working with UDF, Vectorized UDF, Functions, Procedures
   4. Pandas vs Snowpark Dataframes
   5. ML Pipelines with Snowpark
   6. Multiple Demos and Labs
4. Machine Learning pipelines with Snowpark ML (Cortex)
   1. Introduction to Snowpark ML APIs
   2. Data Collections with Filesystem and FileSet
   3. Distributed pipelines with Snowpark ML
   4. Hyper parameter tuning with Snowpark ML
   5. Model predictions with registered models
   6. Multiple Demos and Labs
5. Machine Learning Functions with Cortex
   1. What are machine learning functions in cortex
   2. Performing Time-series forecasting, anomaly detection, classification with ML Functions
   3. Using Snowflake SQL classes and instances
   4. Building Classification and Regression Models with Spark machine learning library
   5. Understanding the costs involved in using Machine Learning Functions
   6. Multiple Demos and Labs
6. LLM (Large Language Model) Functions with Cortex
   1. Understand support for various LLM models on Snowflake
   2. Integrate with ChatGPT models
   3. Using LLM functions: COMPLETE, SENTIMENT, SUMMARIZE, TRANSLATE, etc
   4. Understanding the costs involved in using these LLMs
   5. Multiple Demos and Labs

Training material provided: Yes (Digital format)

Hands-on Lab: Students will create a trial Snowflake account for the hands-on labs. If required virtual machines will be provided