Skip to content
    Back to jobs

    Lead Cortex Developer

    KPI Partners

    Pay
    From ₹40 lakh a year
    Location
    Bangalore, Hyderabad, Pune · Hybrid
    Job type
    Full time permanent
    • Snowflake
    • dbt
    • Apache Airflow
    • PySpark
    • SQL

    Key responsibilities

    Lead the design, development, and implementation of data engineering solutions using Snowflake.
    Develop and optimize data pipelines, transformations, and workflows using dbt, Apache Airflow, PySpark, and SQL.
    Build and maintain solutions leveraging Snowflake Cortex AI capabilities for AI-driven data processing and analytics.
    Develop complex SQL queries, stored procedures, views, and performance-optimized data models.
    Design scalable ETL/ELT pipelines to ingest, transform, and process structured and semi-structured data.
    Implement data orchestration, scheduling, monitoring, and error-handling mechanisms using Apache Airflow.
    Develop modular, reusable, and maintainable data transformation models using dbt.
    Optimize Snowflake queries, warehouse utilization, and overall data processing performance.
    Lead technical discussions, conduct code reviews, and establish development best practices.
    Collaborate with cross-functional teams to translate business requirements into technical solutions.
    Ensure data quality, security, governance, and reliability across data pipelines.
    Mentor junior developers and provide technical guidance to the development team.

    Mandatory technical skills

    Snowflake: Strong hands-on experience in data warehousing, data modeling, query optimization, and Snowflake architecture.
    dbt: Experience developing data transformation models, reusable SQL logic, testing, and dependency management.
    Apache Airflow: Experience building, scheduling, monitoring, and troubleshooting data pipeline workflows.
    PySpark: Strong experience in distributed data processing, transformations, and large-scale data engineering.
    SQL: Excellent proficiency in complex queries, joins, CTEs, window functions, query tuning, and data analysis.
    Snowflake Cortex: Experience with Cortex AI capabilities is highly desirable for developing AI-enabled data solutions.

    Required experience

    Strong hands-on experience in Snowflake-based data engineering.
    Proven experience designing and implementing scalable data pipelines.
    Experience leading technical development and mentoring team members.
    Strong analytical, communication, and troubleshooting skills.
    Ability to work independently and deliver solutions in a fast-paced environment.

    About the role

    Lead and deliver scalable Snowflake-based data engineering solutions. Build and optimize ETL/ELT pipelines for structured and semi-structured data. Enable AI-driven data processing and analytics using Snowflake Cortex. Establish development best practices and raise team technical standards. Ensure data quality, security, governance, and reliability across pipelines.

    What you’ll do

    • Lead the design, development, and implementation of data engineering solutions using Snowflake
    • Develop and optimize data pipelines, transformations, and workflows using dbt, Apache Airflow, PySpark, and SQL
    • Build and maintain solutions leveraging Snowflake Cortex AI capabilities for AI-driven data processing and analytics
    • Develop complex SQL queries, stored procedures, views, and performance-optimized data models
    • Design scalable ETL/ELT pipelines to ingest, transform, and process structured and semi-structured data
    • Implement data orchestration, scheduling, monitoring, and error-handling mechanisms using Apache Airflow
    • Develop modular, reusable, and maintainable data transformation models using dbt

    What we’re looking for

    Must have

    • Snowflake
    • dbt
    • Apache Airflow
    • PySpark
    • SQL

    Nice to have

    • Snowflake Cortex

    Tech stack

    • Snowflake
    • Snowflake Cortex
    • Snowpark
    • Databricks
    • SQL
    • Python
    • AWS
    • Microsoft Azure
    • Google Cloud Platform (GCP)
    • Microsoft Power BI
    • Microsoft Power Apps
    • Microsoft Fabric

    About KPI Partners

    KPI Partners is a global strategic partner for Analytics and Digital Transformation solutions, delivering advanced capabilities in Data Science, GenAI, AI/ML, Cloud Databases, Data Engineering, Analytics & Visualization, and DevOps/DevSecOps/MLOps. Founded in 2006 and headquartered in Newark, California, it supports a wide range of clients, including several Fortune 500 companies across high-tech, retail, CPG, financial services, insurance, manufacturing, and life sciences. The company has not raised any external funding and operates a blended-shore delivery model across the US, UK, and India.

    IT Services and IT Consulting (Data, Analytics & AI consulting) · Bootstrapped · ~784 employees (Revelio Labs, March 2026); headcount range 200-500 per The Comp…

    Lead Cortex Developer

    Apply now