Lead Cortex Developer
KPI Partners
- Pay
- From ₹40 lakh a year
- Location
- Bangalore, Hyderabad, Pune · Hybrid
- Job type
- Full time permanent
- Snowflake
- dbt
- Apache Airflow
- PySpark
- SQL
Key responsibilities
Lead the design, development, and implementation of data engineering solutions using Snowflake.
Develop and optimize data pipelines, transformations, and workflows using dbt, Apache Airflow, PySpark, and SQL.
Build and maintain solutions leveraging Snowflake Cortex AI capabilities for AI-driven data processing and analytics.
Develop complex SQL queries, stored procedures, views, and performance-optimized data models.
Design scalable ETL/ELT pipelines to ingest, transform, and process structured and semi-structured data.
Implement data orchestration, scheduling, monitoring, and error-handling mechanisms using Apache Airflow.
Develop modular, reusable, and maintainable data transformation models using dbt.
Optimize Snowflake queries, warehouse utilization, and overall data processing performance.
Lead technical discussions, conduct code reviews, and establish development best practices.
Collaborate with cross-functional teams to translate business requirements into technical solutions.
Ensure data quality, security, governance, and reliability across data pipelines.
Mentor junior developers and provide technical guidance to the development team.
Mandatory technical skills
Snowflake: Strong hands-on experience in data warehousing, data modeling, query optimization, and Snowflake architecture.
dbt: Experience developing data transformation models, reusable SQL logic, testing, and dependency management.
Apache Airflow: Experience building, scheduling, monitoring, and troubleshooting data pipeline workflows.
PySpark: Strong experience in distributed data processing, transformations, and large-scale data engineering.
SQL: Excellent proficiency in complex queries, joins, CTEs, window functions, query tuning, and data analysis.
Snowflake Cortex: Experience with Cortex AI capabilities is highly desirable for developing AI-enabled data solutions.
Required experience
Strong hands-on experience in Snowflake-based data engineering.
Proven experience designing and implementing scalable data pipelines.
Experience leading technical development and mentoring team members.
Strong analytical, communication, and troubleshooting skills.
Ability to work independently and deliver solutions in a fast-paced environment.
About the role
Lead and deliver scalable Snowflake-based data engineering solutions. Build and optimize ETL/ELT pipelines for structured and semi-structured data. Enable AI-driven data processing and analytics using Snowflake Cortex. Establish development best practices and raise team technical standards. Ensure data quality, security, governance, and reliability across pipelines.
What you’ll do
- Lead the design, development, and implementation of data engineering solutions using Snowflake
- Develop and optimize data pipelines, transformations, and workflows using dbt, Apache Airflow, PySpark, and SQL
- Build and maintain solutions leveraging Snowflake Cortex AI capabilities for AI-driven data processing and analytics
- Develop complex SQL queries, stored procedures, views, and performance-optimized data models
- Design scalable ETL/ELT pipelines to ingest, transform, and process structured and semi-structured data
- Implement data orchestration, scheduling, monitoring, and error-handling mechanisms using Apache Airflow
- Develop modular, reusable, and maintainable data transformation models using dbt
What we’re looking for
Must have
- Snowflake
- dbt
- Apache Airflow
- PySpark
- SQL
Nice to have
- Snowflake Cortex
Tech stack
- Snowflake
- Snowflake Cortex
- Snowpark
- Databricks
- SQL
- Python
- AWS
- Microsoft Azure
- Google Cloud Platform (GCP)
- Microsoft Power BI
- Microsoft Power Apps
- Microsoft Fabric
About KPI Partners
KPI Partners is a global strategic partner for Analytics and Digital Transformation solutions, delivering advanced capabilities in Data Science, GenAI, AI/ML, Cloud Databases, Data Engineering, Analytics & Visualization, and DevOps/DevSecOps/MLOps. Founded in 2006 and headquartered in Newark, California, it supports a wide range of clients, including several Fortune 500 companies across high-tech, retail, CPG, financial services, insurance, manufacturing, and life sciences. The company has not raised any external funding and operates a blended-shore delivery model across the US, UK, and India.
IT Services and IT Consulting (Data, Analytics & AI consulting) · Bootstrapped · ~784 employees (Revelio Labs, March 2026); headcount range 200-500 per The Comp…