Description
You will design and maintain data pipelines using Snowflake and AWS services. You own the ETL processes from ingestion to consumption.
Responsibilities
- Build and optimize ETL pipelines using Snowflake, AWS Glue, and Airflow.
- Develop serverless data processing solutions using AWS Lambda.
- Write efficient PySpark scripts for large-scale data transformations.
- Maintain Python-based data engineering tools and scripts.
Required Skills
- 5+ years of experience as a Data Engineer.
- Strong proficiency in Snowflake SQL and data modeling.
- Hands-on experience with AWS Airflow for workflow orchestration.
- Proficiency in AWS Glue for ETL development.
- Experience with AWS Lambda for serverless computing.
- Advanced Python programming skills.
- Practical experience with PySpark for data processing.
Preferred Skills
- Experience working in hybrid environments in Bengaluru or Noida.
- Familiarity with IST shift operations.