Description

You will design, build, and maintain scalable ETL/ELT pipelines for enterprise-level data initiatives.

This role is remote.

Responsibilities

• Develop and optimize data models and warehousing solutions on Snowflake.
• Write efficient Python code for data transformation, automation, and serverless workflows using AWS Lambda.
• Integrate structured and unstructured data from multiple sources into centralized platforms.
• Implement data quality checks, validation frameworks, and error-handling mechanisms.
• Monitor pipeline performance, troubleshoot issues, and ensure security and governance compliance.

Required Skills

• 15+ years of overall IT experience with a strong focus on data engineering.
• Hands-on expertise with AWS Glue (jobs, crawlers, workflows, Glue Studio).
• Strong experience with Snowflake (data modeling, performance tuning, SnowSQL, Snowpipe).
• Advanced proficiency in Python for scripting and data processing (Pandas, PySpark).
• Solid experience with AWS Lambda for serverless and event-driven architectures.
• Strong SQL skills for data querying, transformation, and optimization.
• Experience with orchestration tools such as Airflow or AWS Step Functions.
• Familiarity with CI/CD pipelines for data workflows (Git, Jenkins, CodePipeline).
• Understanding of dimensional modeling and data lake architecture.

Preferred Skills

• Experience with real-time data streaming (Kinesis, Kafka).
• Knowledge of Terraform or CloudFormation for infrastructure as code.

Key Skills

Education

Any Graduate