Description

You will own the end-to-end design and development of scalable data pipelines.

Responsibilities

• Design and develop scalable data pipelines using Talend, orchestrating complex ELT workflows into Snowflake.
• Architect and optimize data warehousing solutions, including warehouse sizing, clustering keys, and materialized views.
• Build and maintain AWS infrastructure, including S3 data lakes, EC2 batch clusters, RDS, and NoSQL stores.
• Define and enforce data governance, security, and compliance policies across pipelines and AWS resources.
• Mentor junior engineers, conduct code reviews, and implement monitoring/alerting for pipeline reliability and cost control.

Required Skills

• 5+ years of data engineering experience with production-level Talend and Snowflake usage.
• Deep expertise in AWS services (S3, EC2, RDS, NoSQL).
• Expert SQL skills, including performance tuning in Snowflake (query profiling, caching).
• Proficiency in Python and Java for data transformations and custom connectors.
• Experience with orchestration tools like Airflow or Autosys, and CI/CD for data pipelines.
• Strong background in data modeling, schema design, and partitioning for large datasets.
• Knowledge of data security, GDPR/CCPA compliance, and role-based access controls.

Key Skills

Education

Any Gradute