Description

You will own the design, development, and maintenance of data pipelines and ETL processes.

Responsibilities

• Design, develop, and maintain data pipelines and ETL processes.
• Ensure data integrity, quality, and availability when working with large-scale datasets.
• Optimize data workflows for performance and scalability in cloud environments.
• Implement data governance and security best practices.
• Collaborate with data scientists, analysts, and engineers to meet data needs.

Required Skills

• 10+ years of experience in data engineering.
• Proficiency in Python and SQL for data manipulation and pipeline development.
• Hands-on experience with AWS services including S3, Lambda, Glue, and IAM.
• Strong understanding of data modeling, warehousing, and distributed systems.
• Experience with version control systems, specifically Git.
• Experience building and maintaining CI/CD pipelines.

Preferred Skills

• Experience with Databricks or similar data platforms.
• Familiarity with Java for backend or data-related development.

Key Skills

Education

Any Gradute