Description

You will build and maintain data infrastructure to support data science and analytics workflows.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Build and optimize data warehouses and data lakes using PySpark and AWS platforms.
• Implement data ingestion, transformation, and orchestration workflows using AWS Step Functions, Lambda, and Glue Jobs.
• Monitor, troubleshoot, and optimize pipeline performance using AWS CloudWatch.
• Ensure data quality, governance, and security across all data systems and workflows.

Required Skills

• 5+ years of experience as a Data Engineer.
• Expert proficiency in Python.
• Hands-on experience with AWS services (e.g., AWS Glue, Lambda, Step Functions).
• Experience with PySpark for data processing.
• Familiarity with Databricks.
• Knowledge of CI/CD practices.
• Experience implementing Infrastructure as Code (IaC).

Key Skills

Education

Any Gradute