Description

Architect and develop large-scale data engineering platforms on AWS. This role is on-site.

Responsibilities

• Define platform roadmaps, architecture, and solutions, including design, POCs, and technical evaluations.
• Develop data platform, migration, and validation strategies.
• Design data models to reduce system complexity and increase efficiency.
• Review code against coding standards and checklists.

Required Skills

• 12+ years of experience in data engineering architecture for large-scale platforms.
• Expertise with real-time processing frameworks, including Apache Spark and PySpark.
• Hands-on experience with AWS Redshift, EMR, and Databricks.
• Strong coding background in Python and SQL.
• Proficiency with data ingestion and orchestration tools (e.g., Apache Airflow).
• Experience with CI/CD pipelines and DevOps practices (Jenkins, Git, Docker).
• Familiarity with data governance and access control frameworks (e.g., Privacera, Apache Ranger).
• Experience designing enterprise data platforms in healthcare, pharma, or regulated industries.

Key Skills

Education

Any Graduate