Description

You will design and implement large-scale data processing solutions within AWS environments.

Responsibilities

• Execute data migrations from on-premises HDFS to S3.
• Optimize EMR performance and S3 I/O to improve processing efficiency.
• Develop scalable data pipelines using PySpark and SQL.
• Manage workflow orchestration using MWAA.

Required Skills

• 6+ years of big data development experience.
• 3+ years of hands-on experience with AWS.
• Proficiency with PySpark and SQL.
• Experience with Amazon EMR and S3.
• Knowledge of Apache Iceberg.
• Experience with Amazon MWAA.
• Proven ability to handle HDFS to S3 migration scenarios.
• Expertise in EMR performance tuning and S3 I/O optimization.
• Any graduate degree.

Key Skills

Education

Any Graduate