Description

You will design and implement end-to-end large-scale data systems.

Responsibilities

• Write scalable, high-performance code for data processing pipelines.
• Implement end-to-end system architectures for large-scale projects.
• Manage parallel batch processing workflows using Python.
• Develop and maintain data workloads on AWS infrastructure.

Required Skills

• 8+ years of experience in data engineering roles.
• Expertise in Python programming and PySpark.
• Strong proficiency with Pandas, NumPy, and Joblib.
• Hands-on experience with AWS EMR.
• Experience building workflows with AWS Batch and Step Functions.
• Proven track record of implementing at least two large-scale projects.
• Any Graduate degree.

Preferred Skills

• Experience with Apache Airflow.

Key Skills

Education

Any Gradute