Description

You will build and maintain data platforms focused on PySpark migrations and AWS integration.

Responsibilities

• Develop and maintain data platforms using Python and Spark.
• Handle migrations to PySpark on AWS environments.
• Design and implement data pipelines to ensure data quality and integrity.
• Collaborate with cross-functional teams to design solutions based on business requirements.
• Implement and manage agents for monitoring, logging, and automation within AWS.

Required Skills

• Python
• Spark
• PySpark
• AWS
• Big Data architecture
• Data pipeline design
• Data migration
• Monitoring and logging implementation

Education

• Any graduate

Key Skills

Education

Any graduate