Description

You will build and maintain data pipelines using Python and Spark.

This role is hybrid.

Responsibilities

• Develop and execute data processing jobs including join, merge, transform, and summarize operations.
• Design and implement data control checks to ensure data integrity.
• Write and interact with SQL queries against RDS databases.
• Process and manage data using Big Data platforms.
• Read from and design APIs.

Required Skills

• 13+ years of professional experience in data engineering.
• Expert proficiency in Python.
• Mandatory experience with Amazon RDS.
• Strong skills in Apache Spark.
• Proficiency in SQL.
• Experience with data processing tasks.

Key Skills

Education

Strong In Python, RDS (must have), Spark, and SQL , More than 13+ Years Candidate