Description

You will design and maintain data processing pipelines using PySpark and Databricks on AWS.

This role is on-site.

Responsibilities

• Develop and implement data processing pipelines using PySpark and Databricks.
• Design and maintain ETL processes within the AWS cloud environment.
• Integrate data workflows using orchestration tools like Airflow.
• Support and maintain legacy systems including COBOL, JCL, and SAS.

Required Skills

• 5+ years of professional experience in data engineering.
• Expert proficiency in PySpark.
• Hands-on experience with Databricks.
• Required familiarity with AWS cloud platforms.
• Knowledge of ETL design and implementation.
• Experience with workflow orchestration tools, specifically Airflow.
• Familiarity with mainframe technologies: MF COBOL, JCL, or SAS.

Preferred Skills

• Exposure to Google Cloud Platform (GCP).

Key Skills

Education

Any Graduate