Description

You will build and optimize data pipelines using PySpark and Databricks on AWS.

This role is on-site.

Responsibilities

• Develop and optimize data pipelines using PySpark.
• Implement ETL processes within the Databricks environment.
• Manage and orchestrate workflows using Airflow where applicable.
• Work with cloud infrastructure on AWS.

Required Skills

• 5+ years of experience in PySpark.
• Proficiency with Databricks.
• Experience with Cloud technologies (AWS).
• Familiarity with ETL processes.
• Knowledge of Airflow.
• Exposure to GCP.
• Experience with Mainframe COBOL, JCL, or SAS.

Key Skills

Education

Any Graduate