Description

You will build and maintain data processing pipelines using Python and PySpark within Azure and Databricks environments.

Responsibilities

  • Write and optimize Python and PySpark scripts for data processing and analysis.
  • Develop and execute complex queries to manage data workflows.
  • Deploy and manage data solutions on-site at client locations in Mumbai or Pune.
  • Utilize Databricks and Azure environments to support data engineering tasks.

Required Skills

  • 3+ years of relevant data engineering experience.
  • Proficiency in Python for data manipulation.
  • Hands-on experience with PySpark for large-scale data processing.
  • Strong understanding of syntax and experience writing queries.
  • Knowledge or exposure to Azure cloud services.
  • Experience or exposure to Databricks.
  • Any Graduate degree.

Education

Any Graduate