You will build and maintain data processing pipelines using Python and PySpark within Azure and Databricks environments.
Responsibilities
- Write and optimize Python and PySpark scripts for data processing and analysis.
- Develop and execute complex queries to manage data workflows.
- Deploy and manage data solutions on-site at client locations in Mumbai or Pune.
- Utilize Databricks and Azure environments to support data engineering tasks.
Required Skills
- 3+ years of relevant data engineering experience.
- Proficiency in Python for data manipulation.
- Hands-on experience with PySpark for large-scale data processing.
- Strong understanding of syntax and experience writing queries.
- Knowledge or exposure to Azure cloud services.
- Experience or exposure to Databricks.
- Any Graduate degree.