Description

You will build and maintain data pipelines using distributed computing frameworks and data lake architectures.

Responsibilities

• Develop and optimize data processing workflows using PySpark and Scala.
• Manage and maintain data structures within Databricks environments.
• Implement scalable data ingestion patterns into the Data Lake.
• Ensure data quality and pipeline reliability through efficient Python scripting.

Required Skills

• 3+ years of experience in data engineering roles.
• Proficiency in Python.
• Hands-on experience with PySpark.
• Experience programming in Scala.
• Practical knowledge of Databricks.
• Experience working with Data Lake architectures.
• Ability to join within 15 days.

Key Skills

Education

Not specified