Description

You will build and maintain data pipelines using Databricks and Spark.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Apache Spark and PySpark on Databricks.
• Collaborate with teams to define data requirements and deliver analytical solutions.
• Implement data quality checks, performance tuning, and scalable data models.
• Leverage SQL, Python, and Spark for advanced data analysis and reporting.
• Monitor and troubleshoot data workflows to ensure accuracy.

Required Skills

• Proficiency in Databricks, Apache Spark, and PySpark.
• Expertise in SQL and Python.
• Experience with data wrangling and visualization.
• Familiarity with Delta Lake and MLflow.
• Ability to interpret complex datasets and communicate insights.
• Strong analytical and problem-solving skills.

Key Skills

Education

Any Gradute