Description

You will design, develop, and maintain scalable data processing applications using Databricks, Python, and PySpark.

This role is hybrid.

Responsibilities

• Develop and maintain data processing applications using Python and PySpark/Spark.
• Collaborate with data engineers and data scientists to meet business requirements.
• Ensure data integrity and performance across all data processing pipelines.
• Write clean, maintainable code following established coding standards.
• Monitor and troubleshoot performance issues within data workflows.

Required Skills

• 12+ years of proven experience as a Databricks Developer.
• Strong programming expertise in Python and PySpark.
• Proficiency in SQL and hands-on experience with relational databases.
• Experience utilizing CI/CD pipelines for automated deployment.
• Familiarity with version control systems, specifically Git.
• Strong analytical and problem-solving capabilities.
• Bachelor's or Master's degree.

Preferred Skills

• Experience with cloud platforms including AWS, Azure, or GCP.
• Exposure to data orchestration tools like Airflow.

Key Skills

Education

Bachelor's or Master's degrees