Description

Build and manage data infrastructure using Databricks, owning the design, development, and maintenance of scalable data pipelines.

This role is on-site.

Responsibilities

• Design and develop scalable data pipelines on Databricks.
• Optimize and troubleshoot existing pipelines for performance.
• Collaborate with data scientists and analysts to meet data requirements.
• Ensure data quality, integrity, security, and compliance.

Required Skills

• 7+ years of experience in data engineering.
• Proficiency with Databricks and Apache Spark.
• Strong SQL skills and experience with relational databases.
• Experience with big data technologies including Hadoop and Kafka.
• Knowledge of Data Warehousing concepts and ETL processes.
• Python programming ability.
• Bachelor's degree.

Preferred Skills

• AWS cloud infrastructure experience.

Key Skills

Education

Bachelor's degree