Description

You will build and manage data infrastructure using Databricks.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Databricks.
• Collaborate with data scientists and analysts to meet data requirements.
• Optimize and troubleshoot existing data pipelines for performance.
• Ensure data quality and integrity across all data sources.
• Implement data security and compliance practices.

Required Skills

• 7+ years of experience in data engineering.
• Proficiency with Databricks and Apache Spark.
• Strong SQL skills and experience with relational databases.
• Experience with big data technologies including Hadoop and Kafka.
• Knowledge of Data Warehousing concepts and ETL processes.
• Python programming ability.

Key Skills

Education

Bachelor's degree