Description

Design, build, and maintain scalable ETL/ELT pipelines and data workflows to support enterprise analytics and AI/ML initiatives.

This role is on-site.

Responsibilities

• Develop and optimize data workflows within the Databricks architecture, including Delta Lake, Spark, notebooks, jobs, and clusters.
• Prepare high-quality datasets for model training, validation, and deployment to support AI/ML initiatives.
• Create and maintain BI dashboards and reports using Power BI, Tableau, and Looker.
• Implement data quality, governance, and performance optimization best practices for data and analytics platforms.
• Troubleshoot production issues and provide ongoing support while collaborating with data scientists and analytics teams.

Required Skills

• 9+ years of relevant industry experience in Data Engineering or Software Development.
• Strong programming experience with Python.
• Deep understanding of Databricks architecture and Apache Spark.
• Hands-on experience with Delta Lake, Spark SQL, and distributed data processing.
• Experience building enterprise-scale data pipelines and integrating data from multiple enterprise systems and APIs.
• Strong knowledge of data warehousing and dimensional modeling.
• Experience with Power BI, Tableau, or Looker for BI dashboard creation.
• Bachelor’s degree in Technology, Computer Science, Engineering, or a related field.

Preferred Skills

• Experience working in an Agile/Scrum environment, including sprint planning and code reviews.
• Background in AI/ML data preparation and feature engineering.

Key Skills

Education

Bachelor's degree