Description

You will design and maintain scalable data pipelines and ETL processes within an Azure environment.

You will own the integration solutions that consolidate data from multiple sources into a unified platform.

Responsibilities

• Design and develop ETL processes and data architectures using Azure ML and Databricks.
• Analyze solar generation patterns to help field teams identify production anomalies.
• Monitor and troubleshoot workflows to ensure pipeline reliability and performance.
• Collaborate with data scientists and stakeholders to ensure data availability and quality.
• Manage data security, privacy, and regulatory compliance.

Required Skills

• 10+ years of experience in data engineering, data integration, and ETL processes.
• Extensive hands-on experience with Azure ML and Databricks.
• Proficiency in Python, SQL, and Scala.
• Experience with big data technologies including Spark, Hadoop, and Kafka.
• Strong understanding of data engineering principles and best practices.
• Bachelor's degree in Computer Science, Data Engineering, or a related field.

Key Skills

Education

Bachelor's Degree