Description

Build and maintain scalable data pipelines and architecture to support business analytics.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines to move data from various sources into the data warehouse.
• Collaborate with architects to optimize data models, database structures, and data lake management.
• Integrate third-party APIs and data sources while implementing monitoring and exception management processes.
• Optimize pipeline and query performance to ensure data integrity and reliability.
• Implement data security controls, encryption, and compliance measures for GDPR and HIPAA.

Required Skills

• 5+ years of experience in data engineering or a similar role.
• Proficiency in Python, Java, or Scala.
• Strong experience with ETL processes and data modeling.
• Hands-on experience with Azure ADF and Snowflake.
• Expertise in SQL and working with relational and NoSQL databases.
• Experience with data pipeline orchestration tools.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Master's degree in a related technical field.
• Relevant data engineering certifications.

Key Skills

Education

Bachelor's degree in Computer Science, Information Technology