Description

You will design, build, and maintain scalable ETL/ELT pipelines for ingesting and transforming structured and unstructured data.

Responsibilities

• Develop and optimize data models, data warehouses, and data lakes for analytics.
• Implement and maintain data quality checks, governance, and metadata management.
• Integrate data from various sources like databases, APIs, and flat files.
• Monitor and troubleshoot data workflows, resolving pipeline failures.
• Document system architecture, data flows, and transformation logic.

Required Skills

• 5+ years of experience in a data engineering or related technical role.
• Proficiency in SQL and experience with Python, Scala, or Java.
• Hands-on experience with Etl/elt Pipelines.
• Experience utilizing cloud platforms: Aws, Azure, or Google Cloud Platform.
• Familiarity with Apache Spark, Airflow, and data warehousing concepts.
• Understanding of data modeling (relational and dimensional).
• Experience with Git and CI/CD practices for data.

Key Skills

Education

Any Graduate