Description

You will build and maintain scalable data pipelines and ETL workflows for an enterprise lake house platform.

Responsibilities

• Design and implement data ingestion, transformation, and integration using big data technologies.
• Manage and optimize data storage systems, including data lakes and warehouses on cloud platforms.
• Collaborate with data scientists and analysts to gather requirements and deliver data solutions.
• Ensure data quality and consistency through validation and monitoring practices.
• Diagnose performance inefficiencies and document data workflows and system architecture.

Required Skills

• 5+ years of experience as a Data Engineer.
• Proficiency in Python, Java, or Scala.
• Hands-on experience with Spark, Hadoop, and Kafka.
• Experience managing cloud platforms such as AWS, Azure, or Google Cloud.
• Strong understanding of data lake and data warehouse architectures.
• Familiarity with data governance and security best practices.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.

Key Skills

Education

Bachelor’s degree in computer science, Information Technology