Description

Build and maintain data pipelines and infrastructure to support large-scale data processing.

Responsibilities

• Design and implement ETL processes, data integration, and data modeling.
• Develop data pipelines using big data and streaming technologies.
• Manage data warehousing concepts and database systems.
• Collaborate with teams to solve complex analytical and data-driven problems.

Required Skills

• 5+ years of experience as a Data Engineer or in a similar role.
• Proficiency in Python, Java, or Scala.
• Strong SQL skills for data manipulation and querying.
• Experience with Hadoop and Spark.
• Knowledge of data streaming technologies such as Apache Kafka or Apache Flink.
• Experience with data integration tools like Apache NiFi, Talend, or Apache Beam.
• Familiarity with Docker and Kubernetes.
• Experience with Git version control.
• Knowledge of cloud platforms including AWS, Azure, or Google Cloud.
• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Relevant certifications in data engineering or cloud platforms.

Key Skills

Education

Bachelor’s or Master’s degree