Description

You will build and maintain large-scale data pipelines for ingestion, integration, and processing.

This role is on-site.

Responsibilities

• Design and manage data ingestion pipelines using Apache NiFi.
• Process big data workloads using Apache Spark and Hadoop.
• Develop data processing applications with strong proficiency in Python.
• Implement data quality automation and integrate with CI/CD processes.

Required Skills

• 5+ years of Data Engineering experience.
• Bachelor's or Master's degree in Computer Science or related field.
• Expertise with Python for building data applications.
• Hands-on experience with Apache Spark and Hadoop.
• Solid proficiency in writing complex SQL queries.
• Experience with Databricks on AWS or Azure.
• Familiarity with data quality concepts and validation techniques.
• Understanding of CI/CD practices and Jenkins.

Key Skills

Education

Bachelor's or Master's degrees