Description

You will own the design, development, and deployment of large-scale data pipelines.

Responsibilities

• Design, analyze, and code ETL programs covering data pre-processing, extraction, ingestion, quality, normalization, and loading.
• Deliver data engineering projects using Agile methodology and manage tasks in Jira.
• Co-ordinate deliverables across the Software Development Life Cycle (SDLC) in client-facing roles.
• Apply strong database concepts to data modeling and data design requirements.

Required Skills

• 10+ years of experience in Data Engineering and Data Analysis.
• Hands-on expertise with Hadoop Stack: Hadoop, PySpark, HBase, Hive, Pig, Sqoop, Scala, Flume, HDFS.
• Proficiency in Python and Kafka.
• Solid understanding of Data Design, Data Modeling, and ETL processes.
• Experience delivering projects within an Agile Methodology.
• Bachelor’s or Master’s degree in Computer Science or equivalent.

Preferred Skills

• Understanding of Machine Learning Models and Artificial Intelligence.
• Experience with AWS data components, processing, and analytics.

Key Skills

Education

Bachelor’s/Master’s degree