Description

Design, develop, and maintain end-to-end data solutions using open-source, modern data lake, and enterprise data warehouse technologies. You will contribute to the entire data solution lifecycle from conception to launch while partnering with business stakeholders to define and meet data requirements.

Responsibilities

• Design and maintain scalable data pipelines using Hadoop, Spark, and Cloud technologies.
• Partner with business stakeholders to define and meet data requirements.
• Maintain security compliance in accordance with established policies.
• Participate in an Agile development environment to deliver continuous enhancements.
• Conduct code reviews and document solution designs.

Required Skills

• 8+ years of professional experience in data engineering.
• Hands-on experience with Hadoop, Cloudera, Spark, and Cloud environments.
• Proficiency in Java and Python.
• Advanced SQL knowledge and experience with relational databases.
• Proficiency with UNIX shell scripts and commands.
• Experience using Git for version control and Jira for issue tracking.
• Bachelor's degree in Computer Science, Engineering, or Information Management.

Preferred Skills

• Experience with AWS SageMaker.

Key Skills

Education

BTECH