Description

You will design, develop, and maintain end-to-end data solutions using modern data lake and enterprise data warehouse technologies.

Responsibilities

• Design and maintain scalable data pipelines using Hadoop, Spark, and Cloud technologies.
• Own the data solution lifecycle from conception to launch, ensuring continuous enhancements in an Agile environment.
• Partner with business stakeholders to define, document, and meet data requirements.
• Maintain security compliance in accordance with established policies.

Required Skills

• 8+ years of relevant work experience in data engineering or related fields.
• Hands-on experience with Hadoop, Cloudera, Spark, and Cloud environments.
• Proficiency in Java for object-oriented scripting.
• Experience with Python and other scripting languages.
• Advanced SQL knowledge and experience with relational databases.
• Proficiency with UNIX shell scripts and commands.
• Experience using Git for version control and Jira for issue tracking.

Preferred Skills

• Experience with AWS SageMaker.

Key Skills

Education

BTECH