Description

You will design, build, and deploy data pipelines within Teradata and Hadoop environments.

This role is on-site.

Responsibilities

• Build and test data pipelines using HDFS, Hive, Spark, and Kafka.
• Develop real-time data-processing and analytics application systems.
• Automate pipelines and testing within a CI/CD environment using GIT and Jenkins.
• Develop and test Web Services and APIs.
• Apply methodical problem-solving to Big Data and AI domain challenges.

Required Skills

• 4+ years of experience in data pipeline design and deployment.
• Proficiency in Scala, Java, or Python.
• Hands-on experience with HDFS, Hive, Spark, HBase, Kafka, and Oozie.
• Strong SQL development skills for Database and BI/DW.
• Experience with Google Cloud and BigQuery.
• Expertise in shell scripting and pipeline automation.
• Working knowledge of GIT and Jenkins.
• Solid understanding of common software development practices and tools.

Key Skills

Education

Any Graduate