Description

You will build end-to-end data pipelines and harmonization components to enable insight generation for executive decision-making.

Responsibilities

• Build end-to-end data pipelines and harmonization components to enable proactive business action.
• Design, develop, and implement software based on specific business requirements.
• Identify valuable data sources and automate collection processes for structured and unstructured data.
• Troubleshoot production issues and coordinate with support teams for code deployment.
• Collaborate with infrastructure, network, database, and BI teams to ensure data quality and availability.

Required Skills

• 5+ years of professional experience in data engineering or related roles.
• Expertise with Teradata and Teradata Utilities (BTEQ, MLoad, TPump, QG, Fast Export).
• Strong proficiency in SQL and UNIX environments.
• 1-2 years of hands-on experience with Hive, Spark, HSQL, and Oozie.
• Experience designing infrastructure for data extraction, preparation, and loading from various sources.
• Ability to analyze large datasets to identify trends, patterns, and anomalies.
• Experience building analytics tools to monitor pipeline performance and KPIs.
• Knowledge of Jenkins, Jira, and Git.
• Proven troubleshooting skills regarding system capacity, bottlenecks, and data anomalies.

Preferred Skills

• Experience with advanced statistical or mathematical approaches for prediction and optimization.
• Ability to model and interpret complex data sets.

Key Skills

Education

Any Graduate