Description

Lead the development, validation, and migration of Big Data products within Hadoop and Teradata clusters.

This role is hybrid.

Responsibilities

• Design, develop, and test data ingestion pipelines and end-to-end ETL processes.
• Develop validation frameworks and automated test suites to ensure data integrity and transformation accuracy.
• Perform data migration and conversion validation across applications and platforms.
• Provide technical leadership for data profiling, analysis, and identification of data quality issues.
• Collaborate with architects and product managers to establish physical application frameworks, libraries, and modules.

Required Skills

• 15+ years of experience in the Data Domain with a Data Architecture background.
• 10+ years of software development and testing experience.
• Expertise in Spark, Scala, and SQL within Hadoop environments.
• Proven experience developing and testing ETL and real-time data-processing systems.
• Experience with CI/CD environments and automated framework development.
• Bachelor's degree in Computer Science or Engineering.

Preferred Skills

• Experience with Google Cloud Platform (GCP).
• Experience developing tools and utilities for monitoring and alerting.
• Familiarity with JIRA or similar project management and bug tracking tools.

Key Skills

Education

Bachelor's degree