Description

You will own the design, build, and maintenance of the on-premises data orchestration platform.

Responsibilities

• Design, build, and maintain the on-premises data orchestration platform using open source tools.
• Implement self-service capabilities for teams to build and deploy data pipelines.
• Implement data quality testing frameworks to ensure data integrity across the data lifecycle.
• Establish data engineering best practices, including CI/CD for data pipelines and automated testing.
• Collaborate with ML/AI teams to build scalable feature engineering pipelines for batch and real-time processing.

Required Skills

• 7+ years of professional experience in data engineering.
• 5+ years experience in data engineering, with 2+ years on enterprise-scale data platforms.
• Demonstrated experience orchestrating workflows, performance optimization, and operational management.
• Strong understanding of data transformation techniques, testing frameworks, and deployment strategies.
• Experience with stream processing frameworks and technologies.
• Proficiency with SQL and Python for data transformation and pipeline development.
• Familiarity with containerized application deployment.
• Experience implementing data quality frameworks and automated testing for data pipelines.
• Ability to work cross-functionally with data scientists, ML engineers, and business stakeholders.

Preferred Skills

• Experience with self-hosted data orchestration platforms.
• Background in implementing data contracts or schema governance.

Key Skills

Education

Any Graduate