Description

You design, build, and operate large-scale batch and real-time data pipelines that move, transform, and publish data across the enterprise with high reliability and low latency.

This role is hybrid.

Responsibilities

• Architect and implement end-to-end data solutions, from ingestion and workflow orchestration through event streaming and downstream delivery.
• Build and maintain real-time or event-driven data systems using distributed computing technologies.
• Collaborate with Agile engineering teams to ensure seamless data integration and low-latency publishing.
• Implement secure secrets management and credential handling in production environments.
• Apply data observability practices, including monitoring, alerting, SLA tracking, and data quality frameworks.

Required Skills

• 5+ years of experience building or operating data pipelines and orchestration systems.
• Strong proficiency in Java, Python, and SQL for data or application engineering.
• Experience with distributed data platforms such as Kafka, Spark, EMR, or Hadoop.
• Hands-on experience with cloud-based data warehousing and platforms like AWS, Azure, or GCP.
• 3+ years of experience with pipeline scheduling and workflow orchestration tools.
• 2+ years of experience implementing secure secrets management and credential handling.
• Experience working in Agile engineering environments.

Preferred Skills

• Familiarity with data observability practices, including monitoring, alerting, SLA tracking, and data quality frameworks.
• Experience in financial services or other regulated, compliance-driven industries.

Key Skills

Education

Bachelor's degree