Description
You will build and operate real-time streaming pipelines and lakehouse architectures for large-scale data platforms.
This role is on-site.
Responsibilities
- Build and operate real-time streaming pipelines using Apache Flink.
- Design and manage Lakehouse architectures with Apache Iceberg.
- Enable federated analytics using Starburst Trino and optimize ETL pipelines.
- Integrate data platforms with AWS, Azure, and GCP services while ensuring data quality and governance.
- Tune performance across pipelines, tables, and queries, and mentor junior engineers.
Required Skills
- 7+ years of experience in data engineering and large-scale data platforms.
- Strong hands-on experience with Apache Flink, Iceberg, and Trino.
- Proficiency in Python, Scala, or Java with strong SQL skills.
- Experience with cloud data services and distributed systems.
- Knowledge of Kafka, Docker, Kubernetes, and data warehousing concepts.
Preferred Skills
- Financial services experience.
- Cloud certifications.
- Exposure to Delta Lake, Hudi, and Airflow.