Description

Key Skill Set:

1. Modern Table Formats: Implementing Apache Iceberg or Delta Lake on top of the object store to enable ACID transactions.
2. Data Modeling: Designing schemas (e.g., Star Schema, Data Vault) that balance flexible ingestion with efficient querying.
3. Distributed Processing: Advanced Apache Spark or Flink proficiency for large-scale transformations on OpenShift.
4. Streaming / Real-time: Managing Kafka for real-time ingestion and event-driven architectures.
5. Orchestration: Building complex workflows using Airflow or OpenShift-native tools like Argo Workflows.
6. Java: Proficiency in Java, including writing APIs to consume data

Key Skills

Education

Bachelor's degree