Description

You will design, build, and support ingestion solutions within our GCP-based Data Factory environment. You will own the end-to-end delivery of data pipelines and infrastructure.

Responsibilities

• Design and build end-to-end ingestion solutions and code templates to enable rapid pipeline deployment.
• Develop no/low-code frameworks for developers and operators to ingest enterprise data into the Data Lake.
• Maintain and support in-house components leveraging native GCP services and third-party products like Airflow.
• Manage data transformations to produce consumable datasets for analytics.

Required Skills

• 5+ years of experience in data engineering or software development.
• Java or Kotlin with Spring Boot and REST APIs.
• Google Cloud Platform (GCP) including Cloud Run, Cloud Functions, and Cloud PubSub.
• BigQuery development and operations.
• Terraform for infrastructure development.
• CI/CD implementation using Git and Tekton on Google Cloud.
• Kafka and Cloud PubSub for messaging.
• Database migrations using Liquibase or Flyway.
• Cloud Logging and Monitoring principles.
• Dataflow with streaming knowledge.
• LDAP and Spring Security.

Preferred Skills

• Python and Angular.
• Software quality tools including CheckMarx, Fossa, 42C, and CYCODE.

Key Skills

Education

Bachelor's degree in Computer Science