Description

You will build and maintain data infrastructure using cloud technologies.

Responsibilities

• Develop and manage data pipelines using GCP services like Dataflow and PubSub.
• Implement batch and streaming processing logic using Apache Beam.
• Automate deployments and infrastructure using CI/CD practices and Infrastructure as Code.
• Optimize data workflows for performance and cost efficiency.
• Ensure data governance, security, and observability across data systems.

Required Skills

• 6+ years of professional experience in data engineering.
• Proficiency in GCP services, specifically BigQuery, Dataflow, PubSub, Cloud Composer, Dataplex, and Airflow Composer.
• Strong command of SQL and Python programming.
• Experience with Apache Beam for ETL/ELT pipelines.
• Familiarity with CI/CD tooling, including GitHub Actions.
• Understanding of data security and governance principles.
• Experience with performance tuning and cost optimization in cloud environments.

Key Skills

Education

Any Graduate