Description

Build and manage big data processing solutions on Google Cloud Platform, focusing on large-scale ingestion, transformation, and workflow orchestration.

Responsibilities

• Design and develop scalable data pipelines using GCP services including BigQuery, Dataflow, Dataproc, and Cloud Storage.
• Orchestrate and schedule data workflows using Apache Airflow to ensure reliable end-to-end data flow.
• Implement CI/CD practices to automate deployment and release processes for data engineering solutions.
• Monitor pipeline health, troubleshoot issues, and optimize data processing for performance and stability.
• Collaborate with stakeholders to translate business requirements into technical data models and designs.

Required Skills

• 5+ years of experience building big data solutions on GCP.
• Hands-on expertise with BigQuery, Dataflow, Dataproc, and Cloud Storage.
• Proficiency in Apache Airflow for workflow orchestration and scheduling.
• Experience with CI/CD tools and practices for automated deployments.
• Strong understanding of distributed data processing frameworks and big data technologies.
• Knowledge of data modeling, warehousing, and lifecycle management concepts.
• Ability to handle structured and unstructured data across diverse sources.
• Familiarity with GCP data security, governance, and access control.

Preferred Skills

• Experience with data security and governance within GCP environments.
• Strong analytical and problem-solving skills for complex data challenges.

Key Skills

Education

Any Graduate