Description

Design and develop scalable Big Data solutions on Google Cloud Platform, owning the full lifecycle of data pipelines from ingestion to analysis.

Responsibilities

• Build and optimize data pipelines using Google Cloud Dataflow and Apache Beam.
• Develop batch and real-time data processing workflows in Java or Python.
• Integrate structured and unstructured data from multiple sources.
• Implement data quality checks, monitoring, and logging frameworks.
• Troubleshoot performance bottlenecks and ensure cost efficiency in GCP.

Required Skills

• 8+ years of experience in Big Data development.
• Strong hands-on experience with GCP Cloud Dataflow and Apache Beam.
• Proficiency in BigQuery and Cloud Storage.
• Experience with Pub/Sub for streaming data.
• Strong programming skills in Java or Python.
• Experience with Apache Spark, Hadoop, or Hive.
• Proven track record building ETL/ELT pipelines.
• Knowledge of SQL and NoSQL databases.
• Familiarity with CI/CD pipelines and DevOps practices.

Preferred Skills

• GCP Professional Data Engineer certification.
• Experience with Kubernetes and containerization.
• Knowledge of Airflow or other workflow orchestration tools.

Key Skills

Education

Any Gradute