Description

You will build and manage data pipelines within the Google Cloud Platform ecosystem.

Responsibilities

• Develop and maintain ETL processes to support data warehousing requirements.
• Implement real-time data processing and streaming analytics solutions.
• Build batch and stream data processing pipelines.
• Manage data ingestion and messaging through Pub/Sub.
• Execute data manipulation and analysis using Python and SQL.

Required Skills

• 5+ years of experience as a Data Engineer.
• 5+ years of hands-on experience with GCP services.
• Strong proficiency in BigQuery.
• Advanced Python skills for data engineering tasks.
• Expert-level SQL for data manipulation.
• Experience with Pub/Sub.
• At least 8 months of experience with Dataflow and Apache Beam for batch and stream processing.
• Solid understanding of data warehousing concepts.
• Bachelor's degree or equivalent graduate level education.

Preferred Skills

• Experience with distributed computing frameworks beyond Apache Beam.
• Knowledge of CI/CD pipelines for data engineering workflows.

Key Skills

Education

Any Gradute