Description

You will design and implement data engineering, ingestion, and curation functions within a cloud environment.

Responsibilities

• Build Apache Beam and Cloud Dataflow pipelines for both batch and streaming workloads using Java and Python.
• Develop end-to-end data pipelines using Apache Airflow or Cloud Composer.
• Design and implement data warehousing solutions and curation functions.
• Apply SQL standards and implement various data processing scenarios.

Required Skills

• 6-8 years of IT experience.
• Hands-on experience with Google Cloud Platform or other cloud providers.
• Expertise in Core and Advanced Java.
• Practical experience with BigQuery.
• Proficiency in building pipelines with Apache Beam or Cloud Dataflow.
• Experience using Apache Airflow or Cloud Composer.
• Strong understanding of Data Warehousing concepts.
• Solid experience implementing SQL standards.
• Degree in any graduate field.

Preferred Skills

• Experience with Python.

Key Skills

Education

Any Graduate