Description

You will act as a subject matter expert advising on Azure and GCP technology implementations.

Responsibilities

• Develop and deploy data pipelines within GCP and Azure environments.
• Build frameworks for data ingestion, processing, and consumption using GCP Dataflow, GCP Data Composer, and BigQuery.
• Create real-time pipelines utilizing Kafka and Pub/Sub.
• Implement high-quality data pipelines with integrated monitoring and observability.
• Develop dashboards and reports using PowerBI and/or ThoughtSpot.

Required Skills

• 7+ years of experience developing and deploying data pipelines in GCP or Azure.
• At least 7 years in one cloud platform and 2-3 years in the other.
• 5+ years of experience with Snowflake, BigQuery, or Databricks.
• 5+ years of experience building data frameworks using GCP Dataflow, GCP Data Composer, and BigQuery.
• 4+ years of experience with SQL, Python, Java, and API development.
• 2+ years of expertise in real-time pipelines using Kafka and Pub/Sub.
• 2+ years of experience building dashboards with PowerBI and/or ThoughtSpot.
• GCP Professional Architect or GCP Data Engineer certification.
• Bachelor’s or Master’s in computer engineering, computer science, or a related field.

Preferred Skills

• Experience with data transformations for retail and e-commerce use cases.
• Knowledge of GitHub Actions for CI/CD.
• Knowledge of building machine learning models.

Key Skills

Education

Bachelor’s or Master’s in computer engineering, computer science