Description

You will design, implement, and maintain end-to-end ETL data pipelines in distributed environments.

Responsibilities

• Build scalable, performance-oriented data pipelines from scratch.
• Write and optimize complex SQL queries for extraction, transformation, and reporting.
• Utilize GCP services for data processing and storage.
• Document pipelines, procedures, and best practices.
• Collaborate with analysts and data scientists to provide structured data.

Required Skills

• 4+ years of professional experience.
• 3+ years of experience with SQL and Python.
• 1+ years of experience with GCP BigQuery, Dataflow, and GCS.
• 2+ years of experience building fault-tolerant data pipelines in distributed systems.
• Experience with Postgres and CloudSQL.
• Proficiency with Cloud Functions, Pub/Sub, and Cloud Composer.
• Experience building applications in Cloud and traditional Data Warehouse environments.
• Working knowledge of relational and non-relational databases.

Preferred Skills

• Familiarity with Apache Spark, Hadoop, and Kafka.
• Experience with big data and machine learning tools and platforms.

Key Skills

Education

Any Graduate