Description

You will build and maintain end-to-end data pipelines to support large-scale data extraction and transformation.

Responsibilities

• Design, develop, and implement end-to-end data pipelines for efficient extraction and transformation.
• Manage complex workflows using Airflow to handle large volumes of data.
• Write complex SQL queries and optimize database performance for data retrieval.
• Collaborate with infrastructure teams to ensure data platform health and scalability.
• Proactively recommend and implement solutions to improve pipeline efficiency and effectiveness.

Required Skills

• 6+ years of professional experience in data engineering.
• Strong proficiency in SQL and database performance optimization.
• Hands-on experience with GCP and BigQuery.
• Experience with Spark and Kafka.
• Proficiency in Airflow for workflow management.
• Experience with Data Proc.
• Working knowledge of Java or Scala.
• Solid understanding of data structures, data storage, and data security.
• Any Graduate degree.

Key Skills

Education

Any Graduate