Description

You will build and maintain scalable data infrastructure and end-to-end processing pipelines.

This role is on-site.

Responsibilities

• Design, develop, and implement end-to-end data pipelines for efficient extraction and transformation.
• Manage workflows using Airflow to handle large volumes of data.
• Write complex SQL queries and optimize database performance for data retrieval.
• Collaborate with infrastructure teams to ensure data platform health and scalability.
• Proactively recommend solutions to improve pipeline efficiency and effectiveness.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in SQL and BigQuery.
• Experience with GCP, including Data Proc.
• Hands-on experience with Spark and Kafka.
• Experience with Airflow for workflow management.
• Proficiency in Java or Scala.
• Strong knowledge of data storage, structures, processing, and security.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate