Description

You will build and manage scalable data pipelines to ingest and process marketing data from various platforms.

Responsibilities

• Develop and maintain data pipelines to collect and process data from paid media, CDP, and marketing automation platforms.
• Process large volumes of structured and unstructured data using PySpark.
• Build and automate complex workflows using Airflow DAGs.
• Write code to consume real-time APIs and integrate data into BigQuery.
• Optimize existing pipeline architectures for efficiency and performance while ensuring compliance with privacy regulations and security policies.

Required Skills

• 5+ years of experience in data engineering or analytics engineering.
• Strong proficiency in Python3.
• Hands-on experience with PySpark for large-scale data processing.
• Expertise in Google Cloud Platform, including BigQuery, Google Storage, and Compute Engine.
• Experience with Apache Airflow for workflow management.
• Proficiency with Kubernetes, containerization, and networking.
• Proven experience designing and implementing ETL processes.
• Solid understanding of data warehousing principles.
• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science