Description

You will design, develop, and maintain scalable data pipelines and infrastructure to enable efficient data collection, storage, and analysis.

Responsibilities

• Design and implement ETL pipelines to move data from various sources into data warehouses or lakes.
• Develop and optimize data models and schemas to support reporting and analysis requirements.
• Write and optimize complex SQL queries for data extraction and transformation.
• Contribute to data architecture design and strategic decisions regarding data storage and processing.
• Ensure data security and compliance with internal governance policies and industry regulations.

Required Skills

• 8+ years of experience in data engineering.
• Proficiency in Python and PySpark.
• Strong expertise in SQL for complex data manipulation.
• Hands-on experience with ETL processes and pipeline development.
• Hands-on experience with Google Cloud Platform (GCP).
• Experience working with AWS.
• Familiarity with Hadoop ecosystems.
• Any Graduate degree.

Key Skills

Education

Any Graduate