Description

You will lead data engineering initiatives and manage the development of scalable data pipelines and workflows.

This role is remote.

Responsibilities

• Design and implement scalable pipelines to ingest, process, and store data from various sources into data lake and data warehouse environments.
• Lead data wrangling activities using Databricks, Python, and PySpark to process and transform large datasets.
• Define data architecture standards, best practices, and guidelines to ensure reliability and performance.
• Establish data governance policies to maintain data quality, integrity, and security.
• Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical solutions.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Python and PySpark.
• Hands-on experience with Spark and Databricks.
• Experience working with Snowflake.
• Experience with Kafka.
• Experience using AWS services.
• Ability to communicate technical concepts to non-technical audiences.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Gradute