Description

You will lead the design, development, and optimization of scalable data pipelines and ETL workflows.

This role is remote.

Responsibilities

• Design and develop scalable data pipelines and ETL workflows.
• Build data integration solutions for large-scale datasets.
• Ensure the high performance and reliability of data systems.
• Optimize existing data infrastructure for efficiency.
• Collaborate on data architecture decisions.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise with Ab Initio.
• Proficiency in AWS-based data platforms, specifically S3 and Redshift.
• Hands-on experience with Apache Spark for big data processing.
• Experience using Hive for big data processing.
• Strong proficiency in SQL.
• Proficiency in Unix/Linux Scripting.
• Proven experience with ETL processes.

Preferred Skills

• Experience with other cloud data warehousing solutions.
• Familiarity with CI/CD for data pipelines.

Key Skills

Education

Any Gradute