Description

You will design and implement complex data transformation pipelines and manage data warehousing frameworks.

This role is on-site.

Responsibilities

• Develop ETL/ELT processes to transform complex datasets across distributed systems.
• Build scalable data pipelines using Spark and streaming technologies.
• Execute data lifecycle processes to ensure data integrity and availability.
• Manage data warehousing and data management frameworks.

Required Skills

• 5+ years of experience in data engineering roles.
• Hands-on experience with Azure and AWS Big Data solutions.
• Proficiency with Hadoop, Hive, HBase, and Sqoop.
• Strong experience with Spark and Spark Streaming.
• Solid programming skills in Python, Scala, and Java.
• Experience with PLSQL and Shell scripting.

Preferred Skills

• Experience using Azure Databricks for ETL/ELT development.
• Knowledge of R programming for data tasks.

Key Skills

Education

Any Graduate