Description

You will design, develop, and maintain scalable data solutions and big data pipelines.

This role is on-site.

Responsibilities

• Design and maintain enterprise-level data pipelines ensuring performance and security.
• Optimize big data ecosystems for reliability and throughput.
• Implement ETL processes and data modeling strategies for data platforms.
• Tune Spark jobs and manage memory for efficient data processing.

Required Skills

• 12+ years of IT experience in data engineering or big data development.
• 3+ years of hands-on experience with Databricks and PySpark.
• Proficiency in Python, including Data Structures, OOP, Pandas, and NumPy.
• Expertise in Spark SQL, Delta Lake, and data lakehouse architectures.
• Experience with Azure cloud platforms.
• Proficiency in SQL and relational database systems.
• Knowledge of ETL concepts, data modeling, and data warehousing principles.
• Understanding of data governance and security frameworks.

Key Skills

Education

Any Graduate