Description

You will design, build, and maintain data pipelines and infrastructure across AWS and Azure environments.

This role is on-site.

Responsibilities

• Lead development activities and provide technical guidance to delivery teams.
• Design and implement internal process improvements, including automating manual processes.
• Assemble large, complex data sets to meet functional and non-functional business requirements.
• Build analytics tools and data pipelines to provide actionable insights into business performance.
• Collaborate with product managers and stakeholders to support data infrastructure needs.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python programming.
• Hands-on experience with AWS services: S3, Glue, SNS, SQS, Lambda, Redshift, and RDS.
• Experience with Azure cloud services and Big Data application development.
• Strong expertise in designing complex SQL queries and optimizing data fetch.
• Experience with Spark, PySpark, Hadoop, Hive, and Spark-SQL.
• Knowledge of Sqoop, Kafka, MapReduce, and stream-processing systems like Spark-Streaming or Storm.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate