Description

You will build and maintain data pipelines and infrastructure across AWS and Azure environments, providing technical guidance to support and product teams.

This role is on-site.

Responsibilities

• Design and implement cost-efficient, scalable architectures for data infrastructure.
• Assemble complex datasets to meet functional and non-functional business requirements.
• Develop analytics tools and data pipelines to provide actionable business insights.
• Automate manual processes and optimize data delivery through internal improvements.
• Support data science teams by delivering reliable data structures.

Required Skills

• 5-8 years of experience in data engineering.
• Proficiency in Python programming.
• Advanced SQL skills for designing complex queries and optimizing data retrieval.
• Experience with AWS services including S3, Glue, SNS, SQS, Lambda, Redshift, and RDS.
• Experience with Azure cloud services.
• Hands-on experience with Spark, PySpark, Hadoop, Hive, and Spark-SQL.
• Experience developing Big Data applications using Sqoop, Kafka, and MapReduce.
• Experience with stream-processing systems such as Spark-Streaming or Storm.

Key Skills

Education

Any Graduate