Description

You will build and maintain data pipelines and infrastructure across AWS and Azure environments. Responsibilities Lead development activities and provide technical guidance to support, product delivery, and application management teams. Design and implement cost-efficient architectures and scalable infrastructure. Assemble complex datasets to meet functional and non-functional business requirements. Automate manual processes and optimize data delivery through internal process improvements. Develop analytics tools and data pipelines to provide actionable business insights and support data science teams. Required Skills 5-8 years of experience in data engineering. Proficiency in Python programming. Advanced SQL skills for designing complex queries and optimizing data retrieval. Experience with AWS services including S3, Glue, SNS, SQS, Lambda, Redshift, and RDS. Experience with Azure cloud services. Hands-on experience with Spark, PySpark, Hadoop, Hive, and Spark-SQL. Experience developing Big Data applications using Sqoop, Kafka, and MapReduce. Experience with stream-processing systems such as Spark-Streaming or Storm.

Key Skills

Education

Any Graduate