Description

You will lead data analysis and engineering efforts using Python and SQL, managing large-scale data engagements across AWS.

This role is hybrid.

Responsibilities

• Automate data workflows including ingestion, aggregation, and ETL processing.
• Design and engineer solutions across various AWS services for large data engagements.
• Implement data ingestion from diverse sources like file-based systems and API-based streaming data.
• Manage data pipelines using tools like Kafka and AWS Glue.

Required Skills

• 5+ years of hands-on experience with Python and SQL.
• Proficiency with PySpark and Scala.
• Experience scripting using Shell Scripting.
• Strong knowledge of AWS services, including S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, and Kinesis.
• Familiarity with DevOps pipelines using Jenkins, Bitbucket, and EKS.
• Experience with streaming data sources (OLTP, OLAP, ODS) and heterogeneous databases.
• Working knowledge of Kafka.

Key Skills

Education

Any Graduate