Description

You will design and maintain data pipelines and systems within an AWS cloud environment. You own the full lifecycle from infrastructure setup to data processing logic and system analysis.

Responsibilities

• Develop data processing logic using Python, Pandas, NumPy, and PySpark.
• Build and manage cloud infrastructure using AWS services including S3, RDS, EC2, Lambda, SQS, SNS, and Redshift.
• Write and optimize complex SQL queries for system analysis and data retrieval.
• Perform system analysis and software testing using SQL and Jira.
• Document technical requirements, system analysis, and testing results.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Strong Python development expertise with Pandas, NumPy, and PySpark.
• Proficiency in SQL and database management.
• Hands-on experience with AWS services (S3, RDS, EC2, Lambda, SQS, SNS, Redshift).
• Experience with DevOps tools including Jenkins, Bitbucket, GitLab, and Terraform.
• Competency in software testing and automation.
• Experience with Jira for task tracking and system analysis.

Preferred Skills

• AWS Cloud certification.
• Experience with Salesforce system analysis and development.

Key Skills

Education

Any Graduate