Description
You will design, develop, and maintain data pipelines and systems within an AWS cloud environment.
Responsibilities
- Develop data processing scripts and complex SQL queries to manage large datasets.
- Perform system analysis and software testing using SQL, JIRA, and other diagnostic tools.
- Document technical requirements, system analysis, and test results for business decision-making.
- Automate testing processes and manage deployment workflows using DevOps tools.
- Gather and present technical information to explain complex concepts to stakeholders.
Required Skills
- 9+ years of professional experience in data engineering or related roles.
- Strong Python development skills, specifically with Pandas, NumPy, and PySpark.
- Expertise in writing and optimizing complex SQL queries.
- Hands-on experience with AWS services including S3, RDS, EC2, Lambda, SQS, SNS, and Redshift.
- Proficiency with DevOps tools such as Jenkins, Bitbucket, GitLab, and Terraform.
- Experience with system analysis and development within Salesforce and AWS Cloud.
- Ability to use MS Office for reporting and documentation.
- Strong technical communication skills for presenting ideas and answering critical questions.