Description

You will build and deploy data pipelines within an AWS cloud environment, owning the full lifecycle from code development to monitoring.

Responsibilities

• Develop and deploy application code using SQL, Python, and Spark.
• Build and manage scalable data pipelines in the cloud.
• Secure data access using IAM and Active Directory.
• Implement monitoring and logging using CloudWatch and Splunk.
• Write Linux and UNIX shell scripts to automate data processes.

Required Skills

• 3-5 years of experience with AWS services: Glue, Athena, Lambda, Secrets Manager, Redshift, Redshift Spectrum, and Step Functions.
• Proficiency in Python, PySpark, and SQL.
• Hands-on experience with S3, EC2, Boto3, and PostgreSQL.
• Experience with CloudFormation for infrastructure as code.
• Background in Big Data or warehouse environments such as Hadoop or DB2 LUW.
• Experience with version control and CI/CD tools including Bitbucket, Jenkins, and Artifactory.
• Knowledge of Agile methodologies.

Preferred Skills

• AWS Cloud Practitioner or other AWS certifications.
• Experience in the financial services industry.

Key Skills

Education

Any Graduate