Description

You will design and maintain data platforms and pipelines on AWS, ensuring scalable and reliable data processing. You will manage data infrastructure including Snowflake and Dremio, while implementing CI/CD practices for cloud-native applications.

This role is on-site.

Responsibilities

• Build and optimize data pipelines using Apache Spark, PySpark, and AWS Glue/EMR.
• Administer Snowflake and Dremio environments for enterprise data needs.
• Develop cloud-native applications and manage AWS services such as Lambda, Step Functions, S3, DynamoDB, and Kinesis.
• Implement continuous integration and deployment practices for data platforms.
• Monitor system health and performance using CloudTrail, CloudWatch, SNS, and SQS.

Required Skills

• 7+ years of hands-on experience in AWS data pipeline development and implementation.
• Strong proficiency in Python and/or Scala programming languages.
• Deep experience with AWS services: EC2, VPC, RDS, IAM, S3, Lambda, EMR, Glue, Step Functions, CloudTrail, CloudWatch, SNS, SQS.
• Experience with Snowflake and Dremio administration.
• Proficiency in building data platforms using Apache Spark and PySpark.
• Knowledge of application development lifecycles and CI/CD practices.
• Bachelor’s degree in a related field.

Preferred Skills

• AWS Associate or Professional level certifications.
• Experience with Agile Software Development methodologies.

Key Skills

Education

Bachelor's degree