Description

You own the design and implementation of data and cloud infrastructure solutions.

Responsibilities

• Build and maintain ETL pipelines leveraging Apache Spark.
• Develop and deploy cloud-native applications on AWS.
• Manage data platforms and pipelines within AWS environments.
• Implement monitoring and alerting solutions using the ELK Stack and AWS services.

Required Skills

• Minimum 15+ years of in-depth experience developing and implementing AWS Data Pipelines.
• Strong hands-on experience with ETL pipelines using Apache Spark.
• Proficiency in Python and/or Scala.
• Expertise with core AWS services including S3, DynamoDB, Kinesis, Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, VPC, EC2, RDS, IAM.
• Experience integrating Kafka into data workflows.
• Familiarity with the full ELK Stack (Elasticsearch, Logstash, Kibana, Beat agents) and REST API integration.
• Knowledge of CI/CD practices and application development lifecycle.
• Bachelor’s degree in a related field.

Key Skills

Education

Bachelor’s degree