Description

Design and implement cloud architectures and data processing pipelines on AWS.

Responsibilities

• Design cloud architectures using AWS services including S3, SQS/SNS, Kinesis, Lambda, and EC2.
• Develop data science and analytics solutions using Python, Java, and Scala.
• Manage data processing workflows with Apache NiFi, Cribl, and Apache Airflow.
• Administer Kubernetes environments and MLOps pipelines using Kubeflow and Nvidia Morpheus.
• Build and maintain streaming data pipelines using SparkStreaming.

Required Skills

• 5+ years of overall professional experience.
• 3+ years of experience in AWS cloud architecture and design.
• Proficiency in Python, Java, and Scala.
• Experience with AWS Glue, Athena, Redshift, EMR, and SageMaker.
• Hands-on experience with S3, SQS/SNS, Kinesis, and Lambda.
• Knowledge of EKS, ECR, and ECS.
• Experience with container orchestration using Kubernetes.
• Data processing expertise using Apache NiFi, Cribl, and Apache Airflow.
• Familiarity with Linux administration.

Key Skills

Education

Any Graduate