Description

You will build and maintain data pipelines using cloud-native services.

Responsibilities

• Develop and optimize data ingestion and transformation processes.
• Manage and monitor data flows using streaming and batch technologies.
• Deploy and manage data infrastructure components in AWS environments.
• Automate deployment and operational tasks using CI/CD practices.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise in AWS Data Engineering services.
• Strong command of PySpark for large-scale data processing.
• Experience with AWS Glue and Amazon Redshift.
• Proficiency with streaming technologies like Kinesis and Kafka.
• Hands-on experience with containerization using Docker and Kubernetes.
• Familiarity with CI/CD tools such as GitHub Actions or Jenkins.

Key Skills

Education

Any Graduate