Description
You will manage and scale big data infrastructure within cloud-native environments.
Responsibilities
- Build and maintain EKS clusters at an expert level.
- Deploy and manage Spark workloads on EKS.
- Manage AWS services including EMR, S3, and RDS.
- Integrate Ranger and Hive Metastore service within EKS.
- Administer Hadoop clusters and Airflow instances.
Required Skills
- 9+ years of total professional experience.
- 4 to 5 years of experience in Cloud computing.
- Expert-level proficiency in building EKS clusters.
- Hands-on experience with Spark on EKS.
- Proficiency in AWS (EMR, S3, RDS).
- Strong Python programming skills.
- Experience with Shell scripting.
- Mandatory experience working in a CI/CD environment.
- Experience managing Hadoop clusters and Airflow.
Preferred Skills
- Experience integrating Ranger and Hive Metastore service in EKS.