Description
You will work as a Data Engineer focusing on AWS EMR environments.
Responsibilities
- Develop and maintain data processing workflows using Spark and PySpark.
- Write and optimize Python scripts for data engineering tasks.
- Automate operational processes through shell scripting.
- Manage data workloads within AWS EMR clusters.
Required Skills
- 5+ years of professional experience in data engineering.
- Proficiency with Spark and PySpark.
- Strong Python programming skills.
- Experience with Shell Scripting.
- Hands-on experience with AWS EMR.
- Bachelor's degree or equivalent graduate qualification.