Description

What's the Job?

• Monitor and ensure the timely completion of existing ETL jobs to maintain data flow integrity.
• Optimize current ETL processes for improved cost efficiency and performance.
• Develop new ETL jobs to ingest and process additional datasets, supporting business growth.
• Investigate and resolve data quality issues, ensuring data accuracy and consistency across platforms.
• Collaborate with the architecture team to standardize pipeline practices and enhance overall data strategy.

What's Needed?

• Strong proficiency in SQL for data manipulation, analysis, and reporting.
• Experience with Python scripting for automation and process improvement.
• Familiarity with Big Data technologies such as Hadoop, EMR, and Spark.
• Hands-on experience with AWS EMR and cloud-based data processing environments.
• Ability to work independently and collaboratively in a fast-paced, evolving environment

Key Skills

Education

Any Graduate