You will build and maintain data processing systems.
Responsibilities
- Develop, debug, and enhance large-scale ETL batch jobs that transform large amounts of data.
- Build utilities and toolkits to speed up engineering tasks and consolidate repetitive manual tasks during data investigations.
- Investigate and debug complex technical problems.
- Track, analyze, and report issues in a timely manner.
Required Skills
- 5+ years of professional experience.
- Proficiency in Python, Java, or Scala.
- Familiarity with Git or a similar version control system.
- Good understanding of data processing concepts and the data engineering process.
- Ability to collaborate closely with a diverse team.
- Proven ability to maintain attention to detail and commit to quality while meeting deadlines.
- Excellent oral and written communication skills in English.
Preferred Skills
- Experience with big data processing frameworks like Spark/Hadoop.
- Familiarity with cloud services (AWS) and workflow management tools (Apache Airflow).