Description
Build and maintain infrastructure to enable big data access and analysis.
Responsibilities
- Design and generate infrastructure for big data access and analysis.
- Reformulate existing frameworks to optimize system performance.
- Prepare and clean raw data for use by data scientists.
- Test data structures to ensure functional integrity.
- Liaise with coworkers and clients to define technical requirements.
Required Skills
- 5+ years of experience as a data engineer, software developer, or similar role.
- Expert proficiency in Python, C++, Java, R, and SQL.
- Familiarity with Hadoop or equivalent big data technologies.
- Bachelor's degree in data engineering, big data analytics, computer engineering, or a related field.
- Strong analytical and problem-solving abilities.
- Ability to manage a pipeline of duties with minimal supervision.
- Proven ability to work both independently and within a team.
Preferred Skills
- Master's degree in a relevant field.