Description
You will design, develop, and maintain data pipelines to ingest, store, and process data from multiple sources.
Responsibilities
- Design and develop data pipelines to manage data from diverse sources.
- Produce architecture and design artifacts for complex applications while ensuring design constraints are met.
- Develop secure, high-quality production code and perform code reviews and debugging.
- Automate remediation of recurring issues to improve operational stability.
- Build visualizations and reporting from large datasets to monitor data quality and integrity.
Required Skills
- 3+ years of applied experience in data engineering.
- Proficiency in Python or Java.
- Hands-on experience delivering data pipelines.
- Experience with SQL-based technologies such as MySQL or Oracle DB.
- Practical experience with cloud-native distributed systems.
- Understanding of the full Software Development Life Cycle (SDLC).
- Knowledge of agile methodologies including CI/CD and Application Resiliency.
- Experience with statistical data analysis and identifying data patterns.
- Working knowledge of Bitbucket and JIRA.