Description
You will build and maintain data pipelines to support complex business and analytics requirements.
Responsibilities
- Design and implement data pipelines in collaboration with data users and engineering teams.
- Ensure the reliability, data quality, and performance of all data assets.
- Deliver high-quality, maintainable code focused on simplicity and performance.
- Redesign existing pipelines to leverage modern technologies and best practices.
- Work with solution engineers, data scientists, and product owners to deliver end-to-end products.
Required Skills
- 4-15 years of experience in software or data engineering.
- Proficiency in Python.
- Expertise in PySpark and distributed computing frameworks.
- Strong understanding of data modeling and data architecture concepts.
- Familiarity with system design, data structures, algorithms, and storage systems.
- Experience with cloud infrastructure and CI/CD processes.
- Experience with data testing and monitoring.
- Any Graduate degree.
Preferred Skills
- Experience with Palantir Foundry.
- Knowledge of advanced analytics, Machine Learning, or Statistics.
- Experience with data visualization and TypeScript.