Description

You will build and maintain data pipelines to support complex business and analytics requirements.

Responsibilities

• Design and implement data pipelines in collaboration with data users and engineering teams.
• Ensure the reliability, data quality, and performance of all data assets.
• Deliver high-quality, maintainable code focused on simplicity and performance.
• Redesign existing pipelines to leverage modern technologies and best practices.
• Work with solution engineers, data scientists, and product owners to deliver end-to-end products.

Required Skills

• 4-15 years of experience in software or data engineering.
• Proficiency in Python.
• Expertise in PySpark and distributed computing frameworks.
• Strong understanding of data modeling and data architecture concepts.
• Familiarity with system design, data structures, algorithms, and storage systems.
• Experience with cloud infrastructure and CI/CD processes.
• Experience with data testing and monitoring.

Preferred Skills

• Experience with Palantir Foundry.
• Knowledge of advanced analytics, Machine Learning, or Statistics.
• Experience with data visualization and TypeScript.

Key Skills

Education

Any Graduate