Description

Lead the design and development of data processing and transformation engines using Python.

Responsibilities

• Design and implement efficient, scalable data processing workflows and ETL processes.
• Develop and maintain Python code for complex data processing pipelines and algorithms.
• Optimize existing codebases to improve performance, reduce technical debt, and ensure scalability.
• Automate repetitive data processing tasks to streamline operations and ensure data integrity.
• Collaborate with data scientists and analysts to implement data models and ensure data quality.

Required Skills

• 6+ years of experience in systems integration and building data transformation services.
• Expertise in Python and libraries including Pandas, NumPy, Seaborn, Matplotlib, and Flask.
• Strong proficiency in SQL and NoSQL database systems.
• Experience with ETL and data pipeline development.
• Hands-on experience with CI/CD tools like AWS CodePipeline or Azure DevOps.
• Familiarity with containerization using Docker and Kubernetes.
• Deep understanding of data structures, data modeling, and software architecture.
• Strong knowledge of math, probability, statistics, and algorithms.

Preferred Skills

• Experience with machine learning libraries such as TensorFlow and Scikit-Learn.
• Familiarity with Agile methodologies.

Key Skills

Education

Bachelor /master’s degree in computer science