Description

You will build and manage scalable data pipelines and infrastructure to support data-driven insights.

Responsibilities

• Architect, build, and maintain scalable data pipelines and infrastructure using Python.
• Design and implement data models and schemas to meet business objectives.
• Develop and optimize data processing algorithms and workflows using Apache Spark or Pandas.
• Fine-tune pipelines for performance, reliability, and scalability.
• Monitor and troubleshoot pipeline issues to ensure data quality and integrity.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python programming.
• Hands-on experience with Apache Spark or Pandas.
• Experience with SQL and NoSQL database systems.
• Familiarity with cloud platforms such as AWS or Azure.
• Bachelor’s degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Experience collaborating with data scientists and analysts to meet specific data requirements.

Key Skills

Education

Any Graduate