Description

You will architect, build, and maintain scalable data pipelines for batch and real-time processing.

Responsibilities

• Architect and build scalable data pipelines for batch and real-time processing.
• Partner with analysts, scientists, and engineers to transform raw data into actionable insights.
• Optimize data pipeline performance and ensure smooth production operations.
• Own end-to-end data engineering solutions impacting business decision-making.

Required Skills

• 7+ years of experience in data engineering or backend development with data-intensive systems.
• Strong proficiency in Python, including pandas and API integration.
• Deep understanding of data structures, algorithms, and testing best practices.
• Experience with ETL/ELT pipelines and orchestration tools like Airflow or Prefect.
• Strong proficiency in SQL and knowledge of data warehousing concepts.
• Experience working with AWS cloud services.
• Familiarity with data quality assurance and documentation practices.
• Experience with Java, Python, Node.js, Spring Boot, Kafka, or ZooKeeper.

Key Skills

Education

Any Graduate