Description

Build and maintain data infrastructure to support ingestion, transformation, and processing pipelines.

This role is on-site.

Responsibilities

• Design and implement data ingestion and transformation pipelines.
• Develop and deploy data services using RESTful APIs.
• Manage CI/CD processes for data workflows.
• Ensure data governance and security compliance across systems.

Required Skills

• 5+ years of professional experience in data engineering.
• Expert proficiency in Python.
• Experience with Spark, Hadoop, and Hive for big data processing.
• Familiarity with Kafka for streaming data.
• Hands-on experience with AWS services (S3, Glue, Redshift, Athena, IAM).
• Proficiency in containerization using Docker and Kubernetes.
• Experience implementing CI/CD using Jenkins and Git.

Preferred Skills

• Knowledge of developing and integrating RESTful services.

Key Skills

Education

Any Graduate