Description

Key Skills: Apache, Databricks, Python, Snowflake, ETL, Kafka, Algorithms, CICD, Cloud (AWS / Azure / GCP), Microservices

Roles and Responsibilities:

• Develop and maintain ETL/ELT pipelines using Databricks and Spark, including SQL and Python transformations.
• Build and support streaming and event-driven data flows using Kafka.
• Optimize pipeline performance and cost through tuning, validation, and data quality checks.
• Monitor pipeline health and respond to alerts using observability tooling (e.g., CloudWatch/Datadog) and operational runbooks.
• Collaborate with senior engineers and analytics teams to support production operations, troubleshooting, and platform improvements.

Skills Required:

• 2+ years of experience in data engineering or related software engineering roles.
• ETL development and maintenance for production data workflows.
• Kafka-based streaming/event ingestion and processing.
• Python and SQL job development for data ingestion, transformation, and troubleshooting.
• Databricks and Snowflake for big data processing and analytics storage/serving.

Good to Have:

• Algorithms and strong problem-solving fundamentals.
• CI/CD experience for data and software delivery (e.g., GitLab, Jenkins, GitHub Actions).
• Microservices experience and familiarity with cloud-native patterns.
• Cloud exposure across AWS, Azure, or GCP.

Education: Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent experience)

Key Skills

Education

Any Graduate