Description

You will design and implement scalable data pipelines and storage solutions using modern distributed systems.

This role is on-site.

Responsibilities

• Develop data processing pipelines using batch, micro-batching, and streaming methodologies.
• Design data models using Dimensional, Data Vault, Kimball, or Inmon techniques.
• Manage data serialization and storage using formats like JSON, Avro, Protobuf, Parquet, or Iceberg.
• Execute development within Agile environments, contributing to PI planning and roadmaps.
• Maintain code quality through TDD/BDD practices and CI/CD workflows.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python, Scala, or Java.
• Experience with cluster computing frameworks such as Spark, Flink, or Storm.
• Hands-on work with cloud lakehouse platforms like AWS data lake services or Databricks.
• Experience with relational databases such as Postgres or Oracle.
• Proficiency with NoSQL stores including Cassandra, Dynamo, or MongoDB.
• Experience orchestrating workflows with Airflow, AWS Step Functions, or similar tools.
• Competency with Git and Jenkins for CI/CD.

Preferred Skills

• Experience with AWS Bedrock APIs and Generative AI concepts like RAG, vector embeddings, or agentic AI.
• Experience with Infrastructure as Code using Terraform or AWS CloudFormation.

Key Skills

Education

Any Gradute