Description

Key Skills: Python, Scala, PySpark, SQL, Databricks, Delta Lake, AWS DMS, Kafka, AWS Lambda, AWS Kinesis

Good to Have Skills: AI Augmentation and Vibe Coding knowledge, Oracle/DB2 database experience, AWS Aurora/PostgreSQL experience, event-driven streaming technologies, API development, microservices architecture.

Roles & Responsibilities:

• Lead the engineering efforts to build pipelines, CDC connections, and lakehouse foundations bridging the legacy estate to the cloud.
• Develop comprehensive data pipelines using Databricks Live Tables, PySpark, and AWS Lambda/Kinesis for processing all data types.
• Implement Change Data Capture (CDC) using AWS DMS to apply daily delta extracts from Oracle/DB2 to AWS Aurora/PostgreSQL databases.
• Build robust transformation frameworks for data validation, cleansing, and business logic implementation within the Curated and Foundation layers.
• Expose data products through APIs and Event-driven streams for downstream microservices consumption and integration

Key Skills

Education

Any Graduate