Description

You will build and manage multi-terabyte scale data lakes and implement Data Mesh architectures.

This role is remote.

Responsibilities

• Orchestrate large-scale data lakes and implement Data Mesh architectures.
• Build and maintain data pipelines and microservices for high-volume streaming data.
• Manage on-premises to AWS migrations and real-time data processing workflows.
• Transform vague business requirements into functional technical solutions.
• Collaborate with Data Architecture and Modeling teams to structure data.

Required Skills

• 5+ years of professional experience as a software engineer or data engineer.
• Proficiency in Python, Java, or Scala.
• Experience with Spark, Kafka, Flink, Hive, and Airflow.
• Strong SQL skills and experience with data modeling and warehousing concepts.
• Hands-on experience with AWS services including EMR, Kinesis, Redshift, S3, SQS, Lambda, and Glue.
• Experience with NoSQL databases such as MongoDB and Cassandra.
• Background in financial services or banking.

Preferred Skills

• Experience with C++.

Key Skills

Education

Any Graduate