Description

You will build and manage multi-terabyte scale data lakes and implement Data Mesh architecture. You will orchestrate large-scale data lakes, transform vague requirements into functional technical solutions, and build or maintain data pipelines and microservices. You will collaborate with Data Architecture and Modeling teams to structure data, manage on-premises to AWS migrations, and handle real-time data processing workflows.

Responsibilities

• Orchestrate large-scale data lakes and implement Data Mesh architectures.
• Build and maintain data pipelines and microservices for high-volume streaming data.
• Transform vague business requirements into functional technical solutions.
• Manage on-premises to AWS migrations and real-time data processing workflows.
• Collaborate with Data Architecture and Modeling teams to structure data.

Required Skills

• 5+ years of professional experience as a software engineer or data engineer.
• Proficiency in Python, Java, or Scala.
• Experience with Spark, Kafka, Flink, Hive, and Airflow.
• Strong SQL skills and experience with data modeling and warehousing concepts.
• Hands-on experience with AWS services including EMR, Kinesis, Redshift, S3, SQS, Lambda, and Glue.
• Experience with NoSQL databases such as MongoDB and Cassandra.
• Background in financial services or banking.
• Knowledge of object-oriented or object-functional scripting.

Preferred Skills

• Experience with C++.

Key Skills

Education

Any Graduate