Description

You will design and develop scalable data architectures to extract, store, and process large datasets.

Responsibilities

• Architect scalable data pipelines and ETL processes using Scala, Python, and Spark.
• Build serverless workflows and orchestration using AWS Step Functions, Glue, and Lambda.
• Automate integrations and pipelines using data governance and testing techniques.
• Perform unit tests and code reviews to ensure performance and code quality.
• Collaborate with software engineers, analysts, and product owners to deliver data exploration and visualization solutions.

Required Skills

• 4+ years of experience with AWS services including Step Functions, Glue, Lambda, and DynamoDB.
• 4+ years of experience with distributed computing tools like Spark.
• Proficiency in Scala and Python.
• 2+ years of experience practicing Agile engineering.
• Experience with SQL and NoSQL databases.
• Knowledge of Java, JavaScript, TypeScript, HTML, and CSS.
• Experience with serverless architectures.

Key Skills

Education

Any Gradute