Description

You will build and manage data applications and near-real-time integrations within an AWS-based technology stack.

Responsibilities

• Design and implement reporting and analytics features using Agile/Scrum methodologies.
• Contribute to architecture, frameworks, and design patterns for storing and processing high data volumes.
• Build automated, scalable, and sustainable solutions to minimize technical debt and defects.
• Manage applications in AWS cloud and utilize cloud APIs for integrations.
• Provide post-implementation production support for data pipelines.

Required Skills

• 5+ years of experience in a data engineering role.
• 2+ years of development experience with AWS services including EMR, ECS, EC2, S3, SNS, Lambda, and IAM.
• Proficiency in Python, SQL, and APIs.
• Experience with Snowflake.
• Hands-on experience with RDBMS platforms such as MS SQL Server, MySQL, or Postgres.
• Experience with GitHub pipeline actions and deployment.
• Ability to work on critical enhancements and time-sensitive projects in multi-disciplinary teams.

Preferred Skills

• Experience with streaming data.
• Knowledge of Debezium, Kafka, SQLite, Apache Hudi, Hadoop, YARN, Spark, Apache Hive, or Ray clusters.

Key Skills

Education

Any Graduate