Description

You will own the design and implementation of data solutions.

Responsibilities

• Architect and implement data ingestion, validation, and transformation pipelines.
• Collaborate with Product, Development, and Enterprise Data teams to design batch and streaming integrations.
• Take ownership in building solutions and proposing architectural designs for efficient data ingestion and transformation.
• Troubleshoot data pipelines and resolve issues according to SDLC.
• Estimate, track, and communicate status of assigned items to stakeholders.

Required Skills

• 12 years of industry experience.
• Knowledge of Big Data Architecture on cloud and on-premise.
• Proficiency in AWS Collection Services: Kinesis, Kafka, Database Migration Service.
• Proficiency in AWS main Storage Services: S3, EBS, EFS.
• Proficiency in AWS main Compute Services: EC2, Lambda, ECS, EKS.
• Proven experience in Java.
• Working experience with AWS Athena and Glue PySpark, EMR, DynamoDB, Redshift, Kinesis, Lambda, Apache Spark, Databricks on AWS, Snowflake on AWS.
• Proficient in AWS Redshift, S3, Glue, Athena, DynamoDB.
• AWS Certification: AWS Certified Solutions Architect and/or AWS Certified Data Analytics.
• Working experience with Agile Methodology and Kanban.

Preferred Skills

• Strong experience in Azure with hands-on experience in 2 or more of: Azure SQL DB, Azure SQL Managed Instance, Azure Data Lake Store, Azure Cosmos DB, Azure Database for PostgreSQL, Azure Database for MySQL.

Key Skills

Education

Any Graduate