Description

Design and implement large-scale data management platforms on AWS, translating customer requirements into validated architectural patterns.

Responsibilities

• Build data management platforms using EMR, Redshift, Kinesis, Athena, Lake Formation, S3, Glue, DynamoDB, ElastiCache, and RDS.
• Develop configuration-based ETL pipelines and orchestration workflows using Dagster.
• Deliver high-performance solutions as CloudFormation templates and reusable artifacts.
• Lead teams of developers across Big Data, Reporting, and Database architecture disciplines.
• Advise customers on system transitions to live AWS environments and extract reference architectures.

Required Skills

• 12-14 years of experience in AWS and big data technologies.
• Expertise in AWS services including EC2, EMR, Redshift, S3, and Kinesis.
• Hands-on experience with Kafka, HDFS, and the Starburst ecosystem.
• Proficiency in data modeling using dbt.
• Experience with Statistics, Machine Learning, and Predictive Modelling.
• Strong background in tuning Big Data ecosystems including Spark, Hadoop, R, Presto, and Hive.
• Deep knowledge of relational databases: Oracle, MySQL, PostgreSQL, and MS SQL Server.
• Experience with NoSQL databases such as DynamoDB, HBase, MongoDB, and Cassandra.
• Proven ability in data warehousing, schema design, and query optimization for Redshift, Teradata, or Vertica.

Preferred Skills

• AWS Certifications such as Solutions Architect, Developer, or Data Analytics Specialty.
• Experience using bootstrap user data scripts for implementation.

Key Skills

Education

Any graduate