Description

Lead data integration, transformation, and modeling efforts within AWS cloud environments. You will design database architectures, cloud computing structures, and data lakes while managing batch and real-time processing jobs.

Responsibilities

• Lead data integration, transformation, migration, and modeling projects across AWS environments.
• Design scalable database architectures, cloud structures, and data lakes.
• Develop batch and real-time processing jobs using Spark, Spark Streaming, Kafka, and Python.
• Implement automation and DevOps practices using CloudFormation, Terraform, and CI/CD pipelines.
• Perform database performance tuning, system requirement analysis, and create technical diagrams for data entities.

Required Skills

• 14+ years of experience in data architecture and big data development.
• 5+ years of experience in cloud architecture specifically with AWS.
• Expertise in AWS services including Glue and Redshift.
• Proficiency in Python and PySpark.
• Strong experience with Apache Spark, Spark Streaming, and Kafka.
• Hands-on experience with Denodo and SQL Server.
• Ability to manage data pipelines and perform complex SQL querying.
• Experience with GIT and SQL Server Management Studio.
• Competency in design tools such as LucidChart or Draw.io.

Preferred Skills

• AWS Certified Solutions Architect (Associate or Professional).

Key Skills

Education

Any Graduate