Description

You will build and manage data pipelines and serverless applications on AWS.

This role is hybrid.

Responsibilities

• Develop data pipelines to extract data from external sources into internal systems.
• Design and architect serverless applications using AWS Lambda, EMR, and DynamoDB.
• Implement ETL processes to load data into staging areas, data warehouses, and data marts using SCDs.
• Build Python APIs and use AWS Glue for data extraction from design databases.
• Integrate open-source components into data-analytic solutions.

Required Skills

• 5+ years of experience in data engineering with a focus on AWS Glue and Python.
• Proficiency in PySpark, Redshift, and SQL.
• 3+ years of hands-on experience with AWS services including EC2, VPC, S3, EBS, ELB, CloudFront, IAM, RDS, and CloudWatch.
• Strong understanding of relational database design, stored procedures, triggers, and SQL jobs.
• Knowledge of OLAP, OLTP, Star Schema, Snowflake Schema, and dimensional data modeling.
• Experience with AWS data migration tools such as Storage Gateway and Database Migration services.
• Familiarity with CI/CD tools like Jenkins and UCD for automated deployments.
• Experience working within SDLC frameworks, including Waterfall and Agile.

Preferred Skills

• Experience with Git, SVN, and UNIX/Linux environments.
• Hands-on experience with Jupyter Notebooks.
• Knowledge of Informatica.

Key Skills

Education

Any Gradute