Description

You will design and build cloud-based data solutions to support digital transformation and business decision-making.

Responsibilities

• Build foundations for cloud solutions focusing on data discovery, quality, integration, and movement.
• Develop ingestion processes using AWS Glue and manage ETL workflows.
• Migrate data from on-premise sources like RDBMS, Hadoop, and Netezza to AWS, Redshift, or Snowflake.
• Design and maintain data pipelines using Step Functions and EMR.
• Perform data modelling, integration, and troubleshooting for complex data environments.

Required Skills

• 5+ years of experience in Data Engineering.
• Expertise in SQL and cloud data warehouses, specifically Redshift or Snowflake.
• Hands-on experience with AWS Glue, Lambda, and EMR.
• Proficiency in Python, including the use of NumPy and Pandas libraries.
• Experience with Spark and data pipeline orchestration.
• Working knowledge of Kubernetes, Docker, and Argo orchestration.
• Ability to handle diverse data sources including RDBMS, flat files, XML, and JSON.
• Experience managing data movement and ETL processes.
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.

Preferred Skills

• Snowflake Certification, AWS Certification, or Azure Certification.
• Hands-on experience with Python and related frameworks in a Linux environment.
• Experience with SnowSQL development and Snowflake setup.

Key Skills

Education

Any Gradute