Description

You will design database systems and build ETL processes to support real-time and offline analytic processing.

Responsibilities

• Write ETL processes and design database systems to integrate data from diverse sources.
• Translate business specifications into technical design specifications and maintainable code.
• Develop Spark data processing applications and write ad hoc queries and reports.
• Troubleshoot software and processes to ensure data consistency and integrity.
• Partner with internal clients to understand business functions and explain technical considerations.

Required Skills

• 5+ years of experience in data engineering or analytical roles.
• Expertise in building Spark data processing applications using Python and PySpark.
• Advanced SQL development skills.
• Experience building AWS cloud architecture using ECS, Glue, S3, Redshift, Step Functions, Lambda, and SageMaker.
• Proficiency with AWS foundational services including IAM, CloudWatch, CloudFormation, and Secrets Manager.
• Hands-on experience with Tableau for reporting.
• Experience with CI/CD pipelines and GitHub.
• Knowledge of test automation and test-driven development (TDD) practices.
• Any Graduate degree.

Preferred Skills

• Experience providing data analysis guidance and tool support to business users.

Key Skills

Education

Any Graduate