Description

You will build and maintain scalable real-time streaming ETL applications and data warehouses.

Responsibilities

• Build scalable real-time streaming ETL applications and data warehouses.
• Process large data sets in time-sensitive environments while minimizing errors.
• Maintain infrastructure as code using Terraform.
• Develop and optimize Python and PySpark ETL modules.

Required Skills

• 3+ years of experience with Python and PySpark.
• Advanced proficiency in PySpark and Python ETL development.
• Hands-on experience with AWS tools including S3, Glue, Lake Formation, Athena, and Redshift.
• Experience managing infrastructure as code with Terraform.
• Advanced understanding of SQL and NoSQL technologies like MongoDB or DocumentDB.
• Experience with Postgres and SQL.
• Hands-on experience working with Qlik (Attunity) Replicate.
• 4-year college degree required; Bachelor’s in Information Technology or a related technical discipline preferred.

Preferred Skills

• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science