Description

You will design and maintain fault-tolerant data pipelines and distributed cloud systems to support machine learning and business initiatives.

This role is on-site.

Responsibilities

• Build large-scale batch and real-time distributed data systems for cloud-based environments.
• Optimize and integrate distributed data architectures to support new products and data initiatives.
• Develop and manage automated workflows to minimize human error in data processing.
• Design, test, document, and deploy data engineering solutions using distributed cloud technologies.

Required Skills

• 12+ months of hands-on experience with Alteryx, Apache Spark, Azure Cloud, and Databricks.
• Proficiency in Python, SQL, and Snowflake for data engineering tasks.
• Experience with infrastructure as code using Terraform and container orchestration via Kubernetes.
• Knowledge of DBT Analytics for data transformation and modeling.
• Linux administration skills and familiarity with Microsoft Services.
• Bachelor’s degree in Computer Science, IT, Engineering, Business, Statistics, or a related field.

Preferred Skills

• Experience with GIS data processing and integration.
• Background as an IT Consultant, Analyst, or Developer.

Key Skills

Education

Any Graduate