Description

You will design and build scalable data pipelines and infrastructure solutions.

This role is remote.

Responsibilities

• Develop and maintain scalable data processing workflows using PySpark and Python.
• Implement ETL/ELT processes for data ingestion and transformation.
• Manage and optimize data infrastructure using Infrastructure as Code tools like Terraform, Ansible, or CloudFormation.
• Troubleshoot and resolve issues within distributed data systems.

Required Skills

• 12+ years of experience in a Data Engineering role.
• Proficiency with Python and PySpark for data manipulation.
• Hands-on experience with AWS services, specifically Redshift and Databricks.
• Experience using DBT for data transformation.
• Knowledge of Infrastructure as Code tools (Terraform, Ansible, or CloudFormation).
• Experience with distributed data technologies, specifically Spark.

Key Skills

Education

Any Gradute