Description

You will build and maintain scalable data solutions focused on large-scale data processing.

Responsibilities

• Build and optimize data pipelines capable of processing terabytes of data.
• Implement and manage messaging queues using Kafka, AWS SQS, or similar technologies.
• Design and implement data models for data warehousing.
• Develop ETL processes and data manipulation scripts using Python.
• Manage data engineering workflows through CI/CD pipelines.

Required Skills

• 15+ years of experience in data engineering roles.
• Expert proficiency in Python for ETL and scripting.
• Hands-on experience with Snowflake or equivalent cloud data warehouses.
• Strong knowledge of orchestration tools like Apache Airflow.
• Experience implementing messaging queues (Kafka, AWS SQS).
• Proficiency with cloud platforms (AWS, Azure).
• Familiarity with CI/CD practices for data workflows.
• Experience with data modeling and database design.
• Knowledge of Docker and Kubernetes.

Key Skills

Education

Bachelor's degree