Description

What you'll do
• Develop and maintain high-performance, scalable, and fault-tolerant data processing systems using Spark, Flink, Druid, or the like.
• Collaborate with cross-functional teams to integrate data from multiple sources and ensure data accuracy and consistency.
• Write complex SQL queries to support data analysis and reporting.
• Develop and maintain data models and ETL processes.
• Optimize data pipelines and system performance to ensure efficient data processing and analysis.
• Build and maintain data infrastructure, including data storage and data access systems.
• Stay up-to-date with the latest developments in data engineering technologies and best practices.

What you'll need:
• Bachelor's degree in Computer Science, Engineering, or a related field
• 5+ years of experience in Data Engineering
• Expertise in Spark and Python
• Experience with Scala is a bonus
• Experience with Databricks is a bonus
• Strong understanding of distributed systems, data modeling, and ETL processes
• Hands-on experience with cloud-based data warehousing solutions (e.g., AWS Redshift, Snowflake, Teradata)
• Excellent problem-solving skills and attention to detail
• Strong written and verbal communication skills
• Ability to work independently and as part of a team
 

Key Skills

Education

Any Graduate