Key Responsibilities

The Data Engineer will be responsible for designing, implementing, and maintaining data pipelines to support various analytics and reporting projects. This role involves working with large data sets, optimizing data architectures, and ensuring data quality and integrity. You will collaborate with data scientists and analysts to understand their data needs and develop solutions that meet those needs effectively. Additionally, you will be tasked with monitoring system performance, troubleshooting issues as they arise, and providing actionable insights based on data analysis.

Requirements

Applicants should possess a robust understanding of data engineering principles, with at least 6 years of relevant experience in handling big data technologies such as Hadoop, Spark, and Kafka. Proficiency in SQL and experience with cloud platforms like AWS or Azure is essential. Candidates must exhibit strong programming skills in languages such as Python or Scala, and familiarity with ETL processes is a plus. Effective communication skills and the ability to work in a collaborative environment are critical, as is a strong problem-solving mindset