Description

Lead the development of big data products, production-level machine learning systems, and data platforms.

This role is on-site.

Responsibilities

• Build and deploy production-level data-driven applications and processing workflows.
• Implement machine learning systems at scale, covering ingestion, feature engineering, modeling, and monitoring.
• Develop and configure data lakes and warehouses using advanced data modeling and integration techniques.
• Lead collaborative work in complex engineering projects within Agile/Scrum environments.
• Automate processes through shell scripting and manage standard software development lifecycles including version control, testing, and deployment.

Required Skills

• 13+ years of hands-on experience as a Data Engineer in an individual contributor capacity.
• Expert proficiency in Python, Scala, and Java.
• Extensive experience with Spark, specifically tuning jobs for performance.
• Deep knowledge of Hadoop platforms and tools including Hive, Impala, Airflow, and NiFi.
• Advanced SQL skills for data mining and complex analysis.
• Proven ability to develop production machine learning pipelines.
• Strong background in Analytics, Computer Science, and Advanced Statistics.

Preferred Skills

• Experience developing and configuring dashboards using Tableau or Looker.

Key Skills

Education

Any Graduate