Description

You will lead the development of big data products, platforms, and production-level machine learning systems.

Responsibilities

• Build and deploy production-level data-driven applications and data processing workflows.
• Implement machine learning systems at scale, covering ingestion, feature engineering, modeling, and monitoring.
• Develop and configure data lakes and data warehouses using advanced data modeling and integration techniques.
• Lead collaborative work in complex engineering projects within Agile/Scrum environments.
• Automate processes through shell scripting and manage standard software development lifecycles including version control, testing, and deployment.

Required Skills

• 13+ years of hands-on experience as a Data Engineer in an individual contributor capacity.
• Expert proficiency in Python, Scala, and Java.
• Extensive experience with Spark, specifically tuning jobs for performance.
• Deep knowledge of Hadoop platforms and tools including Hive, Impala, Airflow, and NiFi.
• Advanced SQL skills for data mining and complex analysis.
• Proven ability to develop production machine learning pipelines.
• Strong background in Analytics, Computer Science, and Advanced Statistics.
• Experience with predictive analytics and machine learning algorithms.
• Experience working in Agile/Scrum settings for complex engineering projects.

Preferred Skills

• Experience developing and configuring dashboards using Tableau or Looker.

Key Skills

Education

Any Graduate