Description

Lead the implementation of machine learning production systems and manage complex engineering projects in an Agile setting.

Responsibilities

• Lead collaborative work on complex engineering projects using Scrum methodologies.
• Build and deploy production-level data-driven applications and data processing pipelines.
• Implement machine learning systems at scale, covering ingestion, feature engineering, modeling, and monitoring.
• Develop Big Data products and platforms using Hadoop ecosystems.
• Automate workflows through shell scripting and standard software development practices including version control and testing.

Required Skills

• 10+ years of hands-on experience as a Data Engineer in an individual contributor capacity.
• 5+ years leading collaborative work in complex engineering projects within Agile/Scrum environments.
• Expert proficiency in Python, Scala, and Spark, including Spark job tuning.
• Deep experience with Hadoop platforms and tools such as Hive, Impala, Airflow, and NiFi.
• Advanced SQL skills and extensive data warehousing/data lake development experience.
• Strong expertise in data modeling, data integration, and data mining.
• Practical experience with machine learning algorithms and production machine learning pipelines.
• Proficiency in Java, Scala, or Python for deploying large-scale data processing workflows.
• Solid foundation in computer science, analytics, and statistical analytical techniques.

Preferred Skills

• Experience developing and configuring dashboards using Tableau or Looker.

Key Skills

Education

Any gradudate