Description

Design, develop, and implement end-to-end AI/ML models and data pipelines for large-scale processing.

Responsibilities

• Design and implement end-to-end AI/ML models using classification, clustering, and regression.
• Develop and optimize complex SQL, Hive, and PySpark-dataframe queries for large-scale data processing.
• Build optimized data pipelines for both batch and real-time data processing.
• Lead engineering and scrum teams through the full software development lifecycle.
• Analyze software and system processing flows to develop technical and functional specifications.

Required Skills

• 7-10+ years of software development experience.
• 4+ years of experience in applying statistics and end-to-end ML engineering.
• Expertise in data structures, data modeling, and software architecture.
• Hands-on experience with SQL, Hive, and PySpark-dataframes.
• Experience with NoSQL databases such as HBase, Couchbase, or MongoDB.
• Proficiency in UNIX shell scripting.
• Bachelor’s degree in Engineering, Computer Science, or equivalent, or a Master’s in Computer Applications.

Preferred Skills

• Experience with cloud platforms including GCP or AWS.
• 2+ years of experience building solutions using Kafka streams or queues.
• Experience with GitHub and CI/CD pipelines.

Key Skills

Education

Any Graduate