Senior ML Engineer - (NPW)
1 viewMilestone Technologies, Inc.KochiHybrid
5+ years
Posted 4 days ago
- Devops
- Llm
- Python
Role Summary
Owns the AI Evaluation and Benchmarking Baseline: evaluation set construction aligned to the golden dataset, and accuracy measurement harness automation.
Key Responsibilities
- Construct the evaluation set aligned to the golden dataset
- Automate the accuracy measurement harness
- Integrate MLflow for experiment tracking
- Own KPI observability reporting
Required Skills and Experience
- 5+ years ML engineering experience with an evaluation / observability focus
- Hands-on experience with MLflow or an equivalent experiment-tracking tool
- Benchmarking framework design experience, including KPI reporting for stakeholder review
- Strong Python skills
- Education: B.Tech/MCA in Computer Science, AI/ML, or a related field, or equivalent practical experience
Preferred Qualifications
- Experience resequencing an evaluation milestone around a late-arriving dataset dependency
- KPI observability reporting experience for AI systems specifically