Jobs by Fastorial
Back to all jobs

Senior ML Engineer - (NPW)

1 view
Milestone Technologies, Inc.KochiHybrid

5+ years

Posted 4 days ago

  • Devops
  • Llm
  • Python

Role Summary

Owns the AI Evaluation and Benchmarking Baseline: evaluation set construction aligned to the golden dataset, and accuracy measurement harness automation.

Key Responsibilities

  • Construct the evaluation set aligned to the golden dataset
  • Automate the accuracy measurement harness
  • Integrate MLflow for experiment tracking
  • Own KPI observability reporting

Required Skills and Experience

  • 5+ years ML engineering experience with an evaluation / observability focus
  • Hands-on experience with MLflow or an equivalent experiment-tracking tool
  • Benchmarking framework design experience, including KPI reporting for stakeholder review
  • Strong Python skills
  • Education: B.Tech/MCA in Computer Science, AI/ML, or a related field, or equivalent practical experience

Preferred Qualifications

  • Experience resequencing an evaluation milestone around a late-arriving dataset dependency
  • KPI observability reporting experience for AI systems specifically