Predictive ML Inference Meta Monitoring
Sunita Koppar will walk through AI landscape, significance of inference monitoring and mechanisms of monitoring AIML pipelines with SageMaker AI and MLFlow. Traditional ML is NOT being replaced by LLMs for most operational ML use cases. LLMs excel at language/generative tasks but are too expensive, slow, and inaccurate for structured prediction tasks.