Building Malleable ML Systems through Measurement, Monitoring & Maintenance

Posted Jul 14, 2021 | Views 327

# Explainability and Observability

# Organization and Processes

# Research

SPEAKER

Karan Goel

PhD Student @ Stanford University

Karan Goel is a 3rd year CS PhD student at Stanford advised by Chris RŽ. His main goal is to accelerate the pace at which machine learning can be robustly and safely used in practice across applications, and in industry at large. He leads the Robustness Gym project, where he builds tools to measure, monitor and repair machine learning systems interactively. He is a recipient of the Siebel Foundation Scholarship.

+ Read More

SUMMARY

Machine learning systems are now easier to build than ever, but they still donÕt perform as well as we would hope on real applications. IÕll explore a simple idea in this talk: if ML systems were more malleable and could be maintained like software, we might build better systems. IÕll discuss an immediate bottleneck towards building more malleable ML systems: the evaluation pipeline. IÕll describe the need for finer-grained performance measurement and monitoring, the opportunities paying attention to this area could open up in maintaining ML systems, and some of the tools that IÕm building (with great collaborators) in the Robustness Gym and Meerkat projects to close this gap.

+ Read More

Watch More

Wild Wild Tests: Monitoring Recommender Systems in the Wild

Posted Apr 12, 2022 | Views 672

# Explainability and Observability

# Open Source

# Production Use Case

1:00

Workshop: The Key Pillars of ML Observability and How to Apply Them to Your ML Systems

Posted Apr 20, 2022 | Views 951

# Explainability and Observability

Intelligent Customer Preference engine with real-time ML systems

Posted Apr 12, 2022 | Views 418

# Data engineering

# Production Use Case

# Systems and Architecture