I would like to see the ability to manage loaded models without having to do so by trying to load one of the agents that requires a model. That pop-up seems to be the only place right now where I can load, unload, or unload all LLM models
I think it would be better if you had that on the dashboard, where you could click to load or unload. In the dashboard, show what's being loaded or what is loaded at the time, and how much each one is using of the MPUs, like your points system. That would be a really nice quality-of-life update
Yes — you'll be able to load and unload models from the dashboard without going through an agent, and see each model's memory use. It's due by the end of November, provided that the release stays on schedule.