Hello Blabladores, in order to improve the reliability of BLABLADOR, I am having to do some drastic changes, which required me to shutdown pretty much every single model and the server itself. OF COURSE while this happened, some GPUs decided do fail, which forces a full node reboot. I am bringing everything back up. If you are not working at the evening, just ignore this part. They are basically all up. Another thing is that I would like to phase out Llama3-405. It’s an obsolete model, it’s slow, and takes too many resources. Yesterday, Minimax-M2 came out, and it’s one of the best models out there. It’s ranked among models such as ChatGPT 5 and Claude 4.5. It is already running. It’s aliased as “alias-huge”. But as this is a reasoning model, you might filter what comes between the <think> and </think> on your code. Another thing is that this model might be able to generate images and music, but I need to figure it out. Let’s bark! Alex
participants (1)
-
Strube, Alexandre