Hi @gfqdjb. I’ve used a low-level Qwen model locally via VSCode and a bunch of extensions like Cline and Continue, but that’s about it.
If you want to go down the same path, I’d recommend this video to help you get started. Beyond that, hardware limitations mean most of the higher models are off limits to me except via the browser or paid API tokens.
I’m on a Mac, an older model, but people with M5 MacBooks still can’t run some of these models.
Let me know if this helps or if you need something else.