I haven’t, but I’ll keep this in mind for the future – thanks.

I believe I was when I tried it before, but it’s possible I may have misconfigured things

I’ll give it a shot later today, thanks

edit: Tried out mistral-7b-instruct-v0.1.Q4_K_M.ggufvia the LM Studio app. it runs smoother than I expected – I get about 7-8 tokens/sec. I’ll definitely be playing around with this some more later.

That’s good to know. I do have 8GB VRAM, so maybe I’ll look into it eventually.

I’m looking forward to the day where these tools will be more accessible, too. I’ve tried playing with some of these models in the past, but my setup can’t handle them yet.