I'm really not doing anything particularly fancy, just kinda been trying to see how much juice I can actually get out of my fairly old card I mean it's newly purchased, new years basically, but it's not a new model
now that I've got an actually fairly good setup as far as speed and context goes, I can make it actually do something useful, probably I've got it hooked into discord so I can drive it from there already, even if I doubt I'll use it all that much I prefer to be at the computer when I do this stuff cause I mean, it is running on my GPU
S C
well for now I'm siccing it on the voxyrium and shader issue
S C
alright, so 100k is still kinda the limit but that's fine
S C
100k isn't bad when atomic-agent is so efficient with it and also it reads super fast it seems
S C
hipfire does need its own bespoke model format though, which is a pain, but still the primary bother with it isn't really the format itself, they do provide a way to convert a safetensor to it, with quantization and everything, but the issue is I can't benefit from the progress made in quantization until that's ported over into this thing
