i am still in shock that Qwen 3.5 27B dense on a single RTX 3090, a $900 GPU, one shotted a game challenge that 120B MoE at full precision on $70K+ production hardware could not.
this is leading me to doubt if it was a fluke. so i am going to reproduce it. i will test 27B dense Q4 on my single 3090 again paired with Hermes Agent and have it reproduce the results. after that i will test the same dense 27B but unquantized because if Q4 can one shot something that 120B full precision cannot then i wonder what dense 27B unquantized would do.
dense models with all parameters active on every token might matter more than total parameter count for agent coding. if this reproduces it changes how i think about what hardware you actually need.
this is not letting me sleep well since yesterday. i will report back.
Feels like the model inference companies are showing signs of financial strain. They are seriously pushing hard for monetisation. Claude pro is almost useless at this point...




