MoE models are the new big thing for low-end hardware. Try Chat Completion with the official Gemma 4 samplers: top_k: 64; top_p: 0.95; temp: 1.0
Paul Mercer
unknown2304
AI & ML interests
None yet
Recent Activity
updated a collection 4 days ago
26B-A4B RP/eRP and other MoEs liked a model 4 days ago
SubMaroon/Kitchoon-V2-26B-A4B updated a collection 23 days ago
26B-A4B RP/eRP and other MoEsOrganizations
None yet
