/g/ — /lmg/ - Local Models General

File: mikuthreadrecap.jpg (1.15 MB, 1804x2160)

►Recent Highlights from the Previous Thread: >>109053101

--Debating benchmark reliability and Qwen's performance vs Gemma 4:
>109053525 >109053577 >109053603 >109053627 >109053651 >109053669 >109054428 >109053670 >109053684 >109053687 >109053723 >109053647 >109053711 >109053593 >109053628
--Local model limitations with long system prompts and cloud orchestration:
>109053518 >109053541 >109053558 >109053666 >109053732 >109053730 >109053813 >109054600 >109054628 >109054700 >109053825
--Strategies for small AI labs to gain visibility without benchmarks:
>109053667 >109053710 >109054446 >109054525 >109054502 >109056323 >109056703 >109056830 >109054790 >109055065 >109056367
--MoE models and deployment tips for DGX Spark hardware:
>109054365 >109054420 >109054436 >109054729 >109054659 >109054734
--Trading model size for context window on 24GB VRAM cards:
>109055171 >109055203 >109055228 >109055286 >109055409 >109055439 >109055253 >109055266 >109055930 >109055740 >109055936 >109056028 >109056110 >109056247
--Gemma-4-31B performance on 4090 and debate over QAT quants:
>109057054 >109057076 >109057093 >109057136 >109057218 >109057138 >109057268
--Claims that Rio 3.5 is a merge of Nex and Qwen:
>109055830 >109055903 >109055989
--Speculating on Mistral's decline and Meta's internal corporate AI failures:
>109053890 >109053911 >109053959 >109053961 >109054584 >109054594 >109054743 >109053970 >109054002 >109053951
--Debating world models versus LLMs as paths to AGI:
>109054070 >109054085 >109054169 >109054198 >109054226 >109054243 >109054240 >109054193
--Comparing open source AI coding tools and local-only interfaces:
>109053118 >109053132 >109053144 >109053204 >109053236 >109053250 >109053848 >109054337 >109055482 >109055657 >109055681 >109055744 >109055510 >109055568 >109055592 >109055680 >109056440
--Miku (free space):
>109053508 >109055705

►Recent Highlight Posts from the Previous Thread: >>109053288

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

https://github.com/moeru-ai/airi
This one looks promising

>>109057513
Shit, didn't even see it posted in the last thread lmao

another thread, another migu

Are there any good models that could run on a toaster? Talking about a T480 ChinkPad with an Intel HD 620

Your future self 10 years from now telling you you'll be masturbating to computer-generated VR content when you're older, running on expensive hardware you specifically bought for that purpose.

>>109057545
no

>>109057545
https://huggingface.co/prism-ml

70b dense

>>109057545
you're doomed

Gemma5-70B-A69B

>>109057547
The me from ten years ago collected expensive anime figures. We'd shake hands and jerk off together.

>>109057545
just buy a cheap ryzen mini pc with a 7000 or better apu 32gb+ of ram you can run gemma 4 26b on it

>>109057547
what if they're VR hags

>>109057547
Hopefully it'll be more like 5 years and we'll be on our Steam Frame OLEDs.

>>109057601
Is Genie the closest thing to that currently?

File: 1756621225097944.png (376 KB, 719x1335)

>>109057485 (OP)
Look like Anthropic is gonna try and beg the government to unban mythos I guess?

https://www.axios.com/2026/06/14/anthropic-white-house-mythos-fable

File: 1778025706923877.webm (2.90 MB, 1280x720)

>>109057626
I don't know if we'll go that route. I think scene construction via an agent will be what's actually used, except better and faster.
We might also be running small, efficient video models that take a lightly rendered scene + metadata to produce the final image. Hybrid AI rendering basically.

>>109057644
looks like a whole lot of "not my problem" mixed with some "not local" to me

>>109057644
was this really not part of their plan
did they really hype this up as world ending and too dangerous for general public for months while begging for more regulation and safety concern, and then get surprised when government regulate it for safety concern because it's too dangerous for general public?

File: dipsyYouGetWhatYouFuckingDeserve.png (2.22 MB, 1536x1024)

>>109057644
> mfw Dario gets to claw out a mess of his own creation, begging for regulation

>>109057663
considering all the blatant market manipulation this administration has done they're probably waiting for tech stocks to dump as a result of the ban, stock up, unban it, then dump on baggies again

>>109057663
they wanted the government to do it to their competitors, while getting a pat on the back for being responsible. it didn't work out so well.

>>109057659
Regulation of SOTA models will 100pct downstream impact local. It is very much an /lmg/ topic.

>>109057545
You can try getting OpenVINO running and then try https://huggingface.co/OpenVINO/Qwen3.5-0.8B-int4-ov but it's highly dependent on RAM size since your iGPU needs to allocate from system memory.

gpt-oss2 when

>>109057679
good question, what would happen if the chinks dropped a fable tier model on hf?

glm > gemma

>>109057772
>>>/g/sdg

>>109057713
dario will say >oof ouch i don't like that
and nvidia will sell even more gpus

>>109057713
That's a big "if" that's really far away, and in the end it cant be regulated. It'll be put on the internet, up for grabs, then what? They're chinks. What are they gonna do? shit their pants and send a strongly worded letter? Enforce some dns block that'll be easily bypassed by everyone?

>>109057674
That makes no logical fucking sense considering Claude models are considered one of the if not the top tier for general purpose stuff (both because of their own shilling, fear mongering, and genuine general consensus) so it bogos my mind that they whatever think they would be exempt from that. Then again Californians think they're better than everybody (if silicon valley is a good way to gauge how they think and behave) so I guess that arrogance should not be surprising to me

>>109057857
its probably just a few politicians want a free trip to the strip club. after dario sends his guys to dc to wine n' dine them, fable will be restored.

File: lolz.png (16 KB, 815x130)

this pisses me off

>>109057899
>no, but yes

>>109057689
come on buddy unload i know you wanna

>>109057713
99% llama would find contrived reasons to not support it.
>>109057689
It's as authentic as the claims around Mythos's capabilities.

File: 00002-1260451778_lucy.png (1.48 MB, 1024x1024)

>>109057772

>>109057937
you exist in a jarted thread ran by jart

>>109057944
how exactly is the thread run by him? give me the ins and outs of how he makes every single op and how he runs the thread recap.

>>109057942
Fix the damn eyes you lazy bitch

>>109057547
If I can still masturbate at 40 I'll consider that a win.
My body is already showing it's age.

File: 1773555939201084.png (203 KB, 500x646)

>>109057772
>>109057942
There is a dipsy phenotype girl in the AI working group at my corporate workplace. I'd make a pass at her but HR would disappear me. Sad!

>>109057970
Stop lying, you are unemployed or in primary school.

>>109057948
>>109057944
>>109057938
>>109057689
samefag

im testing cohere's coder model so you dont have to
>first prompt, ask it to define a gui component
>2.5k reasoning tokens, seems acceptable
>second prompt, ask it to make it a generic container type instead, that only defines the style instead of a whole component
>8k reasoning tokens, hitting the budget limit
i'd get faster responses from dense models running at 6 t/s

Your future self 15 years from now telling you you'll be having sex with your computer-controlled robot, running on expensive hardware you specifically bought for that purpose.

>>109057987
Many such cases.
Have you tried Nex N2 mini?

>>109057975
I have taken the megacorp behavioral training course. It is strictly forbidden to compliment, or by omission of neutral greeting insult a female employee. Only bland speech is allowed.

You wouldn't use an llm to make a card of a church woman.

>>109058007
I wouldn't use an LLM to make a card at all. I prefer my cards to not be primed with slop.

skill issue

>>109058000
Seems like too much of a meme to bother, its arch seems to be qwen35moe

Your future self 20 years from now telling you that GNU Hurd is finally stable and you can install it on your GNU+Wombforce-9000 Wifebot that you specifically bought for "a purpose".

I’m glad I can i can use my pc for video games so I have a cover story

File: 1778186230688151.png (457 KB, 2300x1900)

>>109057547

I hope so, because I intend on just making a bunch of money from the energy markets, buying good hardware and completely dropping out of society to live somewhere nice.
If 10 years from now I can just jack off to top tier AI stories or even better, plow a robot waifu to my hearts content, I'll be pretty happy with my situation.

>>109058086
Why do you need four graphics cards to play League of Losers?