And how do the results compare to hosted LLMs like Claude 3.7?

resource_waste · 2025-05-21T18:01:08 1747850468

Eh, different usecase entirely. I don't really compare these.

bufferoverflow · 2025-05-21T20:11:10 1747858270

Different class. Same exact use case.

ttoinou · 2025-05-21T21:12:02 1747861922

For which kind of coding would you use a subpar LLM ?

kergonath · 2025-05-22T05:52:00 1747893120

A LLM that I don’t host is a non-starter, so even a “subpar LLM” is better than someone’s cloud.

troyvit · 2025-05-21T22:12:38 1747865558

I'd use a "subpar" LLM for any coding practice where I want to do the bulk of the thinking and where I care about how much coal I'm burning.

It's kind-of like asking, for which kind of road-trip would you use a Corolla hatchback instead of a Jeep Grand Wagoneer? For me the answer would be "almost all of them", but for others that might not be the case.

ttoinou · 2025-05-21T23:28:37 1747870117

In that case examples of which trips would be interesting so we can take inspiration from you

__MatrixMan__ · 2025-05-22T03:02:57 1747882977

The kind of coding that happens after the internet goes down. How important of a use case that is depends heavily on why the internet went down.