pythonofftopic | Unsorted

Telegram-канал pythonofftopic - Offtopic

12466

Offtopic group for casual talking about anything. @rules_for_python still apply (except for the ontopic rule)

Subscribe to a channel

Offtopic

So not exactly 16 times slower, but still close.

Читать полностью…

Offtopic

4 performance cores with 2 threads each, 8 ecores with one thread. 16 threads.

Читать полностью…

Offtopic

I have a lot of cores.

Читать полностью…

Offtopic

Anyway, I do not have 1 core.

Читать полностью…

Offtopic

I'll only investigate if it happens again.

Читать полностью…

Offtopic

It can compile packages, that would have made sense, but it didn't get that far.

Читать полностью…

Offtopic

htop was sorted by CPU usage, so I couldn't see. Just that nix, the process I started before it began, was consuming about 20G.

Читать полностью…

Offtopic

All cores were fully busy, but that was a side effect of the memory being full. As if was doing something special. But somehow I managed to get it full.

Читать полностью…

Offtopic

100%, there is something called Caching. When you first talk to the LLM, it needs to know everything about your project.

The context window size doesn't change when you change the model, but most of the context for the first LLM is already cached on the server. When the next LLM is called, the whole thing has to be sent again, and the LLM has to know the proper context.

This is why you see that the amount of tokens used for the newer model is much higher.

Читать полностью…

Offtopic

Maybe fair amount of token gets burned in the beginning

Читать полностью…

Offtopic

Or to say it politely, doesn’t work for me.

Читать полностью…

Offtopic

They should have compared Claude Code CLI with Claude Code in Cursor.

Читать полностью…

Offtopic

I see. And that makes sense.

Читать полностью…

Offtopic

No, not really... if you switch from one model to another, you have to send that new model all the context, while if you stick with a single model, it uses loads of cache.

Читать полностью…

Offtopic

I mean there's an overhead I'd assume, but it's not 5 times as much.

Читать полностью…

Offtopic

Which to the os looks like 16 cores.

Читать полностью…

Offtopic

And they all work together. The fact my cpu may sucks is another argument.

Читать полностью…

Offtopic

Matter of facts, I have 4 pcore and 8 ecore.

Читать полностью…

Offtopic

👋

Читать полностью…

Offtopic

repeating activities that lead to utilisation might have some insight. But it could be spontaneous 🤔

Читать полностью…

Offtopic

For a package manager, certainly.

Читать полностью…

Offtopic

That’s how we are. Makes sense totally

Читать полностью…

Offtopic

My computer crashed today. I was lucky enough to have been able to open htop before it stopped reacting completely.

Читать полностью…

Offtopic

To understand repo. It’s like complaints of diminishing returns is being improved

Читать полностью…

Offtopic

And cause it’s due to caching.

Читать полностью…

Offtopic

I’ve seen significant less token usage by Claude cli. Extension is useless.

Читать полностью…

Offtopic

Comparing Opus with GPT-5 isn't a fair comparison.

Читать полностью…

Offtopic

Token efficiency matters for cost. Independent testing found Claude Code uses 5.5x fewer tokens than Cursor for identical tasks. Claude Code (Opus) completed a benchmark task with 33K tokens and no errors. The Cursor agent (GPT-5) used 188K tokens and hit errors along the way. Fewer tokens means lower per-task cost even at higher subscription prices.

https://www.builder.io/blog/cursor-vs-claude-code

Читать полностью…

Offtopic

Claude models are good at coding so they gatekeep. No wonder. Their claims

Читать полностью…

Offtopic

It does not seem to be the case for vscode.

Читать полностью…
Subscribe to a channel