Viewing profile — bytefactory

I had long been of the opinion that local models were a long way away from being useful, and that they were toys at best. I'm a heavy user of o3/GPT5, Claude Opus/Sonnet and Gemini…

Can you clarify my understanding as a layman please? Are you saying that LLMs hold concepts in latent space (weights?), but the actual predictions are always in tokens (thus ineffi…

> I think AGI, if possible, will require a architecture that runs continuously and 'experiences' time passing Then you'll be happy to know that this is exactly what DeepMind/Google…

Ah, should have probably googled before asking. Thanks!

How did you get access to Gemini 1.5, I thought it wasn't available for general access yet?

> I think that insight is an important feature that GPT doesn't seem to have, at least not yet. I actually think this is a limitation of the RLHF that GPT has been put through. Wit…

Completely agree. The System 1/System 2 distinction seems relevant here. As powerful as transformers are with just next-token generation and context, which can be hacked to form a …

This doesn't seem like a major difference, since LLMs are also choosing from a probability distribution of tokens for the most likely one, which is why they respond a token at a ti…

> It doesn't necessarily have to look ahead. Since Go is a deterministic game there is always a best move Is there really a difference between the two? If a certain move shapes the…

It's interesting how this is not presumably the case within the weights of the LLM itself. Those probably encode data as well as logic!

Interesting. I like your idea in one of your posts of separating out system prompts and user inputs. Seems promising.

A GPT-4 powered assistant for Android would be a game changer

Thanks for the links, I'll give them a read. For my understanding, why is not possible to pre-emptively give LLMs instructions higher in priority than whatever comes from user inpu…

Apparently they just did exactly that. New accounts will start being charged $1/year.

Isn't that precisely what Threads did?

I was curious about this, and it seems like people have already created drop-in cosmetic uBO filters for Substack: https://ronitray.xyz/writing/clean-substack/ I haven't really loo…

> And that shirt with the name of the last race you ran? Yeah, fancy t-shirt, i. e., underwear. looks at Spartan race t-shirt from 2014 I use as my gym shirt No need to call me out…

Why....why were you running in your underwear?

I think about this very often. It's also so strange that these proto-AIs feel so organic and flawed in their operation. I've always thought that computers would be perfect, but lim…

I have a few times, but I'm not always diligent. I'll keep an eye out next time!

> Remote desktop, hyperv, windows sandbox, windows containers None of this is particularly enticing to me personally, I think I'll be scratching my virtualization itch with linux o…

I'm on Windows 11 Home and Windows 11 Pro for $39 on stacksocial is tempting. Other than Bitlocker and the ability to create local accounts, does Pro have anything particularly not…

I have "Cite sources whenever possible, and include URLs if possible (at the end of the answer, not inline)" in my custom instructions and nearly always get citations from chatGPT.…

I think the browsing mode should negate the need for those now?

Neat app and very cool idea. I guess I'll have to figure out how to get Samantha running on Windows. Thanks!