W^Unt!2

I wonder what an ELI5 version of ‘stored weights’ would be in this context.

Edit: i see now it’s an article and not just you asking a question lol. I’ll leave it up anyway.

You know when your typing on your phone and you have that bar above the keyboard showing you what word it thinks you are writing? If you click the word before you finish typing it, it can even show you the word it thinks you are going to write next. Gpt works the same way, it just has waaaay more data that it can sample from.

It’s all just very advanced predictive text algorithms.

Ask it a question about basketball. It looks through all documents it can find about basketball and sees often they reference, hoops, Michael Jordan, sneakers, NBA ect. And just outputs things that are highly referenced in a structure that makes grammatical sense.

For instance, if you had the word ‘basketball’ it knows it’s very unlikely for the word before it to be ‘radish’ and it’s more likely to be a word like ‘the’ or ‘play’ so it just strings it together logically.

That’s the basics anyway.

It’s actually more dangerous than that. They want to be the music distributor also. Yes, they are currently separate subscriptions, but with enshitification you know they’re going to link them into 1 package eventually, meaning if you want to stop 1 you’ll lose the other.

An example of that would be, you(the artist) find a new Patreon kinda thing that takes less of a cut so you want to move there, but because winamp are also your distributor if you decide you want to leave, they’ll also cancel your distribution removing all your music off of online platforms like Spotify. It’s a seriously dangerous path to take as an artist.

They are not the llama we once knew. This one I think is a wolf in llama skin.

I’d love to be proven wrong.

It’s funny how individually we can do the right thing but together is a whole other beast.

Its a trap. The best way to fight reddit is to not even engage. Imagine r/place was left blank because no one was there.