Good pitch. You could also ask people to help out with the more expensive computations. Say, adding alt text.

In the client, you wouldn’t need to be sorting and running extensive calculations on all data. You could, e.g, build the front-page by indexing/scoring posts and comments that have been created since your last visit with a hard cap on some time window (last 48h) or total data points (e.g, keep only the most recent 10k objects in a local hot database, freeze/archive everyhing else.)

Absolutely. There’s a lot you can do. The “For You” Feed on Bluesky is quite instructive. https://bsky.app/profile/spacecowboy17.bsky.social/post/3mb2r5qei322a

But when you’re talking about sending a lot more data to clients, you really need to consider what that means for the internet bill of instance owners.

Embrace content sorting and filtering algorithms, but on the client side, with optional control by the user.

You can only filter and sort what was downloaded by the client. So that runs into resource constraints.

Standardize tags on all content. So many of the different ways different platforms classify or organize content can be implemented as tags, which increases interoperability between them.

I’m so with you. https://xkcd.com/927/

Transferable user identity (between instances)

User identity and authentication as separate service from social network instance

That’s more the ATproto/Bluesky vision.

Yeah, one would think so. And those were the hobbyists that Gates was addressing in that open letter.

“They” is the copyright industry. The same people, who are suing AI companies for money, want the Internet Archive gone for more money.

I share the fear that the copyrightists reach a happy compromise with the bigger AI companies and monopolize knowledge. But for now, AI companies are fighting for Fair Use. The Internet Archive is already benefitting from those precedents.

In the US, copyright is limited by Fair Use. It is still IP. Eventually, you’d just be changing how Fair Use works. Not all for the better, I think.

Maybe one could compare it to a right of way over someone’s physical property. The public may use it for a certain purpose, in a limited way, which lowers its value. But what value it has, belongs to the owner.

What kind of person owned a computer as a hobby in 1976?

That’s true in the same way that Trump’s tariffs are paid by other countries. Which is to say: Not at all.

Bill Gates was no billionaire at the time. His background was probably shared by almost all computer hobbyists at the time.

“Property is theft.”

the caveats that commercializing someone else’s work or taking credit for someone else’s work should be illegal.

So, not actually abolishing IP, then.

It’s a bit of a split among libertarians. Some very notable figures like Ayn Rand were strong believers in IP. In fact, Ayn Rand’s dogmas very much align with what is falsely represented as left-wing thought in the context of AI.

It’s really irritating for me how much conservative capitalist ideals are passed off as left-wing. Like, attitudes on corporations channel Adam Smith. I think of myself as pragmatic and find that Smith or even Hayek had some good points (not Rand, though). But it’s absolutely grating how uneducated that all is. Worst of all, it makes me realize that for all the anti-capitalist rhetoric, the favored policies are all about making everything worse.

I really don’t get how opinions on intellectual property and its “theft” turn 180 whenever AI is mentioned.

I find it very unexpected. It used to be understood that IP laws favor monopolies. EG I don’t remember the OS community being on the side of Oracle in https://en.wikipedia.org/wiki/Google_LLC_v._Oracle_America,_Inc.

Maybe it just passed me by.

For fastest inference, you want to fit the entire model in VRAM. Plus, you need a few GB extra for context.

Context means the text (+images, etc) it works on. That’s the chat log, in the case of a chatbot, plus any texts you might want summarized/translated/ask questions about.

Models can be quantized, which is a kind of lossy compression. They get smaller but also dumber. As with JPGs, the quality loss is insignificant at first and absolutely worth it.

Inference can be split between GPU and CPU, substituting VRAM with normal RAM. Makes it slower, but you’ll probably will still feel that it’s smooth.

Basically, it’s all trade-offs between quality, context size, and speed.

Translation:

For when you have to move fast

The Böcker Agilo transports your up to 400 kg heavy treasures at 42 m/min - whisper quiet thanks to a 230 V electric motor.

It’s also funny how Lemmy is buying up this narrative.

The entire US economy is currently being propped up by growth in the AI/tech sector.

What’s happening is that Dementia Don is curb-stomping the US economy. AI investments, mainly in data centers, are the only thing that still seems promising. When you are on a trek and someone leads you through Death Valley, while pouring out all the water, you shouldn’t blame the last horse that still keeps going.

Putting the blame in the right place would certainly help, with a view toward the mid-terms.

Financially: Diversify. Make sure that you are not completely dependent on what happens in the US. But mind that Europe comes with its own imponderable risks (ie Putin). Same with China. Maybe some old leader dies and the new crew runs everything into the ground; they go to war with Taiwan, that sort of thing.

I agree with everything. The thing is, I’ve been thinking about the psychology behind this lately.

When Fedi-Fans complain about Bluesky, it is usually based on the misunderstanding that it also is instance based. It really doesn’t seem to occur to many that things might be done differently. But I think it may go a little deeper.

A common complaint is that it’s too expensive to run a full relay. People want to self-host it all. They want to feel that they are in control and don’t need anyone. It’s not particularly rational but people do lots of silly things chasing that feeling. The rational start would be to move somewhere remote and grow your own food. Instead, people buy a pick-up truck or degoogle their phone.

That architecture also appeals to a more tribal mindset. An instance is “our” place. We just pull up the drawbridge when bad people come and we are safe here in “our” castle.

I think to some people that is more appealing than the more open design of atproto.

On Bluesky, there is all this waffle about some people trying to get someone banned. They might find such tribal architecture more appealing.

I’d argue that the modular design is a more radical approach to decentralization.

Yes, but only if you can do without instances. Instances seem to be important to many in the Fediverse.

I realize my title has little to do with the post

I was going to say. Red dwarf is the name of a ship and Constellation is a class of ship. In any case, you can’t have a proper ship without a bridge.