• 2 Posts
  • 92 Comments
Joined 2 年前
cake
Cake day: 2023年12月18日

help-circle

  • “They” is the copyright industry. The same people, who are suing AI companies for money, want the Internet Archive gone for more money.

    I share the fear that the copyrightists reach a happy compromise with the bigger AI companies and monopolize knowledge. But for now, AI companies are fighting for Fair Use. The Internet Archive is already benefitting from those precedents.







  • It’s a bit of a split among libertarians. Some very notable figures like Ayn Rand were strong believers in IP. In fact, Ayn Rand’s dogmas very much align with what is falsely represented as left-wing thought in the context of AI.

    It’s really irritating for me how much conservative capitalist ideals are passed off as left-wing. Like, attitudes on corporations channel Adam Smith. I think of myself as pragmatic and find that Smith or even Hayek had some good points (not Rand, though). But it’s absolutely grating how uneducated that all is. Worst of all, it makes me realize that for all the anti-capitalist rhetoric, the favored policies are all about making everything worse.



  • For fastest inference, you want to fit the entire model in VRAM. Plus, you need a few GB extra for context.

    Context means the text (+images, etc) it works on. That’s the chat log, in the case of a chatbot, plus any texts you might want summarized/translated/ask questions about.

    Models can be quantized, which is a kind of lossy compression. They get smaller but also dumber. As with JPGs, the quality loss is insignificant at first and absolutely worth it.

    Inference can be split between GPU and CPU, substituting VRAM with normal RAM. Makes it slower, but you’ll probably will still feel that it’s smooth.

    Basically, it’s all trade-offs between quality, context size, and speed.



  • It’s also funny how Lemmy is buying up this narrative.

    The entire US economy is currently being propped up by growth in the AI/tech sector.

    What’s happening is that Dementia Don is curb-stomping the US economy. AI investments, mainly in data centers, are the only thing that still seems promising. When you are on a trek and someone leads you through Death Valley, while pouring out all the water, you shouldn’t blame the last horse that still keeps going.

    Putting the blame in the right place would certainly help, with a view toward the mid-terms.

    Financially: Diversify. Make sure that you are not completely dependent on what happens in the US. But mind that Europe comes with its own imponderable risks (ie Putin). Same with China. Maybe some old leader dies and the new crew runs everything into the ground; they go to war with Taiwan, that sort of thing.


  • I agree with everything. The thing is, I’ve been thinking about the psychology behind this lately.

    When Fedi-Fans complain about Bluesky, it is usually based on the misunderstanding that it also is instance based. It really doesn’t seem to occur to many that things might be done differently. But I think it may go a little deeper.

    A common complaint is that it’s too expensive to run a full relay. People want to self-host it all. They want to feel that they are in control and don’t need anyone. It’s not particularly rational but people do lots of silly things chasing that feeling. The rational start would be to move somewhere remote and grow your own food. Instead, people buy a pick-up truck or degoogle their phone.

    That architecture also appeals to a more tribal mindset. An instance is “our” place. We just pull up the drawbridge when bad people come and we are safe here in “our” castle.

    I think to some people that is more appealing than the more open design of atproto.

    On Bluesky, there is all this waffle about some people trying to get someone banned. They might find such tribal architecture more appealing.





  • Yes, but that doesn’t seem sufficient for some. Conservatives certainly would like to remove trans people from the public completely. Aside: It’s foolish for trans people to copy these tactics, assuming this comes organically from the trans community. These people are certainly acting like the heels in some right-wing propaganda play.

    Bluesky offers several ways in which users can remove unwanted content from their experience. Easiest is for users to block Singal; banning him from their personal part of the network. Blocklists can be shared easily. Users can also spin up their own moderation service.

    I probably shouldn’t go into the details of what Bluesky can do on a technical level. Incidentally, that blog post contains errors.

    In short: On a technical level, the Bluesky company can greatly reduce the visibility of someone. But they would likely run into legal problems if they used that on Singal. The EU regulates what can be done quite strictly. Maybe they could benefit from some industry friendly “loopholes”. I’d have to look that up.


  • That needs a longer explanation.

    An instance does not interact with all other instances. It only syncs with other instances when users follow someone there, join a community, …

    But that’s also a problem. It means you can’t search the entire Fediverse from a particular instance and find new and interesting discussions and people. There is no discovery feed. For that, you need something like Bluesky’s relay. That relay actually does keep up with what everyone is posting and archives it.

    But that’s one aspect of Bluesky that draws a lot of criticism by Fedi people. A full relay is expensive to run and not something anyone can self-host. Pruned down versions are doable, though. If everyone actually did run their own relay, then one would get you the combinatorial problem.

    In practice, large instances are the Fediverse solution to the discovery problem. You can see what the many users on that instance post. Also, the many users subscribe to many things and so a large instance will cache much content from elsewhere. That architecture encourages centralization.

    There’s other difficult issues. So you have a little server that serves your content to a few followers. Some celebrity with millions of followers would have to rent an entire server rack. But what if little old you interacts with a celeb and now all their followers try to fetch your content from your little server? Common problem. You just need caching. EG the celebrity rack also serves your content to their followers and takes the load off your server. But now whoever is doing the caching can also filter replies. There’s no simply solution there.