• 1 Post
  • 563 Comments
Joined 3 years ago
cake
Cake day: August 24th, 2023

help-circle





  • If anything i think the better comparison is you use more power watching TV or gaming than you probably will using AI in the day if you do either of those 2 things.

    The issue is training takes a lot of power, and because we can’t run the hardware locally our usage is also placed in these data centers which put pressure on a specific area instead of distributing the same power usage.

    I saw a post a couple days ago about a company etching the model weights into silicon chip and they made a 8b model that could do 16k t/s and once made are relatively cheap to produce, and in power requirements, and would only get better. Just need to make sure they can be recycled well as they’d end up on a 1 to 2 year cycle like phones. Model to chip in 60 days they said.

    So maybe that’s the future solution to distrubuted usage, but we would still need to solve training, but we could just mandate these datacenters must build their own renewable power and it would be less is everyone could run their own local inference.














  • I am kind of curious what the SpaceX / DoD deal was once the DoD finally took things over back in 2022 or 2023 or whenever it was. Did they just hand off all decision making of what is/isn’t allowed, or did they actually hand off some form of control that lets them manage things?

    It’s possible, but unlikely, that SpaceX is helping with the whitelist, but only the DoD can see it, or at least, only the DoD can see it in the simplistic form all laid out without having to do any extra work.

    But given the current government… that doesn’t really help in terms of leaks/hacks and the data being considered safe.