I’m personally not and I never will be, but I keep seeing on the news that a lot of people are actually becoming friends with their AI bots, trying to use them as substitutes to replace real human interaction. Kinda scary, kinda absurd. What is your take on this? And are you friends with a bot?
I’ve been curious about running LLMs locally. Mostly about how long it takes to return a response.
I mean, it depends on your hardware and the model’s size/intelligence.
Worst case for me is many seconds of preprocessing followed by 4-5 words a second.
But you can get almost instant responses + way faster than you can read too.