This genuinely made me do an IRL spit take, holy shit.

Same, but they did set up a self hosted instance for us to use and, tbh, it works pretty good.

I think it’s s good tool specifically for helping when you dunno what’s going on, to help with brainstorming or exploring different solutions. Getting recommended names of tools, finding out “how do other people solve this”, generating documentation, etc

But for very straightforward tasks where you already know what you are doing, it’s not helpful, you already know what code you are going to write anyways.

Right tool for the right job.

Humans are “trained” with maybe ten thousand “tokens” per day

Uhhh… you may wanna rerun those numbers.

It’s waaaaaaaay more than that lol.

and take only a couple dozen watts for even the most complex thinking

Mate’s literally got smoke coming out if his ears lol.

A single Wh is 860 calories…

I think you either have no idea wtf you are talking about, or your just made up a bunch of extremely wrong numbers to try and look smart.

1. Humans will encounter hundreds of thousands of tokens per day, ramping up to millions in school.

2. An human, by my estimate, has burned about 13,000 Wh by the time they reach adulthood. Maybe more depending in activity levels.

3. While yes, an AI costs substantially more Wh, it also is done in weeks so it’s obviously going to be way less energy efficient due to the exponential laws of resistance. If we grew a functional human in like 2 months it’d prolly require way WAY more than 13,000 Wh during the process for similiar reasons.

4. Once trained, a single model can be duplicated infinitely. So it’d be more fair to compare how much millions of people cost to raise, compared to a single model to be trained. Because once trained, you can now make millions of copies of it…

5. Operating costs are continuing to go down and down and down. Diffusion based text generation just made another huge leap forward, reporting around a twenty times efficiency increase over traditional gpt style LLMs. Improvements like this are coming out every month.

We are having massive exponential increases in output with all sorts of innovations, every few weeks another big step forward happens

https://youtu.be/d4tMzagjXrI