Its an interesting field! I think the reason we have not gone there is the LLM specific models all have very different models/languages/etc… right now. So the algorithms that create them and use them need flexibility. GPUs are very flexible with what they can do with multiprocessing.

But in 5 years (or less) time, I can see a black box kinda system that can run 1000x+ speed that will make GPU LLMs obsolete. All the new GPU farm places that are popping up will have a rude awakening lol.

I wonder how much we really need for a clock (555 eq) to work?

Meh I like some of the others on hugging face a bit more for coding and such. But its all the same at the end of the day. I do like what you are saying though!

Models + moderate power should be what we strive for. I’m hoping for a star trek ending where we live in a post scarcity world. Im planing on a post apocalypse haha.

Once ASIC chips come out (essentially a specific model on a chip) the amount of power we use will be dramatically less.

Yep you can run models without giving $$ to tech billionaires!

Now we are giving it to the power billionaires! unless you own your own power sources.

Yeah best we have right now is subscribing to the lemmy/piefed communities like /c/peertube and seeing what you like. For better or for worse, there is no algorithm. Moreso in peertube than others.

Yep that would be nice! Yunohost can make it pretty easy to install for those of us who self host. Plus this is the fediverse. Totally agree!

Thats a good question.

Users are still able to see their videos, it just does not create a local copy unless you enable that on your server. Its just a pass-though.

EX:

• https://videos.abnormalbeings.space/w/k7oGP4hkGWMx2oJxpw6KUd which is being passed though
• https://video.canadiancivil.com/videos/watch/9ac216ba-1a55-4ca9-9e6e-574f53a92ba8 original server.

You can see that more clearly here:

And here is my subscriptions (looks and functions identical to Youtubes subscriptions):

But the videos are on their respective servers.

Federation still occurs (and admins can be very specific if they want):

Hope that makes sense!

Newest version of lemmy fixed this quite well. Take a look: https://lemmy.world/post/27751672

Old lemmy broke a lot of activityhub stuff unfortunately.

I dont think its ok to just rip peoples content without their permission.

The server itself has the option to turn that off or on. And most dont turn that on. Its off by default.

Source: I host a peertube instance.

Same people that pay for lemmy. Us.

It doesn’t take much to host peertube TBH. And with each peertube instance, the videos get easier to host. It scales very well with the current iteration of software.

The two biggest issues are actually not software related:

1. A platform is only as good as its users (creators and users who interact). Peertube has the issue that its not very popular, so creators have to really plug their stuff.
2. Its not profitable for creators UNLESS they add a way to monetize. Some argue that with secondary sources such as patreon, its not an issue, But I just don’t see it.

Im pretty happy with what it does NOW. I like the ability to post my videos and get comments without getting flagged for whatever on Youtube. I like my friends and family (and sometimes us weirdos) looking at my videos. And I like the slow trickle of people hosting their videos on say makertube, peertube.wtf, and other such platforms. They seem like really fun individuals and im having a blast.

/c/peertube@lemmy.world

There’s a couple Lemmy communies out there where we showcase different channels.

https://lemmy.world/c/peertube

Check out top for a decent selection. It’s a somewhat new community but we are growing fast. It’s federated and has some hidden gems from people. Has a very early YouTube feel.

I’m already seeing some huge increases on ic chips online here…

Ive tried a couple of times, ended up bricking a phone and had to re-do another. Linux phones are hard to get set up (for certain models).

Yeah its VERY expensive and only useful for a very niche setup. But its cool we can have options like this in the first place.

I disagree about how it used to be easy. And agree with everything else.

Ive used Windows since the 3.1 days (MSDOS as well?). Its never been “easy”. You just learn the magic spells on how to fix a printer, get the right drivers installed in JUST the right way, or which hardware magically doesn’t work for some reason and avoid it.

With Linux, at least we get good logs most of the time.

I know some of the issue is the manuals themselves are out of date. Ive literally had to have something explained to me via the developers Discord. I hate going to a projects Discord in order to find out crucial info.

Sometimes manuals are in 5 different places so you don’t know what applies to your specific system.

I usually try and improve the manuals when I do come across this with a quick PR, when I have time.

I’m not sure if the hard requirement of using openai is good for an open source projects. It requires a somewhat hidden closed source source for the main functionality.

Unfortunately it’s sold out. In fact it was only available for a very small amount of time.

Yep I got one too. Works great and self hosted. I swear its actually faster than GH is nowadays.

And I like that it doesn’t try to advertise and recommend a ton of repos to do you like GH does now.