Bernie Sanders proposes 20 year prison sentence for AI devs who plow ahead with Artificial Superintelligence plans - penalty on par with illegally developing rogue nuclear weapons

[u/ArgentineBeauty]

https://www.tomshardware.com/tech-industry/artificial-intelligence/sanders-proposes-20-year-prison-sentence-for-ai-devs-who-plow-ahead-with-artificial-superintelligence-plans-penalty-on-par-with-illegally-developing-rogue-nuclear-weapons

[u/arcbe]

AI can't live up to the hype, but you can absolutely make the case that these companies believe they are building a weapon of mass destruction. The crime is the attempt not whether they can succeed.

[u/JPuree → u/arcbe]

If you truly believe they never could succeed, it becomes a lot like:

Threatening to jail a child for attempting to build a gun out of popsicle sticks

[u/arcbe → u/JPuree]

Or it's like attempted robbery. These aren't children, they're high profile CEOs.

[u/Working-Permission84 → u/JPuree]

Or a better analogy: Threatening to jail a madman for attempting to build a nuclear weapon. He's not going to succeed, but the IED he does manage to cobble together and set off will still kill people.

But you're also underestimating current development if you think super-intelligence is an impossibility. AI is improving very rapidly and has not slowed down since it kicked off a few years ago. And now that the agents can code reasonably well, we're in the recursive improvement phase, where AI is used to make better tools to make the next version of the AI quicker and better, and that AI is used to make even better tools, and so on. It's an exponential curve.

If we get to the point where we can remove the human from the loop entirely and have AI recursively improve itself, we'll go from several months between improved models, to days or even hours. At that point, we would have to simply hope that there's some fundamental limit preventing it from greatly exceeding a human's intelligence - but there's no logical/mathematical/physical basis by which we can actually know that.

[u/WTWIV → u/arcbe]

Don’t underestimate the steady, inevitable march of technological innovations.

[u/arcbe → u/WTWIV]

What exactly do you think I'm underestimating?

[u/WTWIV → u/arcbe]

I probably just misunderstood what you meant by “AI can’t live up to the hype” my bad

[u/arcbe → u/WTWIV]

I just mean that LLMs aren't going to achieve superintelligence and become an existential threat.

[u/blueSGL → u/arcbe]

Well we've gone from AI's that can't do math laughing about "they made a computer that can't count the number of 'R's in strawberry"

to Fields medal winners complaining that (paraphrased) "AI's solving long standing math conjectures and providing LEAN proofs is not helping the field of math, because there is non of the 'digestion' that normally happens when humans are working towards solutions"

What is the least impressive thing you are saying an AI system won't be able to do?

[u/arcbe → u/blueSGL]

AI still can't do math, they just gave it the ability to pull out a calculator and do a google search. Yeah, I'm not buying this story about OpenAI solving the Navier Stokes problem because they have a history of plagiarism.

[u/arcbe → u/[deleted]]

Yeah, sure, if you just ignore all the human ingenuity it's fed in training, then chatgpt can solve things with no human ingenuity. It's not searching literature, it's remembering what's trained on. It's impressive how far you can get with just that, but that is all neural nets are capable of.

[u/blueSGL → u/arcbe]

to pull out a calculator and do a google search.

That's not how long standing math problems get solved.

OpenAI solving the Navier Stokes problem because they have a history of plagiarism.

So the theory is that suddenly there has been something else (non AI) happening and long standing math proofs are just falling... and AI companies are swooping in to take the credit.

https://vibemathed.com/stats

What is the other thing that has suddenly made people so much better than math if not AI?

[u/arcbe → u/blueSGL]

Yep, that's the MO of generative AI companies. They steal data, feed it to their AI, and claim credit when it regurgitates it. I'm sure it can help math research, but to claim that AI is pushing research beyond human limits is an extraordinary claim and I have not seen any extraordinary proof.

[u/blueSGL → u/arcbe]

I have not seen any extraordinary proof.

Every one of those dots on that website I linked leads to the source of the information.

https://vibemathed.com/stats#significance-vs-age be sure to filter by "discovered"

[u/idiosyncratic190 → u/arcbe]

Maybe not, but it is possible that LLMs eventually help humans design a better AI system and that may pave the way for superintelligence. Or maybe the LLM side is just one part of advanced AI the same way our brains have many parts that function together.

[u/arcbe → u/idiosyncratic190]

At that point it's not an LLM anymore.

[u/idiosyncratic190 → u/arcbe]

Sure, but that’s beside the point your comments were making. The risk is still there and it just seemed like you were downplaying it simply because the current iterations of LLMs have limitations.

[u/arcbe → u/idiosyncratic190]

I'm downplaying it because it's not present. The limitations are fundamental. It would take some crazy breakthroughs to approach superintelligence so it's not worth worrying about right now. We don't even know what that breakthrough would look like let alone what it would imply.

[u/Working-Permission84 → u/arcbe]

An LLM is just an interface to an artificial neural network. If you think the current models are just fancy chatbots or text predictors, you haven't been keeping up.

[u/WTWIV → u/arcbe]

Oh for sure, I mean LLMs aren’t actually true AI.

[u/WTWIV → u/[deleted]]

I mean, sure, there isn’t really a consensus on how you would truly define it, so until we can come up with that, we can’t say what really does or doesn’t constitute true AI. I personally think self awareness should be part of the discussion when it comes to machine intelligence. But at some point, humanity needs to figure this part out.

[u/SR520 → u/arcbe]

The goal is to make mass production not destruction.

[u/arcbe → u/SR520]

With how eager these companies are to brag about ruining people's careers, I'm not so sure about that.