r/technology • u/ArgentineBeauty • 12d ago

Artificial Intelligence Engineer says Claude Code has made his job "soul-sucking" as workers spend 12-hour days pressing enter

https://www.techspot.com/news/113937-engineer-claude-code-has-made-job-soul-sucking.html
17.6k Upvotes

93% Upvoted

1.4k comments sorted by

View all comments

Show parent comments

19

u/DustyRacoonDad 12d ago

Everything put on Github or any other similar site alone is more than enough training data.

2

u/coconutpiecrust 12d ago

But, like, LLMs trained in trash code will produce trash code, no? If they are any good, where’d they get high volumes of decent code?..

6

u/new_name_who_dis_ 12d ago

There's a lot of high quality code on github. Especially if you filter by stars or number of contributors.

2

u/OHNOitsNICHOLAS 12d ago

These things don't learn in such simple terms - you can learn how to do something right by taking in enough information about how to do it poorly/wrong, and this technology can also present emergent intelligent behavior like that as well.

1

u/coconutpiecrust 12d ago

They can train LLMs on how to do things wrong without showing it how to do things right? 

I feel like LLM companies always search for high quality training data, though. 

1

u/OHNOitsNICHOLAS 12d ago

they can kind of infer how to do something based on the knowledge they have - and even if they make a wrong assumption you can oftentimes guide them in the right direction even with just a good guess.

it's not necessarily true of all models though. Generally larger models will have more emergent behavior or understanding because they just contain more knowledge in their weights to work from.

It's honestly all really interesting if you dive into it. But the irresponsible pace of development, lack of regulations, theft of content required to train them.. it shouldn't have emerged this way.