r/technology • u/Miserable_Phase_2519 • 14h ago

Artificial Intelligence Florida woman used Claude as a diary, then Anthropic reported an entry to police

https://www.techspot.com/news/114091-florida-woman-used-claude-diary-anthropic-reported-shoot.html
13.5k Upvotes

97% Upvoted

1.4k comments sorted by

View all comments

Show parent comments

7

u/Bacardi_Tarzan 6h ago

the anti AI Reddit crowd is dogmatic, but anyone who hasn’t twisted their brain into a pretzel trying to feel self-righteous about AI would understand that an AI company should be responsible for and attempt to prevent someone from using their product to more efficiently do serious crimes like murder.

-1

u/DrakontisAraptikos 5h ago

Two wrongs can be a wrong without making a right. A person shouldn't be making violent threats, but it can set a concern when a company can inspect your logs and report you for things not said in a "public forum." All sorts of things that can be written for the sake of venting or for fiction could also trigger something along these lines. None of this absolves the woman from any legal concern now that it's been brought up, but I think it should be a concern for everyone especially as AI features are folded into more and more applications. How soon until writing a school essay about the causes of Columbine results in a child getting flagged by Microsoft and recommended for arrest? Surveillance is something everyone should be concerned with. 

1

u/Bacardi_Tarzan 5h ago

Slippery slope, my dude. You’re assuming that will be a real problem when there’s not really a sign it will be. A human reviewing an essay about the Columbine Shooting would very clearly understand it is an essay, and we don’t have any evidence to suggest that stuff like this is getting false positives. 

1

u/DrakontisAraptikos 4h ago

That gal who got picked up from an entirely different state due to being "identified" as a suspect. AI doesn't think, it just exists off of matching probabilities. The goal often becomes eliminating the human element entirely. So while a human may not make that linguistic jump, an LLM will and won't have the same wisdom. Even with a human in the chair it doesn't mean they won't just forward off the recommendation because they're lazy or tired or just don't give a fuck for any myriad of reasons. We are seeing all sorts of "firsts" with this technology and they should all be approaching with a hefty amount of caution and apprehension lest these things become our new normals.