r/technology • u/Miserable_Phase_2519 • 14h ago

Artificial Intelligence Florida woman used Claude as a diary, then Anthropic reported an entry to police

https://www.techspot.com/news/114091-florida-woman-used-claude-diary-anthropic-reported-shoot.html
13.5k Upvotes

97% Upvoted

1.4k comments sorted by

View all comments

29

u/Grand0rk 13h ago

Yeah, no shit. If you tell an AI you are going to commit a crime, it's flagged, reviewed and reported.

How fucking stupid can you be?

1

u/oldgus 9h ago

I mean, it would be great if that were always the case, but tragically it isn’t.

1

u/ilikepizza30 10h ago

Maybe she had a prompt months ago that said 'You are my diary bot. I'm going to tell you, among other things, items that I have fantasies of doing but would never do.' Then, months later, this one 'entry' is taken out of context. You can't be flagging a single entry without reviewing the ENTIRE chat history with the bot because it could be a fantasy diary, for a game, book, movie, testing the limits of the bot, etc.

5

u/Grand0rk 10h ago

Brother, the AI didn't fucking report her to the police. It was a person that reviewed it.

Also, I know you have absolutely 0 idea how chat bots work. Especially Claude. There's a hard cap at how much you can use a single chat, before they tell you to start a new thread.

2

u/ilikepizza30 6h ago

Brother, the AI didn't fucking report her to the police. It was a person that reviewed it.

That's my point... a person read ONE prompt of an entire conversation and without the CONTEXT of the WHOLE conversation they could not possibly determine if it was a real threat or not.

2

u/Grand0rk 5h ago

That's not what happened. They read the full thing and reported the FULL CHAT to the police dude.

1

u/ThatGuyBackThere280 6h ago

That's my point... a person read ONE prompt of an entire conversation and without the CONTEXT of the WHOLE conversation they could not possibly determine if it was a real threat or not.

You just stated under assumption that they only had that snippet and said "WELP I GOTTA FULL SEND IT", when they have the ENTIRE LOG, where they already have the entire conversation?

1

u/ilikepizza30 4h ago

Yes, I'm operating under the assumption, as someone who has actually done these kinds of jobs, that they only saw and acted on the most recent prompt and did not have access to prior prompts, nor would they have the time to read those prior prompts if they did have access.