r/technology • u/Miserable_Phase_2519 • 14h ago

Artificial Intelligence Florida woman used Claude as a diary, then Anthropic reported an entry to police

https://www.techspot.com/news/114091-florida-woman-used-claude-diary-anthropic-reported-shoot.html
13.5k Upvotes

97% Upvoted

1.4k comments sorted by

View all comments

Show parent comments

238

u/Marcoscb 13h ago

The point is they shouldn't be aware.

But they are. So either they aren't allowed to know what you write and are then not responsible for it, or they are and they should be responsible. The point is that they don't get both the benefits of knowing everything you write and not being responsible for anything.

63

u/TrulyOutrageous42 13h ago

Absolutely, I think the overarching argument is that they should NOT be aware of what we're writing when it explicitly states it's not using the data to train models. That rather clearly implies it's not reading or saving or sending it beyond the instance, but it is.

30

u/THEBAESGOD 12h ago

When you use our services for individuals, such as ChatGPT and Codex, we may use your content to train our models. You can choose whether your conversations help improve our models. To opt out, turn off Improve the model for everyone under Settings > Data controls in ChatGPT, or select Do not train on my content in our Privacy Portal.

Claude is Opt-In but it says it’ll save your data and use it for training if “ Your conversations are flagged for safety review (in which case we may use or analyze them to improve our ability to detect and enforce our Usage Policy…”

1

u/Piranata 11h ago

It should be more direct, like the error you receive in Linux when you try to use sudo when you're not in the sudoer list: "This topic violates our Usage Policy, this incident will be reported".

1

u/IrregularPackage 7h ago

oh, so it’s not opt-in at all.

5

u/MovieTrawler 11h ago

Yep, they've opened Pandora' Box by reading, analyzing, storing and selling our private data. You can't do that and then cherry pick what you see.

1

u/slfnflctd 10h ago

This right here.

But we have been long past this discussion for at least a dozen years. Ever since Snowden and the collective yawn which followed, it has been over. Really since the 'patriot act', but that's what laid the groundwork for the inescapable surveillance we're under now.

There are so many incentives for data gathering at this point, it's nuts... the scales have been tipped against users for a long time. It is vanishingly rare to find an organization which provides full transparency of exactly how they handle your data, along with a clear pathway to total obfuscation/deletion. The increasing reach of law enforcement is most of the reason why.

I agree with your last sentence so much, I just don't know what can be done about it, especially with the whole Section 230 thing. It deserves more discussion, though, for sure.