r/technology • u/Miserable_Phase_2519 • 14h ago

Artificial Intelligence Florida woman used Claude as a diary, then Anthropic reported an entry to police

https://www.techspot.com/news/114091-florida-woman-used-claude-diary-anthropic-reported-shoot.html
13.5k Upvotes

97% Upvoted

1.4k comments sorted by

View all comments

Show parent comments

14

u/shield1123 11h ago

You need a pretty beefy GPU and a lot of RAM to get something decent running

-7

u/CookIndependent6251 10h ago

I think I read it's close to 2 TB of VRAM for high quality open models.

2

u/12345623567 9h ago

That's for frontier models. To run something like Deepseek v4, 32GB VRAM is enough, which is sufficiently small for single-GPU consumer hardware.

It'll still cost you 6-10k for the full system, obviously. Go cheaper and running decent models becomes a pain (though possible).

3

u/spiteful_rr_dm_TA 8h ago

I have Cydonia 24B Q3_K_M running on a local machine that runs perfectly fine on a build with:

-CPU: AMD Ryzen 5 1600 ($180)

-GPU: GIGABYTE Radeon™ RX 9060 XT ($800)

-RAM: 32GB ($200-$300)

-Storage: 256GB SSD ($50)

So honestly you can get away with much cheaper. For something like coding it probably isn't be enough, but for using it as a diary? This works just fine, and runs about 1500-1800 without issue. Honestly my regular RAM is enough that I can also run game servers off of it like Palworld or Zomboid.

EDIT: But this is also a separate dedicated machine I connect to over LAN. Running things on it like gaming or coding directly might be too much for the system.

1

u/pandemicpunk 3h ago

Where are you getting RAM and SSDs that cheap? Lmfaooo

1

u/spiteful_rr_dm_TA 2h ago

RAM is that cheap if you go DDR4, which is fine for a low end diary AI machine. And just googling a 256GB SSD shows them in the 30-60 range depending on the manufacturer

1

u/Dom1252 8h ago

It's terabytes if you want to train a model, if you want to use a model you need tens of gigabytes... There are ok models that fit 12GB and some decent ones you can run with 16, but for really good models with context you need ideally 70+

But a lot of people would be ok with a "decent" model and don't need the big ones

1

u/shield1123 7h ago

You can get a decent agent running with two orders of magnitude less than that