I hope open weights continue to gain traction for this reason too.
But injecting information into outputs is a little different than Claude keeping tabs internally. The point is that we do not know what information is being shipped with the fingerprint itself.
If you really care, a) use an open model or b) obscure your identity to Anthropic.
Otherwise, you're already vulnerable: Anthropic can silently record every change Claude makes to every codebase, maybe they already do.
I hope open weights continue to gain traction for this reason too.
But injecting information into outputs is a little different than Claude keeping tabs internally. The point is that we do not know what information is being shipped with the fingerprint itself.
Come now, this isn't about attack vectors, it's about you getting caught using LLMs where you shouldn't.
That's a philosophical question in itself. Where shouldn't you use it?
Exams, writing to your grandmother, surgery, ...