Paper by,
Simon Lermen, Daniel Paleka, Joshua Swanson, Michael Aerni, Nicholas Carlini, Florian Tramèr
It talks about deanonymizing those who writes under a pseudonym. Sites like reddit, lemmy would be that type.
From the paper,
Given two databases of pseudonymous individuals, each containing unstructured text written by or about that individual, we implement a scalable attack pipeline that uses LLMs to: (1) extract identity-relevant features, (2) search for candidate matches via semantic embeddings, and (3) reason over top candidates to verify matches and reduce false positives.Our results show that the practical obscurity protecting pseudonymous users online no longer holds and that threat models for online privacy need to be reconsidered.
They can match writing styles, interests, details to infer a job or city, or other unstructured information. That allows to match unrelated pseudonyms to the same person. Like, FooFighterGroupie and Yolanda43905 are the same human, despite they neve
... Show more...Paper by,
Simon Lermen, Daniel Paleka, Joshua Swanson, Michael Aerni, Nicholas Carlini, Florian Tramèr
It talks about deanonymizing those who writes under a pseudonym. Sites like reddit, lemmy would be that type.
From the paper,
Given two databases of pseudonymous individuals, each containing unstructured text written by or about that individual, we implement a scalable attack pipeline that uses LLMs to: (1) extract identity-relevant features, (2) search for candidate matches via semantic embeddings, and (3) reason over top candidates to verify matches and reduce false positives.Our results show that the practical obscurity protecting pseudonymous users online no longer holds and that threat models for online privacy need to be reconsidered.
They can match writing styles, interests, details to infer a job or city, or other unstructured information. That allows to match unrelated pseudonyms to the same person. Like, FooFighterGroupie and Yolanda43905 are the same human, despite they never said it. It can allow also, to match a pseudonym to a real identity across sites. Like someone posted on LinkedIn with a real name. It takes less info than most people expect, to figure out Julia Greenberg of Cedarville, NH is FooFighterGroupie.
You can protect yourself by never giving away much info. But ofc sometimes that's the whole point! Think talking about specific hobbies or w/e, gives away info. Also change up writing styles + vocab use, b/c it is a unique fingerprint.
I doubt this technique is used in a dragnet way... YET! But no reason it can't scale, if the cost of resources goes low eonugh. We could eventually see it become standard, analysis to link people across sites and identities.

We show that large language models can be used to perform at-scale deanonymization. With full Internet access, our agent can re-identify Hacker News users and Anthropic Interviewer participants at high precision, given pseudonymous online profiles an…
arXiv.org
PolarKraken
in reply to FineCoatMummy • • •astraeus
in reply to FineCoatMummy • • •grey_maniac
in reply to astraeus • • •astraeus
in reply to grey_maniac • • •corvus
in reply to FineCoatMummy • • •FineCoatMummy
in reply to corvus • • •Yah, there might be something to that. For protection against style + vocab matching.
It sucks though. I recently read where the more people use LLM assisters when they write, the more the whole virtual commons grows bland. It feeds back upon itself.
Sigh. I just want a world where we can have nice things. And assholes don't try to ruin the nice things we could have.
astraeus
in reply to corvus • • •like this
potatoguy likes this.
Nils
in reply to corvus • • •Previously, the advice was to translate your posts into one or two languages before posting. It seems that even rough content generated by large language models (LLMs) can help people fit in more easily.
I like how slop became "rough content" after translation.
Zacryon
in reply to FineCoatMummy • • •Bloefz
in reply to FineCoatMummy • • •racoon
in reply to FineCoatMummy • • •irmadlad
in reply to FineCoatMummy • • •Which is why you should silo all online accounts and avoid linking them together.