A friend of mine claims that it is possible to identify every anonymous call (prepaid, skype, etc) only using voice recognition. However the scientific literature which I've read so far is ambiguous, i.e. if you apply voice recognition to a limited number of individuals, you could reliably identify who is who. However if the number reaches a certain limit this becomes impossible. So the question is: Is user identification using voice recognition of all network participants really possible or is my friend just being paranoid?

  • With sufficient "training", it should be possible to identify people individually among a very large set. I do not know if anyone has such a large set of known voices though. It is absolutely within the realm of possibility.
    – forest
    May 13 '18 at 23:12
  • Unfortunately this is true. Voice can be a "fingerprint". Similar to fingerprint recognition, voice recognition just need to pick up unique attribute from individual voice and match the database.
    – mootmoot
    May 14 '18 at 7:52
  • I doubt it. Ask your friend to show proof.
    – Tom K.
    May 14 '18 at 11:08
  • @mootmoot Can you maybe post an answer explaining the current state-of-the-art of voice identification technology and how good its success rate is?
    – Philipp
    May 14 '18 at 11:14
  • @Philipp Theoretically applicable doesn't mean it is practically viable to record all the conversation of Joe public. The challenge will be the storage. Currently , HSBC does offer speaker recognition as biometric. en.wikipedia.org/wiki/Speaker_recognition
    – mootmoot
    May 14 '18 at 11:39

However if the number reaches a certain limit this becomes impossible.

Why? The basic problem is: given a signal, determine the matching fingerprint(s). This problem is parallelizable, and thus could be solved by using parallel architectures (GPUs, even FPGAs).

Once you have a way to reliably compare your signal to one fingerprint - and this is possible even in known scientific literature - you can run several instances of this matching algorithm, one per fingerprint in your database (or group of fingerprints) and collect the result at the end.

A 2006 classified NSA memo, leaked by Snowden, states that some speaker identification techniques known to the NSA work, in their own words,

largely independently of the language spoken.

Uniqueness is probably an issue, when considering such a large scale. Even real fingerprints are not unique.

Highly speculative thought here. It might be possible to combine the voice fingerprints with other known information (location, owner of that number/device, names being spoken in the conversation itself e.g. "Hi John"). This can be done in an investigation, should the need arise. It might be possible to do this automatically, but again this is pure speculation.

Anyway, what about storage? Let's do some simple computation.

Take this paper as an example of a publicly known automatic speaker recognition system. It claims an Equal Error Rate (EER) between 0.57% and 2.62% with 25 seconds of training recording per person.

At 8 kbps, 25 seconds equals 200 KB. Multiply this by 7×109 (7 billion people on this Earth), and you get 1.4 petabytes.

While it may seem huge, it is not impossible.

The NSA data center in Utah is assumed to have a maximum capacity of 3 to 12 exabytes. Google is estimated to hold 10-15 exabytes of data. We are talking about thousands of petabytes here.

Although this is clearly an estimate, the order of magnitude should be correct.

Moreover, you don't really need to keep all those training recordings. After you have extracted the features you want, you could, at least theoretically speaking, delete them, which means that you can save a lot of space. We are also not considering classified advances in speaker identification systems, which might be possible.

It's not clear whether it is possible to do this in real time, due to the large number of fingerprints, but non real time identification certainly seems feasible even if you gather samples from every living person on Earth.

Conclusion. While we obviously don't know for sure, automatic speaker identification on phone calls, given training samples of every person on Earth, seems a challenging but technically feasible problem for a very advanced organization. It's not clear if it can be done in real time. Fingerprint uniqueness (or lack thereof) may be a problem at such a large scale.

  • Is every voice unique though? Would other factors have to be brought into the equation, like assumed language, sex or nationality? What about bad connections? What if I try to disguise my voice? This seems highly speculative.
    – Tom K.
    May 15 '18 at 8:31
  • 1
    @tomK. the paper I quoted mentions a sample of men and women speaking Arabic. A 2006 classified memo by the NSA (leaked by Snowden) mentions that they "can identify voices largely independent of the language spoken". Voice disguises may be a problem. Yes, this is speculative, but the question asks "is this possible?". My answer to that, supported by references to a paper and some computations, is yes. Is this system practically used? I don't know.
    – A. Darwin
    May 15 '18 at 8:39
  • It's a question of the scope though. Yes, if you have a limited amount of people their voices might be unique in that population. The OP asks if "it is possible to identify every anonymous call" and you speak about 7 billion people. I assume the acoustic fingerprinting has to be done with a lot of items to determine unique voices.
    – Tom K.
    May 15 '18 at 8:47

Well it is probably true and trivial to fake. You can find speech engines around, and if you use such a speech engine, it will not be possible to identify the human being that prepared the text.

Worse, it is easy to get words and/or partial sentences from public people from radio, or internet. Simple audio file processing could then make them say more or less anything. And you soon fall in the same problem of identifying gangsters wearing masks from facial recognition...

  • 1
    I think the problem here is not authentication but rather privacy.
    – Philipp
    May 14 '18 at 11:12
  • @Philipp : Well , a paranoia can use the engine to protect their privacy.
    – mootmoot
    May 14 '18 at 11:42

If voice recognition was possible, that would mean that a massive database had to be created, and this would never happen due to security issues. Your friend is paranoid.

  • 5
    Adversaries might not care about security issues.
    – Tom K.
    May 14 '18 at 12:31
  • I think you might want to look into the meaning of MASINT, imlee, and what it means to our FVEY and SSEUR friends out there.
    – forest
    May 15 '18 at 8:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.