The Shape of the Room
Two people sing the same note. Same pitch, same fundamental frequency, checked against a tuner, dead on. And you can still tell them apart in under a second, without seeing either one, without either of them saying a word beyond that single sustained note. Something about that bothered me until I actually looked into what's physically happening, because the obvious answer, "they just sound different," isn't an answer. It's a restatement of the question.
Here's the actual mechanism, and it's not the same one that explains why a cello sounds different from a violin. That's a source problem, a difference in what's vibrating. This is a filter problem, a difference in what the sound has to travel through after it's already made.
Two separate jobs
A voice is built out of two systems doing two completely different jobs. The vocal folds are the source. They buzz open and shut at whatever rate you've set for pitch, and that buzz is already rich, already loaded with a full stack of harmonics riding above the fundamental, before it has gone anywhere at all. That part is basically the same setup for every human voice. Folds vibrate, harmonics stack up in the usual ratios. Nothing unique about it yet.
Then that buzz has to travel through the vocal tract to get out into the air, and the vocal tract is not a neutral pipe. It's a specific, irregular, individually shaped chamber, throat, mouth, tongue, sometimes the nasal passages, and that chamber resonates. Every chamber has frequencies it naturally amplifies and frequencies it naturally kills, based purely on its size and shape, the same way a bottle has a pitch it wants to hum at when you blow across the top. The vocal tract is doing that to every harmonic passing through it, boosting some, damping others, and the pattern of which ones get boosted is called the formant structure.
So the source makes the raw material. The room shapes it into something identifiable. Two singers with the same pitch have, more or less, the same raw material. What's different is the room.
The tell: formants don't move with the note
This is the part that actually convinced me it was a real, separate phenomenon and not just another name for overtones. Harmonics are locked to the fundamental. Sing a note, then sing the octave above it, and every harmonic in that stack has doubled right along with the fundamental. They're mathematically welded to whatever pitch you're producing.
Formants don't do that. Formants are set by the geometry of your throat and mouth in that instant, not by what pitch is passing through them. Sing the same vowel across your whole range, low note to high note, and the formant frequencies stay roughly parked in the same place the entire time, because your throat didn't get longer and your mouth didn't get bigger just because you went up an octave. The note moved. The room didn't.
That's why you can recognize a friend's voice whether they're talking in their normal register, laughing an octave higher, or half-whispering something low. The pitch is all over the place. The room they're speaking through hasn't changed at all, because it can't, it's built into their skull. You're not tracking their note. You were never tracking their note. You're tracking the shape of the chamber the note keeps passing through.
Vowels are rooms, not sounds
Here's a way to feel this directly instead of just being told it. Pick one note and hold it. Now shape your mouth into "ah," then into "ee," then into "oh," without changing the pitch at all. You are producing the same fundamental, the same source, the entire time. What changes, drastically, audibly, is the vowel. And a vowel isn't a different sound in the way a different pitch is a different sound. A vowel is a different room. Moving your tongue and jaw physically reshapes the resonating chamber, which shifts which formants get amplified, and that shift in formants is, acoustically, the entire identity of the vowel. "Ah" and "ee" are the same note wearing two different rooms.
That single exercise is the whole idea in miniature. Pitch is what note you're playing. Formants are the shape of the space the note is living in while it's being played. You can hold one perfectly still and vary the other completely, which is proof they were never the same variable to begin with.
Why you can't copy a voice by matching its pitch
If someone asked you to impersonate a friend's voice, and you nailed their exact pitch, hit their precise fundamental frequency on every word, you would not sound like them. Not even close. You'd sound like yourself, on their note. Because the thing that makes their voice theirs was never the note. It's the specific resonant shape of a throat and mouth and sinus structure that belongs to their body and not to yours, and no amount of matching pitch gets you access to that shape.
To actually sound like them, you'd have to change the room, not the note, which is a much harder and much more physical thing to do. Voice actors and impressionists know this instinctively even without the acoustics vocabulary for it. They're not matching your friend's pitch. They're distorting their own throat and mouth and jaw into something closer to the shape that produces those formants. They're rebuilding the room.
What I keep sitting with
The note is what gets said. The room is what says it. And it turns out the room, not the note, is where the identifying information actually lives, in a voice and probably in more places than a voice. Two people can say the identical thing, hit the identical pitch, use the identical words, and still be completely, recognizably different, because the content passed through two different shaped spaces on its way out, and it's the shape, not the content, that you end up recognizing.
That's a strange thing to sit with once you've actually heard it in your own mouth, saying "ah" and "ee" on one held note. The sound didn't change because I said something different. It changed because I reshaped the space it had to travel through. Which makes me wonder how much of what reads as someone's identity, in a voice or otherwise, was never in what they were saying at all. It was in the shape of whatever the saying had to pass through to reach you.