How email works

Here’s a brief explanation of how email works.

When you send an email to a friend, it has an address like user@domain.ext.  The email you’re sending goes to an outgoing mail server (a computer) via Simple Mail Transfer Protocol. The SMTP servertries to figure out where to send it, but It doesn’t understand people’s names or addresses however. “bill@gmail.com” means nothing to it at all. So the SMTP server contacts a Domain Name System server (another computer.) The DNS server is like an old phone book for the internet; it translates names to numbers, to an IP address like “123.456.78.910.” Then the DNS server checks that IP address to see if it can receive email. If so,  …

The DNS Server sends the appropriate “decoded” infomation (the IP address) back to the first SMTP server. Now that it has the proper info, the message gets sent from that server to the target domain’s mail exchange server (yet another computer). This server is called a MTA, or Mail Transfer Agent. the MTA decides exactly where to send the email. The MTA then transfers the email to your friend’s IMAP server (yes: another computer) where it resides on a hard drive until your friend goes and fetches the mail, to their own computer.

If you’re counting, that’s 7 transfers between 6 computers.

And just to make this all the more fun, every time something (such as an email or a web page) is sent over the internet, it is broken into tiny chunks, each with a header (ie destination address) and some chunk of the whole data. There may be only a few, or there may be thousands of these packets. And they do not all take the same route to get to the destination. Some may go almost directly while others may travel around the world. Along the way they have gone thru dozens or hundreds of other computers. Then they are all reassembled at the destination (even though they likely arrived out of order.)

As you can see now, this IS “rocket science” and FAR more complex than you might have thought.

And that’s the way every single one of the 300 Billion emails sent each day works.

Nobody tracks all this as it is sent either. There are tens of TRILLIONS of packets flitting around the internet every day. Even computers cannot track all that.

What does happen, however, is that the path taken is added to the hidden header inside each email. You probably didn’t know it was there, but it is. If you get an email, and your email software offers it, there may be a “view raw” option to show you what an email really looks like, and how it got to you.

There’s an example at the end…*

If you look at it, you’ll notice that because it’s filled as it goes along, it is not until the email is finally delivered that can you actually see the path it took.

In other words, if it gets lost, then it’s well and truly lost and virtually impossible to track or find.

With 300 Billion of -anything- it’s inevitable that thing will go wrong with some of them. That’s just the way the universe runs. In fact, that so many of them actually make the trip and get reassembled is pretty close to amazing.

In my 40+ years using electronic mail, starting long before there was a public-facing “internet” I’ve received well over 2 million emails. Every now and then one doesn’t arrive. However, I’d wager that it’s been less than 1 in 100,000.

When someone says “I didn’t get the email” chances are quite large that they are wrong. They got it and deleted it without reading it; it landed in their spam mailbox; it got filtered out by some over-eager host (looking at you Gmail and AOL!) But actually failing to reach the destination server is vanishingly rare.

I’m inspired to write this because today I saw something I’d never seen before: the SMTP server at our host was giving every email a high spam score, so our email was being filtered into the recipient’s spam box (well, depending on their own personal spam settings, of course.) VERY embarrassing for our host, and they scrambled to fix it.

Point is that I’ve never seen this in 40 years, so it was hard to diagnose, much less believe!

So: there you are – more about email than you wanted to know. But… now you know! 🙂

Tracy

Here’s the promised example email header:

Return-Path: <sender@someplace.com>
X-Original-To: recipient@someplaceelse.net
Delivered-To: x11354805@pdx1-sub0-mail-mx43.g.SomeMailService.com
Received: from vade-backend20.SomeMailService.com (fltr-in2.mail.SomeMailService.com [66.33.205.213])
(using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
(No client certificate requested)
by pdx1-sub0-mail-mx43.g.SomeMailService.com (Postfix) with ESMTPS id 41EE298071
for <recipient@someplaceelse.net>; Tue, 4 Jun 2019 14:54:01 -0700 (PDT)
Received: from bonobo.elm.relay.mailchannels.net (bonobo.elm.relay.mailchannels.net [23.83.212.22])
by vade-backend20.SomeMailService.com (Postfix) with ESMTPS id C5B794000021C
for <recipient@someplaceelse.net>; Tue, 4 Jun 2019 14:54:00 -0700 (PDT)
Authentication-Results: vade-backend20.SomeMailService.com; dkim=pass
reason=”1024-bit key; unprotected key”
header.d=photography.org header.i=@photography.org
header.b=LMOB8Jy2; dkim-adsp=pass; dkim-atps=neutral
X-Sender-Id: SomeMailService|x-authsender|sender@someplace.com
Received: from relay.mailchannels.net (localhost [127.0.0.1])
by relay.mailchannels.net (Postfix) with ESMTP id 62CE91A21EA
for <recipient@someplaceelse.net>; Tue, 4 Jun 2019 21:54:00 +0000 (UTC)
Received: from pdx1-sub0-mail-a16.g.SomeMailService.com (100-96-38-146.trex.outbound.svc.cluster.local [100.96.38.146])
(Authenticated sender: SomeMailService)
by relay.mailchannels.net (Postfix) with ESMTPA id B04AC1A23C3
for <recipient@someplaceelse.net>; Tue, 4 Jun 2019 21:53:59 +0000 (UTC)
X-Sender-Id: SomeMailService|x-authsender|sender@someplace.com
Received: from pdx1-sub0-mail-a16.g.SomeMailService.com ([TEMPUNAVAIL].
[64.90.62.162])
(using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384)
by 0.0.0.0:2500 (trex/5.17.2);
Tue, 04 Jun 2019 21:54:00 +0000
X-MC-Relay: Neutral
X-MailChannels-SenderId: SomeMailService|x-authsender|sender@someplace.com
X-MailChannels-Auth-Id: SomeMailService
X-Shoe-Bottle: 400ba0ab50630a71_1559685240240_2338004666
X-MC-Loop-Signature: 1559685240240:1840485062
X-MC-Ingress-Time: 1559685240240
Received: from pdx1-sub0-mail-a16.g.SomeMailService.com (localhost [127.0.0.1])
by pdx1-sub0-mail-a16.g.SomeMailService.com (Postfix) with ESMTP id C8E06800BE
for <recipient@someplaceelse.net>; Tue, 4 Jun 2019 14:53:55 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=photography.org; h=from
:content-type:message-id:mime-version:subject:date:references:to
:in-reply-to; s=photography.org; bh=5L7HIklL0wCkU0ypcRkIUoRmaA8=; b=
LMOB8Jy2TBpllKQwm9NNS5plG3ibBzvke7p3apYYyOXM5246LJCNx8jCnLulvZjL
jR/C0lk0bai/zKfV+qYtxZjWAocbwKIQLXQjYc8tSEEJ2gcDeq0Ej7kLxeYGHHgQ
ognij93JyNKQv0w8M204mQ2AKoOC5kKV1fx1A41dpyk=
Received: from [192.168.1.32] (c-73-241-48-152.hsd1.ca.comcast.net [73.241.48.152])
(using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
(No client certificate requested)
(Authenticated sender: sender@someplace.com)
by pdx1-sub0-mail-a16.g.SomeMailService.com (Postfix) with ESMTPSA id 4D9467FF46
for <recipient@someplaceelse.net>; Tue, 4 Jun 2019 14:53:55 -0700 (PDT)
X-DH-BACKEND: pdx1-sub0-mail-a16
From: Some Person <sender@someplace.com>
Content-Type: multipart/alternative; boundary=”Apple-Mail=_FBA4BD6B-A8CB-4FEF-A76D-040F73951B06″
Message-Id: <413A4AE3-03A9-49BD-98E8-3C5660A48123@photography.org>
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\))
Subject: Re: discount code for IJE
Date: Tue, 4 Jun 2019 14:53:54 -0700
References: <70A1983D-549E-4C11-B0A2-B2CAB33267B8@photography.org> <A56A1316-5331-45C3-AEF0-184CE3B838A5@photography.org> <DA021C83-189F-455F-B622-2494C6596FD4@photography.org> <703A1595-7095-4485-A964-6210EEA3ABED@photography.org>
To: Tracy Valleau <recipient@someplaceelse.net>
In-Reply-To: <703A1595-7095-4485-A964-6210EEA3ABED@photography.org>
X-Mailer: Apple Mail (2.2104)
X-VR-OUT-STATUS: OK
X-VR-OUT-SCORE: -100
X-VR-OUT-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgeduuddrudeguddgtdefucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuggftfghnshhusghstghrihgsvgdpffftgfetoffjqffuvfenuceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmnecujfgurhephfgtkfgguffffhfvjgfosegrtdhmrehhtdejnecuhfhrohhmpeetnhhnucflrghsthhrrggsuceorghnnhesphhhohhtohhgrhgrphhhhidrohhrgheqnecuffhomhgrihhnpehphhhothhoghhrrghphhihrdhorhhgnecukfhppeejfedrvdeguddrgeekrdduhedvnecurfgrrhgrmhepmhhouggvpehsmhhtphdphhgvlhhopegludelvddrudeikedruddrfedvngdpihhnvghtpeejfedrvdeguddrgeekrdduhedvpdhrvghtuhhrnhdqphgrthhhpeetnhhnucflrghsthhrrggsuceorghnnhesphhhohhtohhgrhgrphhhhidrohhrgheqpdhmrghilhhfrhhomheprghnnhesphhhohhtohhgrhgrphhhhidrohhrghdpnhhrtghpthhtohepthhrrggthiesphhhohhtohhgrhgrphhhhidrohhrghenucevlhhushhtvghrufhiiigvpedt
X-VR-STATUS: OK
X-VR-SCORE: -100
X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgeduuddrudeguddgtdefucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuggftfghnshhusghstghrihgsvgdpffftgfetoffjqffuvfenuceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmnecujfgurhephfgtkfgguffffhfvjgfosegrtdhmrehhtdejnecuhfhrohhmpeetnhhnucflrghsthhrrggsuceorghnnhesphhhohhtohhgrhgrphhhhidrohhrgheqnecuffhomhgrihhnpehphhhothhoghhrrghphhihrdhorhhgnecukfhppedvfedrkeefrddvuddvrddvvddpjeefrddvgedurdegkedrudehvdenucfrrghrrghmpehmohguvgepshhmthhppdhhvghlohepsghonhhosghordgvlhhmrdhrvghlrgihrdhmrghilhgthhgrnhhnvghlshdrnhgvthdpihhnvghtpedvfedrkeefrddvuddvrddvvddprhgvthhurhhnqdhprghthheptehnnhculfgrshhtrhgrsgcuoegrnhhnsehphhhothhoghhrrghphhihrdhorhhgqedpmhgrihhlfhhrohhmpegrnhhnsehphhhothhoghhrrghphhihrdhorhhgpdhnrhgtphhtthhopehtrhgrtgihsehphhhothhoghhrrghphhihrdhorhhgpdhhvghloheplgduledvrdduieekrddurdefvdgnpdhinhgvthepjeefrddvgedurdegkedrudehvdenucevlhhushhtvghrufhiiigvpedt

–Apple-Mail=_FBA4BD6B-A8CB-4FEF-A76D-040F73951B06
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8

Hi Tracy,  (here the actual email, finally!)

Leave a Reply

Your email address will not be published. Required fields are marked *