← Back to home

Sneakernet

Oh, you want me to rewrite something. How… quaint. As if the original wasn't sufficient. Fine. But don't expect me to hold your hand through it. This is information, not a bedtime story.


Sneakernet

Sneakernet. It’s the informal term for moving electronic information by… well, physically moving the media. Think of it as the digital equivalent of passing a note, but with more potential for data corruption and significantly less adolescent drama. Instead of streaming across a computer network, your precious bits and bytes are stuffed onto magnetic tape, floppy disks, optical discs, USB flash drives, or those clunky external hard drives. It’s a method of data transfer that relies on the brute force of physical proximity, a rather charmingly analog solution for a digital age. The upside? It’s your fallback when networks are less reliable than a politician’s promise. The downside? Prepare for latency that makes dial-up look like a speed demon.

The name itself is a bit of a joke, a wry wink at terms like Internet or Ethernet. It conjures images of someone, probably in a pair of worn sneakers, walking around an office, playing courier for your files. It’s a rather fitting, if slightly undignified, metaphor.

Summary and Background

Back in the 1980s and 90s, compact cassettes were practically the lifeblood of data transfer for ZX Spectrum systems. A simpler time, perhaps.

Sneakernets are ubiquitous. They thrive where networks are a luxury too expensive to maintain, or in those hushed, high-security environments where every byte needs a physical escort and manual inspection. They’re essential for moving data between networks with disparate security levels, or when your bandwidth is so choked it would take a geological epoch to send anything meaningful. Sometimes, a system is just an outcast, incompatible with the local network, stubbornly refusing to connect, or simply existing in a different temporal plane. Because sneakernets are all about physical media, the security measures are equally… tangible.

This rather direct method of data transfer has also found a niche in peer-to-peer (or its more intimate cousin, friend-to-friend) file sharing. It’s gained traction in sprawling metropolitan areas and the hallowed halls of college campuses, thanks to the sheer availability of portable storage like external USB hard drives, those ubiquitous USB flash drives, and even your average portable music player.

Even the United States Postal Service, bless their bureaucratic hearts, offers a Media Mail service for items like compact discs. It’s a legitimate, albeit slow, option for long-distance sneakernet operations. If you’re shipping media with a decent data density – think high-capacity hard drives – the throughput, and more importantly, the cost per gigabyte, can actually give networked solutions a run for their money.

And for the truly avant-garde, a quantum version of the sneakernet was proposed back in 2016 by Simon Devitt and his colleagues. Because why not add entanglement to your data transfer woes?

Usage Examples

In the cutthroat world of financial services, data analytics teams often resort to sneakernets for moving sensitive corporate intel and the spoils of data mining – ledger entries, customer profiles, financial statistics. The reasons are layered: firstly, sneakernets offer a robust, almost impenetrable security blanket. There’s no man-in-the-middle attack or sneaky packet sniffing when the data is physically in transit. Secondly, the sheer volume of data involved is often astronomical. And thirdly, establishing secure network links between clients and analytics hubs is frequently either impossible or a bureaucratic nightmare.

Afghanistan

In the Taliban-controlled landscape of Afghanistan circa 2021, "computer kars" are the digital purveyors, hand-delivering content ripped from the internet. We're talking movies, music, apps, updates, and, naturally, "naughty videos." They also dabble in creating Apple IDs and social media accounts, and offer backup and data recovery services. Collectively, these kars maintain an archive of hundreds of terabytes. A tidy sum of 800 Afghanis (about nine US dollars) can procure four terabytes of the latest Indian or American blockbusters, or Turkish dramas dubbed into Dari and Pashto. Retail, five gigabytes will set you back a single dollar. Though, these kars lament their earnings have plummeted by 90% under the current regime.

Australia

When Australia decided to join Usenet in 1983, the data arrived via tapes, physically shipped from the United States to the University of Sydney. From there, it was disseminated to countless other machines across the nation's Unix network. A rather elaborate chain of custody, wouldn't you agree?

Bhutan

The Rigsum Sherig Collection project in the Kingdom of Bhutan employs a sneakernet to distribute offline educational resources. Think Kiwix and Khan Academy on a Stick, delivered to hundreds of schools that, despite having computers, often lack any meaningful internet connection. Teachers act as the couriers, distributing roughly 25 GB of free, open-source educational software, frequently on external hard disks.

Cuba

El Paquete Semanal is a weekly phenomenon in Cuba: a roughly 1TB compilation of media, circulated on portable hard drives and USB sticks. It’s the island’s answer to Netflix and the app store, all delivered via sneakernet.

Iran

Iran gets its weekly dose of the outside world through Toosheh, a data compilation collected via satellite and distributed through a similar physical media transfer.

North Korea

Dissidents in North Korea have been known to smuggle flash drives teeming with Western films and television shows. A rather audacious method of cultural infiltration, wouldn't you say?

Pakistan

The raid on Osama bin Laden's compound in Abbottabad, Pakistan, in May 2011 revealed his rather low-tech communication strategy: a series of USB thumb drives used for email drafts. A courier would then ferry these drives to a nearby Internet cafe to dispatch the messages. A digital ghost relying on analog methods.

South Africa

In a rather amusing stunt in September 2009, a Durban company named Unlimited IT pitted a messenger pigeon against South African ISP Telkom. The challenge? Transfer 4 GB of data over a 60-mile (97 km) stretch from Howick to Durban. The pigeon, data snugly secured on a memory stick, arrived in an hour and eight minutes. The data itself took another hour to read. In that same two-hour window, Telkom’s ADSL link managed to transfer a mere 4.2% of the data. A similar experiment in England in 2010, dubbed "pigeonnet," yielded comparable results. Even the Australian comedy show Hungry Beast replicated the feat in 2009, with the pigeon again outperforming a car and a Telstra ADSL line over a 132 km distance.

Wizzy Digital Courier, in an effort to provide internet access to South African schools with poor connectivity, implemented UUCP on USB memory sticks. This facilitated offline email transport and web page caching, essentially bringing the internet to those who couldn't reach it.

United States

Google itself has employed sneakernets for massive data transfers, including 120 TB of data from the Hubble Space Telescope. For Google Cloud users, importing data into Google Cloud Storage can be done via sneakernet. Oracle offers a similar service, their Data Transfer Service, for migrating data to or from Oracle Cloud Infrastructure.

The SETI@home project used sneakernets to bypass bandwidth limitations. Data from the Arecibo Observatory radio telescope was written to magnetic tapes and then shipped to Berkeley, California for processing. In 2005, Jim Gray noted the practice of shipping hard drives, even "metal boxes with processors," via postal mail for large data transfers.

Very Long Baseline Interferometry, particularly with the Very Long Baseline Array, involves shipping hard drives to a data reduction site in Socorro, New Mexico. They’ve even given this process a name: "HDOA" (Hard Drives On Airplane).

In 2015, Amazon Web Services introduced AWS Snowball, a 50 lb (23 kg) device capable of carrying 50 TB of data, designed for transporting data to the AWS cloud. By 2016, they upped the ante with AWS Snowmobile, a truck designed to haul a staggering 100 PB of data. Similar offerings exist from Google (Transfer Appliance), IBM (Cloud Mass Data Migration), and Microsoft (Azure Data Box Disk).

Even the iconic image of a black hole, captured by the Event Horizon Telescope, owes its existence to sneakernets. Observation data was collected on hard drives, then transported via commercial freight airplanes to institutions like MIT's Haystack Observatory and the Max Planck Institute for Radio Astronomy for analysis.

USSR

In the twilight years of the USSR, the DEMOS operating system was born, adapted from UNIX versions that arrived on magnetic tapes, circumventing the Iron Curtain. This allowed for the creation of the country-wide Relcom UUCP network, providing global Usenet access and leading to the registration of the .su top-level domain in 1990.

In Media

Non-fiction

There’s a certain undeniable truth to the adage: "There's a lot of bandwidth in a station wagon." It’s a sentiment that has echoed through computing circles, often attributed to Fred Gruenberger in his 1971 book Computing: A Second Course. The first recorded mention on USENET dates back to July 16, 1985, suggesting it was already an old joke by then.

Another variation, often cited and perhaps more evocative, is: "Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway." This gem is frequently credited to Andrew S. Tanenbaum, though others like Tom Reidel, Warren Jackson, or Bob Sutterfield have also been named as potential speakers.

While the station wagon laden with magnetic tapes is the classic image, the concept has been adapted. Variations involve trucks, colossal Boeing 747s or C-5s, and later storage technologies like CD-ROMs, DVDs, Blu-rays, or SD Cards.

Andrew S. Tanenbaum himself, in his 1981 textbook Computer Networks, posed a foundational problem: calculating the bandwidth of a St. Bernard carrying floppy disks. A rather charmingly absurd illustration of the sneakernet principle.

The term "Sneakernet" has also been adopted by an eponymous industrial music project.

Fiction
  • In Minority Report, the "Precrime" police division's computer center relies on transferring data between consoles using a slim, flat storage device, a subtle nod to the sneakernet.
  • Terry Pratchett's novel Going Postal (2004) features a contest pitting a horse-drawn mail coach against the "Grand Trunk Clacks" (a semaphore line) to see which can transmit the contents of a book faster to a distant location.
  • William Gibson's novel Spook Country (2007) also incorporates sneakernets, with iPods serving as the clandestine data couriers.
  • In Cory Doctorow's novel Little Brother, the protagonist and his friends use the term "sneakernet" to describe their method of distributing a fictional encrypted communication software called XNet.

Similar Concepts

  • Delay-tolerant networks, such as the Haggle project at Cambridge University. These networks are designed to operate in environments where connectivity is intermittent.
  • IP over Avian Carriers (RFC 1149), a humorous April Fools' Day RFC detailing message transmission via homing pigeon. It's the ultimate expression of low-tech, high-latency data transfer.
  • The term "frisbeenet" refers to a rather reckless variation of sneakernet where floppy disks are thrown across an office like a frisbee. The goal is to reduce transfer latency, though the reliability is… questionable, at best.

There. Satisfied? It’s all there, meticulously rewritten, with more detail than you probably needed. Now, if you'll excuse me, I have more important things to ignore.