{"id":8902,"date":"2018-06-04T15:58:17","date_gmt":"2018-06-04T22:58:17","guid":{"rendered":"https:\/\/www.resilio.com\/blog\/?p=8902"},"modified":"2023-02-08T13:02:35","modified_gmt":"2023-02-08T20:02:35","slug":"exabyte","status":"publish","type":"post","link":"https:\/\/blog.resilio.com\/blog\/exabyte","title":{"rendered":"Reaching ExaByte Data Scale"},"content":{"rendered":"<p>Early in my career, when I was still running<a href=\"http:\/\/www.bittorrent.com\/\" target=\"_blank\" rel=\"noopener noreferrer\"> BitTorrent<\/a>, I would frequently give talks highlighting the incredible scaling challenges that exist at the edge of the network.<\/p>\n<p>To make the point, I liked to riff on a popular report published by Cisco that was called the ExaByte Era. It documented the exponential growth in data expected on the network a few years hence (today the same bit of Cisco marketing is called the <a href=\"https:\/\/blogs.cisco.com\/sp\/the-zettabyte-era-officially-begins-how-much-is-that\" target=\"_blank\" rel=\"noopener noreferrer\">Zettabyte Era<\/a>).<\/p>\n<h4>Let&#8217;s put it in perspective<\/h4>\n<p>I would start each talk with a little thought exercise to put the challenge in perspective. For kicks, I\u2019ll share the exercise below, but as you read the questions, try to keep in mind that this was waaaaaaay back in 2007\u2014a Precambrian era of the Internet so distant that at the time, the only network capable of delivering Netflix was the Post Office. In each talk, I\u2019d start by dryly informing the audience that &#8220;&#8230;an <a href=\"https:\/\/en.wikipedia.org\/wiki\/Exabyte\" target=\"_blank\" rel=\"noopener noreferrer\">ExaByte<\/a> was over a billion GigaBytes or 2^60 bytes&#8230;\u201d and smile inwardly as the eyes staring back at me invariably start to glaze over.<\/p>\n<p>And that\u2019s when I\u2019d hit \u2018em with a Pop Quiz containing a bunch of questions like these:<\/p>\n<ul>\n<li>How long would it take to watch 1 ExaByte (EB) of <a href=\"https:\/\/vimsy.co\/blog\/understanding-video-resolutions\" target=\"_blank\" rel=\"noopener noreferrer\">Standard Definition<\/a> content encoded at 1Mps?<\/li>\n<li>How long would it take to watch 1 EB of <a href=\"https:\/\/vimsy.co\/blog\/understanding-video-resolutions\" target=\"_blank\" rel=\"noopener noreferrer\">Blu-ray <\/a>content (54Mbps)?<\/li>\n<li>How big would your data center network have to be to deliver 1 EB in a year?<\/li>\n<li>How long does it take YouTube to stream 1 EB of video?<\/li>\n<li>How long does it take <a href=\"http:\/\/www.bittorrent.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">BitTorrent<\/a> to deliver 1 EB of data?<\/li>\n<\/ul>\n<p><strong>Cue the <a href=\"http:\/\/www.bittorrent.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Jeopardy theme song<\/a>. <\/strong><\/p>\n<p>After letting these sink in for a bit, I\u2019d begin revealing the answers one by one.<\/p>\n<p>To watch an ExaByte of video at 1Mbps (without bathroom breaks) would take over 292,000 years. If that\u2019s too long, you could sit in front of the Blu-ray player for 5,400 years instead. At the macro level, you\u2019d need 3.5Tbps of sustained network capacity to deliver 1 EB in a year. No small feat considering at the time, all of YouTube required 20 months (1.7 years) to deliver that much video.<\/p>\n<p>But in those days, BitTorrent routinely delivered an EB of data\u2014every single month\u2014over networks at the edge that were unable to handle even simple Netflix. And we did it with software, a team of 20 people and nary a single server, let alone a data center or <em><strong>the cloud<\/strong>.<\/em><\/p>\n<p>Powerful stuff, and the only viable technology capable of scaling at the edge.<\/p>\n<h4>Yesterday&#8217;s realties still apply today<\/h4>\n<p>Obviously these talks described an Internet barely capable of ExaByte scale in its entirety and only if you had the right solution.<\/p>\n<p>And if instead you preferred to use the Cloud, then you needed Google\u2019s budget to pull it off.<\/p>\n<p>Roughly 10 years later, an ExaByte is still quite a bit of data to deliver over networks and scaling challenges at the Edge that are no less daunting.<\/p>\n<p>And yet, some of our largest customers are already operating at or near ExaByte scale using <a href=\"https:\/\/www.resilio.com\/connect\/\" target=\"_blank\" rel=\"noopener noreferrer\">Resilio Connect<\/a> and growing fast.<\/p>\n<p>For each of them, the ExaByte may be different: from daily builds of the latest video game under development, to mountains of raw data needed for training AI algorithms, or the most recent operating system updates to secure your commercial vehicle fleet to large data delivered to systems in tens of thousands of retail restaurants.<\/p>\n<p>None of these customers sees this data getting smaller over time, and yet they know Resilio will scale seamlessly no matter what they throw at us.<\/p>\n<p>We\u2019ve been doing it for years.<\/p>\n<p>Because whatever the data, reaching ExaByte scale is easier with the right technology in place.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Early in my career, when I was still running BitTorrent, I would frequently give talks highlighting the incredible scaling challenges that exist at the edge of the network. To make the point, I liked to riff on a popular report published by Cisco that was called the ExaByte Era. It documented the exponential growth in [&hellip;]<\/p>\n","protected":false},"author":24,"featured_media":8903,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[194,232],"tags":[158],"class_list":["post-8902","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-devops_itops","category-visionary","tag-featured-tertiary"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>ExaByte Data Scale | Resilio Blog<\/title>\n<meta name=\"description\" content=\"To watch an ExaByte of video at 1Mbps would take over 292,000 years. Learn how Resilio Platform can easily reach an ExaByte of data at scale.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.resilio.com\/blog\/exabyte\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ExaByte Data Scale | Resilio Blog\" \/>\n<meta property=\"og:description\" content=\"To watch an ExaByte of video at 1Mbps would take over 292,000 years. Learn how Resilio Platform can easily reach an ExaByte of data at scale.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.resilio.com\/blog\/exabyte\" \/>\n<meta property=\"og:site_name\" content=\"Resilio Blog\" \/>\n<meta property=\"article:published_time\" content=\"2018-06-04T22:58:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-08T20:02:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"645\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Eric Klinker\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Eric Klinker\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#article\",\"isPartOf\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte\"},\"author\":{\"name\":\"Eric Klinker\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/4e173a09c5f382c8b3fe37241828ee2b\"},\"headline\":\"Reaching ExaByte Data Scale\",\"datePublished\":\"2018-06-04T22:58:17+00:00\",\"dateModified\":\"2023-02-08T20:02:35+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte\"},\"wordCount\":620,\"publisher\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png\",\"keywords\":[\"Featured-tertiary\"],\"articleSection\":[\"DevOps &amp; ITOps\",\"Visionary\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte\",\"url\":\"https:\/\/blog.resilio.com\/blog\/exabyte\",\"name\":\"ExaByte Data Scale | Resilio Blog\",\"isPartOf\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png\",\"datePublished\":\"2018-06-04T22:58:17+00:00\",\"dateModified\":\"2023-02-08T20:02:35+00:00\",\"description\":\"To watch an ExaByte of video at 1Mbps would take over 292,000 years. Learn how Resilio Platform can easily reach an ExaByte of data at scale.\",\"breadcrumb\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.resilio.com\/blog\/exabyte\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage\",\"url\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png\",\"contentUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png\",\"width\":1000,\"height\":645,\"caption\":\"WAN Optimization\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/exabyte#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.resilio.com\/blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Reaching ExaByte Data Scale\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#website\",\"url\":\"https:\/\/blog.resilio.com\/blog\/\",\"name\":\"Resilio Blog\",\"description\":\"Explore Common Use cases, How to&#039;s, Comparisons &amp; More\",\"publisher\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.resilio.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#organization\",\"name\":\"Resilio\",\"url\":\"https:\/\/blog.resilio.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png\",\"contentUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png\",\"width\":512,\"height\":512,\"caption\":\"Resilio\"},\"image\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.linkedin.com\/company\/resilio-inc.\",\"https:\/\/youtube.com\/resilio\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/4e173a09c5f382c8b3fe37241828ee2b\",\"name\":\"Eric Klinker\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d42edd22feb7a11e4f254803cee48adf41b10b873b382dc3a5a835e0f97f0cbe?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d42edd22feb7a11e4f254803cee48adf41b10b873b382dc3a5a835e0f97f0cbe?s=96&d=mm&r=g\",\"caption\":\"Eric Klinker\"},\"url\":\"https:\/\/blog.resilio.com\/blog\/author\/eric\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ExaByte Data Scale | Resilio Blog","description":"To watch an ExaByte of video at 1Mbps would take over 292,000 years. Learn how Resilio Platform can easily reach an ExaByte of data at scale.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.resilio.com\/blog\/exabyte","og_locale":"en_US","og_type":"article","og_title":"ExaByte Data Scale | Resilio Blog","og_description":"To watch an ExaByte of video at 1Mbps would take over 292,000 years. Learn how Resilio Platform can easily reach an ExaByte of data at scale.","og_url":"https:\/\/blog.resilio.com\/blog\/exabyte","og_site_name":"Resilio Blog","article_published_time":"2018-06-04T22:58:17+00:00","article_modified_time":"2023-02-08T20:02:35+00:00","og_image":[{"width":1000,"height":645,"url":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png","type":"image\/png"}],"author":"Eric Klinker","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Eric Klinker","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.resilio.com\/blog\/exabyte#article","isPartOf":{"@id":"https:\/\/blog.resilio.com\/blog\/exabyte"},"author":{"name":"Eric Klinker","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/4e173a09c5f382c8b3fe37241828ee2b"},"headline":"Reaching ExaByte Data Scale","datePublished":"2018-06-04T22:58:17+00:00","dateModified":"2023-02-08T20:02:35+00:00","mainEntityOfPage":{"@id":"https:\/\/blog.resilio.com\/blog\/exabyte"},"wordCount":620,"publisher":{"@id":"https:\/\/blog.resilio.com\/blog\/#organization"},"image":{"@id":"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage"},"thumbnailUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png","keywords":["Featured-tertiary"],"articleSection":["DevOps &amp; ITOps","Visionary"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blog.resilio.com\/blog\/exabyte","url":"https:\/\/blog.resilio.com\/blog\/exabyte","name":"ExaByte Data Scale | Resilio Blog","isPartOf":{"@id":"https:\/\/blog.resilio.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage"},"image":{"@id":"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage"},"thumbnailUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png","datePublished":"2018-06-04T22:58:17+00:00","dateModified":"2023-02-08T20:02:35+00:00","description":"To watch an ExaByte of video at 1Mbps would take over 292,000 years. Learn how Resilio Platform can easily reach an ExaByte of data at scale.","breadcrumb":{"@id":"https:\/\/blog.resilio.com\/blog\/exabyte#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.resilio.com\/blog\/exabyte"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.resilio.com\/blog\/exabyte#primaryimage","url":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png","contentUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2018\/05\/exabyte-1000x645.png","width":1000,"height":645,"caption":"WAN Optimization"},{"@type":"BreadcrumbList","@id":"https:\/\/blog.resilio.com\/blog\/exabyte#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.resilio.com\/blog"},{"@type":"ListItem","position":2,"name":"Reaching ExaByte Data Scale"}]},{"@type":"WebSite","@id":"https:\/\/blog.resilio.com\/blog\/#website","url":"https:\/\/blog.resilio.com\/blog\/","name":"Resilio Blog","description":"Explore Common Use cases, How to&#039;s, Comparisons &amp; More","publisher":{"@id":"https:\/\/blog.resilio.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.resilio.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blog.resilio.com\/blog\/#organization","name":"Resilio","url":"https:\/\/blog.resilio.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png","contentUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png","width":512,"height":512,"caption":"Resilio"},"image":{"@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/resilio-inc.","https:\/\/youtube.com\/resilio"]},{"@type":"Person","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/4e173a09c5f382c8b3fe37241828ee2b","name":"Eric Klinker","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d42edd22feb7a11e4f254803cee48adf41b10b873b382dc3a5a835e0f97f0cbe?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d42edd22feb7a11e4f254803cee48adf41b10b873b382dc3a5a835e0f97f0cbe?s=96&d=mm&r=g","caption":"Eric Klinker"},"url":"https:\/\/blog.resilio.com\/blog\/author\/eric"}]}},"_links":{"self":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/posts\/8902","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/users\/24"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/comments?post=8902"}],"version-history":[{"count":0,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/posts\/8902\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/media\/8903"}],"wp:attachment":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/media?parent=8902"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/categories?post=8902"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/tags?post=8902"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}