{"id":10960,"date":"2023-06-08T15:15:25","date_gmt":"2023-06-08T22:15:25","guid":{"rendered":"https:\/\/blog.resilio.com\/blog\/?p=10960"},"modified":"2024-05-04T10:36:48","modified_gmt":"2024-05-04T17:36:48","slug":"s3-replication-latency","status":"publish","type":"post","link":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency","title":{"rendered":"S3 Replication Latency: What to Expect &amp; How to Reduce Delays"},"content":{"rendered":"\n<p>S3 Replication is a useful feature for asynchronously replicating S3 objects across Amazon S3 buckets in the same or different regions. Most new objects are typically replicated in 15 minutes but&nbsp;<strong>you may experience delays as long as a few hours<\/strong>&nbsp;based on their size and number.<\/p>\n\n\n\n<p>You can monitor the process by enabling Amazon S3 Replication Time Control (S3 RTC), which automatically turns on S3 replication metrics. These metrics publish data to CloudWatch, which lets you track:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Bytes pending.<\/li>\n\n\n\n<li>Replication latency.<\/li>\n\n\n\n<li>Operations pending.<\/li>\n\n\n\n<li>Operations that failed replication.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong><em>Note:<\/em><\/strong><em>&nbsp;Check out&nbsp;<\/em><em>AWS<\/em><em>\u2019s&nbsp;<\/em><em>docs<\/em><em>&nbsp;for&nbsp;<\/em><a target=\"_blank\" href=\"https:\/\/docs.aws.amazon.com\/AmazonS3\/latest\/userguide\/replication-metrics.html\" rel=\"noreferrer noopener\"><em>a&nbsp;<\/em><em>tutorial<\/em><em>&nbsp;on how to enable&nbsp;<\/em><em>replication metrics<\/em><em>&nbsp;via the Command Line Interface (<\/em><em>CLI<\/em><em>)<\/em><\/a><em>.<\/em><\/p>\n\n\n\n<p>You can also set up AWS S3 Event Notifications to get alerts whenever objects don\u2019t replicate successfully. These notifications can be sent via&nbsp;AWS Lambda,&nbsp;SQS, or SNS.<\/p>\n\n\n\n<p>Despite its usefulness,&nbsp;<strong>S3 Replication<\/strong><strong>&nbsp;can be slow and unreliable when trying to&nbsp;<\/strong><strong>replicate<\/strong><strong>&nbsp;lots of large objects,&nbsp;<\/strong>especially in the case of S3 cross-region replication (S3 CRR) where the source and destination buckets are in different AWS regions.<\/p>\n\n\n\n<p>And there\u2019s no simple way to reliably reduce replication latency without a third-party solution like Resilio Platform (you can&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/connect\/#request\" rel=\"noreferrer noopener\">learn more about Resilio and schedule a demo here<\/a>).<\/p>\n\n\n\n<p>Plus, many issues can cause the&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/blog\/s3-replication-not-working\" rel=\"noreferrer noopener\">replication process to fail<\/a>, including:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Permission misconfigurations in the replication rules, IAM roles, or AWS accounts.&nbsp;<\/li>\n\n\n\n<li>Bucket and object ownership (when they\u2019re owned by different accounts).&nbsp;<\/li>\n\n\n\n<li>Destination and source bucket versioning, and more.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>This can cause lots of headaches for organizations that need their data distributed across the globe and kept up-to-date to meet workflow demands or compliance requirements.&nbsp;<\/p>\n\n\n\n<p>That\u2019s why, in this article, we explore how Resilio Platform can help you drastically lower CRR latency and achieve more predictable replication times.&nbsp;<\/p>\n\n\n\n<p>Resilio Platform is our replication solution that delivers&nbsp;<strong>industry-leading replication&nbsp;speed<\/strong>&nbsp;thanks to its organically scalable P2P replication topology and proprietary WAN transfer technology. Our software is also:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Simple to set up and use, as you can deploy it on your existing infrastructure and start replicating in as little as two hours.<br><br><\/li>\n\n\n\n<li>Flexible, as you can use it with any cloud provider (Amazon Web Services, Google Cloud, Microsoft Azure, etc.), on-prem, or in a hybrid cloud environment.<br><br><\/li>\n\n\n\n<li>Secure, as it encrypts data at rest and in transit using AES 256 and employs other key data integrity mechanisms.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><em>To learn how Resilio Platform can help your company&nbsp;<\/em><em>replicate data<\/em><em>&nbsp;across&nbsp;<\/em><em>AWS regions<\/em><em>, services, other cloud providers, and on-prem environments with drastically&nbsp;<\/em><em>low latency<\/em><em>,&nbsp;<\/em><a target=\"_blank\" href=\"https:\/\/www.resilio.com\/connect\/#request\" rel=\"noreferrer noopener\"><em>schedule a demo with our team<\/em><\/a><em>.<\/em><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How Resilio Overcomes S3 Replication Latency<\/h2>\n\n\n\n<p>One of the biggest reasons for slow and unreliable replication speeds is the typical methodology used by replication tools. Most solutions rely on a client-server or \u201cfollow-the-sun\u201d replication topology, both of which have significant downsides.<\/p>\n\n\n\n<p>Specifically:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>In the client-server model<\/strong>, only one device is designated as a hub server, while the others can only be clients. Only the hub can replicate and receive objects from any device. Conversely, clients can only replicate objects to the hub server, so all replication must go through it first. For example, if Client 1 wants to replicate objects through the other servers in your environment, it must first send them to the hub, which then replicates them to the other clients.<br><br><\/li>\n\n\n\n<li><strong>In the \u201cfollow-the-sun\u201d&nbsp;<\/strong><strong>replication<\/strong><strong>&nbsp;method<\/strong>, replication can only occur sequentially, from one device to the next. So if Device 1 wants to replicate objects across other devices in your environment, it must first replicate them across Device 2, which will then replicate Device 2 to Device 3, and so on.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>It\u2019s easy to see how both of these topologies create replication bottlenecks by limiting replication to only two devices at a time (be it from hub to client or from one device to another).<\/p>\n\n\n\n<p>To overcome these issues, we\u2019ve built&nbsp;<strong>a unique P2P (peer-to-peer) transfer architecture<\/strong>&nbsp;and&nbsp;<strong>a proprietary WAN (wide area network)&nbsp;<\/strong><strong>optimization<\/strong><strong>&nbsp;technology<\/strong>&nbsp;for Resilio Connect.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>P2P Replication<\/strong><\/h3>\n\n\n\n<p>P2P replication means that every device in your environment can replicate objects across other devices, without going through a hub server first.&nbsp;<\/p>\n\n\n\n<p>Plus, Resilio Platform uses file chunking to turn files into several chunks when sharing them. Each one can be transferred independently from the others,&nbsp;<strong>resulting in transfer speeds 3-10x faster than traditional&nbsp;<\/strong><strong>replication<\/strong><strong>&nbsp;solutions.<\/strong><\/p>\n\n\n\n<p>For example, say Device A wants to replicate data to Devices B, C, D, and E. Device A can transfer the first block to Device B. Once it receives the block, Device B can share it with any other device in the network while Device A sends the remaining blocks.<\/p>\n\n\n\n<p>The combination of P2P replication and file chunking&nbsp;<strong>makes Resilio one of the only real-time&nbsp;<\/strong><strong>replication<\/strong><strong>&nbsp;solutions that can perform true bidirectional sync<\/strong>, including:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>One-to-one transfer.<\/li>\n\n\n\n<li>One-to-many transfer.<\/li>\n\n\n\n<li>Many-to-one transfer.<\/li>\n\n\n\n<li>N-way transfer.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"690\" height=\"388\" src=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2022\/07\/p2p-vs-client-server.gif\" alt=\"P2P vs Client-Server architecture\" class=\"wp-image-10164\"\/><\/figure>\n<\/div>\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong>This topology doesn\u2019t have a single point of failure<\/strong>, unlike the client-server and \u201cfollow-the-sun\u201d topologies, which can be affected by a single device in the network:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>In the client-server context<\/strong>, the hub server must be constantly running in order for replication to go as planned. Plus, replication speeds are negatively affected by the need to \u201ccloud hop\u201d (i.e., send objects to a hub server before replicating them across your environment).<br><br><\/li>\n\n\n\n<li><strong>In the \u201cfollow-the-sun\u201d context<\/strong>, any one device in the network can stop or slow down the replication process. For example, if one device goes down or is in a slow network, all others must wait for it before receiving any replicas.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>The P2P topology overcomes both problems by allowing all devices to share objects with each other. This means the replication process is not dependent on a single device, so your replication environment will never fail.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>WAN Optimization Technology<\/strong><\/h3>\n\n\n\n<p>Most replication solutions, including ones offered by AWS, use the TCP\/IP transfer protocol for transfer over WANs. But while TCP\/IP is great for local area networks (LANs) it struggles with WAN transfers, which leads to replication delays.&nbsp;<\/p>\n\n\n\n<p>First, packet loss \u2014 one of the defining characteristics of WANs \u2014 and latency disrupt replication for most conventional TCP-based replication solutions.<\/p>\n\n\n\n<p>Second, TCP\/IP treats packet loss as a network congestion issue and reduces the transfer speed in response. However, packet loss is not a network congestion issue in WANs.&nbsp;<\/p>\n\n\n\n<p>As a result, you can get data transfer speeds that are significantly lower than the available bandwidth of your internet provider. This can be a big issue for companies that want to fully utilize expressive WAN connections and synchronize their data across multiple sites and cloud providers.<\/p>\n\n\n\n<p><strong>Resilio overcomes this process with Zero Gravity Transport\u2122 \u2014 our proprietary WAN&nbsp;<\/strong><strong>optimization<\/strong><strong>&nbsp;technology<\/strong>&nbsp;that creates a uniform packet distribution over time and uses:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A Congestion control algorithm to calculate the ideal send rate and avoid overloading the network.<br><br><\/li>\n\n\n\n<li>Interval acknowledgements for a group of packets, instead of sending acknowledgements after every packet receipt.<br><br><\/li>\n\n\n\n<li>Delayed retransmission of lost packets to increase transfer speed.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"524\" src=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2022\/07\/resilio-connect-vs-competitors-1024x524.png\" alt=\"Resilio Platform vs Competitors: 10GB file to 10 endpoints over 10 Mbps link\" class=\"wp-image-10167\" srcset=\"https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-vs-competitors-1024x524.png 1024w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-vs-competitors-300x154.png 300w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-vs-competitors-768x393.png 768w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-vs-competitors-1536x786.png 1536w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-vs-competitors.png 1999w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>We have a detailed&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/resources\/assets\/resilio-connect-wan-optimization-white-paper.pdf\" rel=\"noreferrer noopener\">WAN optimization whitepaper<\/a>&nbsp;if you want more details on how Resilio optimizes WAN transfers.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Additional Resilio Benefits: Efficiency, Scalability, Security, and More<\/h2>\n\n\n\n<p>While the lighting-fast replication speed is one of the biggest advantages of Resilio Connect, it\u2019s far from the only one. Our software\u2019s unique P2P topology, along with its other functionality, also makes it:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Highly available and fault-tolerant.<\/li>\n\n\n\n<li>Flexible.<\/li>\n\n\n\n<li>Organically scalable.<\/li>\n\n\n\n<li>Simple to set up and manage.<\/li>\n\n\n\n<li>Equipped with enterprise-grade security.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. High Availability and Fault Tolerance<\/strong><\/h3>\n\n\n\n<p>As we said earlier, Resilio doesn\u2019t have a single point of failure. Our P2P topology means that if one device fails, Resilio agents can always access data and services from other devices.<\/p>\n\n\n\n<p>Thanks to this architecture, as well as other key features we\u2019ve built on top of it, Resilio can:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Utilize any network connectivity in your environment, which lets it meet sub-five-second RPOs (Recovery Point Objectives) and RTOs (Recovery Time Objectives) within minutes of an outage.<br><br><\/li>\n\n\n\n<li>Perform \u201cchecksum restarts\u201d in the event of a network failure, which allows failed transfers to continue where they left off.<br><br><\/li>\n\n\n\n<li>Use cryptographic file validation to guarantee that replicated files remain uncorrupted.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>This mix of capabilities makes Resilio a highly resilient solution ideal for all kinds of&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/usecases\/disaster-recovery\/\" rel=\"noreferrer noopener\">disaster recovery (DR) scenarios<\/a>, including hot-site DR, warm-site DR, cold DR, and offsite copy.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"699\" height=\"1024\" src=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy-699x1024.png\" alt=\"Hot\/Live DR: Multi-site Active\/Active; Warm DR: Active\/Active; Cold DR: Active\/Passive; Offsite Copy: Backup Copy\" class=\"wp-image-10761\" srcset=\"https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy-699x1024.png 699w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy-205x300.png 205w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy-768x1126.png 768w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy-1048x1536.png 1048w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy.png 1364w\" sizes=\"auto, (max-width: 699px) 100vw, 699px\" \/><\/figure>\n<\/div>\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong><em>Note:<\/em><\/strong><em>&nbsp;We\u2019ve covered this topic in detail in our article on the&nbsp;<\/em><a target=\"_blank\" href=\"https:\/\/www.resilio.com\/blog\/hot-site-disaster-recovery-solution\" rel=\"noreferrer noopener\"><em>top hot-site&nbsp;<\/em><em>disaster recovery<\/em><em>&nbsp;solutions<\/em><\/a><em>.<\/em><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. Storage and Cloud Flexibility<\/strong><\/h3>\n\n\n\n<p>Unlike S3 Replication (or other proprietary cloud storage and replication services), Resilio builds on open formats, open file formats, open standards, and an open, multi-cloud architecture. This means&nbsp;<strong>Resilio is cloud-agnostic and can be deployed on any infrastructure<\/strong>&nbsp;\u2014 single-cloud, multi-cloud, hybrid cloud, on-prem, and so on.<\/p>\n\n\n\n<p>As a result, you can avoid vendor lock-in and replicate your data across a variety of regions, services, cloud providers, and on-prem storage. For example, Resilio Platform lets you:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Replicate your data quickly, efficiently, and reliably across AWS regions and services.<br><br><\/li>\n\n\n\n<li>Use a variety of cloud storage services (including AWS, Azure, GCP, Wasabi, Backblaze, and more) and file storage solutions.<br><br><\/li>\n\n\n\n<li>Browse and sync files on file, block, or object storage via popular tools on operating systems like Mac and Windows.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>Lastly, Resilio also runs on VMware, Citrix, and other virtualization platforms. And it can be deployed on your existing infrastructure and begin replicating extremely quickly, as we\u2019ll discuss in a bit.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>3. Built-In Scalability<\/strong><\/h3>\n\n\n\n<p>A big downside of traditional point-to-point replication topologies is that they become less reliable as the number of replication endpoints (and object sizes) increases. As a result, the replication speed and data accuracy take a hit.<\/p>\n\n\n\n<p>Resilio\u2019s P2P architecture makes our solution organically scalable, so&nbsp;<strong>the more servers you add, the better Resilio performs<\/strong>.<\/p>\n\n\n\n<p>For example,&nbsp;<strong>Resilio can synchronize data 50% faster than point-to-point solutions in a 1:2 scenario and 500% faster in a 1:10 scenario.<\/strong>&nbsp;Our engineers have even successfully tested replicating 250+ million files in a single job with Resilio Connect.&nbsp;<\/p>\n\n\n\n<p>Put simply,<strong>&nbsp;Resilio\u2019s built-in scalability makes it ideal for tons of&nbsp;<\/strong><strong>replication<\/strong><strong>use cases<\/strong>, regardless of the network, number of endpoints, regions, cloud providers, and number of objects (or files).<\/p>\n\n\n\n<p>For a real-life example of Resilio Connect\u2019s speed, scalability, and efficiency, check out&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/casestudies\/voicebase\/\" rel=\"noreferrer noopener\">our case study with VoiceBase<\/a>.<\/p>\n\n\n\n<p>VoiceBase is a speech-to-text solution for audio and video transcription. Data accuracy is the most demanding aspect of their work, as it requires over 50GB of files to be disseminated to over 400 production servers as fast as possible. Thanks to Resilio Connect, the VoiceBase team now confidently overcomes this challenge.<\/p>\n\n\n\n<p><strong><em>\u201cResilio Platform enables us to reliably distribute our code, specifically new language models in a fraction of time. These copy jobs now take an hour, down from eight. Best of all, once Resilio Platform was installed, it just works: We never need to manually intervene in any way.\u201d&nbsp;<\/em><\/strong><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>4. Simple Setup and Management<\/strong><\/h3>\n\n\n\n<p>While replication in AWS can be complex to set up, manage, and debug, Resilio Platform makes the process much simpler.<\/p>\n\n\n\n<p><strong>Our agent-based software can be deployed on your existing infrastructure<\/strong>, including industry-standard desktops, servers, storage, and networks. It can be configured cross-platform on Linux, Ubuntu, OS X, Android, iOS, and Microsoft Windows servers. And as we said, it can be deployed on-prem, in the cloud, and in hybrid cloud scenarios.<\/p>\n\n\n\n<p>In short,&nbsp;<strong>Resilio Platform can be configured on your infrastructure and begin&nbsp;<\/strong><strong>replicating<\/strong><strong>&nbsp;in as little as two hours<\/strong>.<\/p>\n\n\n\n<p>You also don\u2019t need to purchase any new hardware when working with Resilio. Instead, you can continue using the storage your team already uses, like DAS, NAS, or SAN. You can even blend storage capacity from any type of storage \u2014 hard drives, SSDs, storage systems, and so on.<\/p>\n\n\n\n<p>After the setup, Resilio Platform also gives you an easy way to monitor, control, and debug the replication process with our REST API and Management Console.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"989\" height=\"1024\" src=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview-989x1024.png\" alt=\"Resilio Platform Overview, General Info, Statistics\" class=\"wp-image-10166\" srcset=\"https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview-989x1024.png 989w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview-290x300.png 290w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview-768x795.png 768w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview-1483x1536.png 1483w, https:\/\/getsynccom.wpenginepowered.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview.png 1510w\" sizes=\"auto, (max-width: 989px) 100vw, 989px\" \/><\/figure>\n<\/div>\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>The console gives you plenty of options to navigate the replication process and optimize its resource use by adjusting key parameters, like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Buffer size, packet size, and network performance.<\/li>\n\n\n\n<li>Disk io threads, data hashing, and file priorities.<\/li>\n\n\n\n<li>Server bandwidth.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>You can also schedule server bandwidth rules for different times of days or weeks, optimize your file servers to cache files on-demand and minimize data transfer costs, and much more.<\/p>\n\n\n\n<p>For example,&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/casestudies\/mixhits-radio\/\" rel=\"noreferrer noopener\">MixHits Radio uses Resilio Connect<\/a>&nbsp;to update metadata across their servers. Their team has experienced massive time savings thanks to Resilio\u2019s simplicity and ability to coordinate and troubleshoot the process from a single place.<\/p>\n\n\n\n<p>Here\u2019s what MixHits Radio CEO Gary Hanna had to say about working with Resilio Connect:<\/p>\n\n\n\n<p><strong><em>\u201cWe have gone from spending 15 hours on average per week troubleshooting conflicts in the prior solution to spending no time at all with Resilio. We configure jobs once in the Resilio Platform Management Console and never have to look at it again.\u201d&nbsp;<\/em><\/strong><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>5. Enterprise-Grade Security<\/strong><\/h3>\n\n\n\n<p>Storing your data in S3 \u2014 or any other cloud storage service \u2014 and moving it across regions and services always comes with security risks. That\u2019s why it\u2019s imperative to take all possible measures for your data\u2019s safety during its storage and replication.&nbsp;<\/p>\n\n\n\n<p>Resilio Platform helps you do that with its&nbsp;<strong>state-of-the-art security and&nbsp;<\/strong><strong>data protection<\/strong><strong>&nbsp;features<\/strong>, including:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>AES 256 encryption for protecting your data at rest and in transit.<br><br><\/li>\n\n\n\n<li>Mutual authentication keys for guaranteeing your data gets delivered only to designated endpoints.<br><br><\/li>\n\n\n\n<li>Cryptographic data validation integrity for preventing data loss and ensuring data arrives at its destination uncorrupted.<br><br><\/li>\n\n\n\n<li>One-time session encryption keys.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>Lastly, Resilio\u2019s security features are reviewed by 3rd-party security experts to guarantee the highest level of protection for your data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Overcome Delays and Get Reliable S3 Replication Every Time with Resilio<\/h2>\n\n\n\n<p>Resilio Platform can help you achieve real-time,&nbsp;<a target=\"_blank\" href=\"https:\/\/www.resilio.com\/blog\/reliable-bidirectional-sync-for-files-everywhere-and-for-everyone\" rel=\"noreferrer noopener\">bi-directional (two-way) replication<\/a>&nbsp;with and across AWS regions, services, on-prem environments, and even other cloud providers. Besides providing industry-leading replication speeds, our software is also:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Highly resilient, making it an ideal solution for disaster recovery scenarios.<br><br><\/li>\n\n\n\n<li>Flexible, as you can use it with various AWS services, other cloud providers, and on-prem environments.<br><br><\/li>\n\n\n\n<li>Organically scalable, thanks to its P2P architecture that performs better as you add more replication endpoints.&nbsp;<br><br><\/li>\n\n\n\n<li>Simple to set up and manage, because it can be deployed on your existing infrastructure and start replicating in as little as two hours.<br><br><\/li>\n\n\n\n<li>Secure, thanks to AES 256 protection and a myriad of other security features built by our engineering team and verified by 3rd-party security experts.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><em>To learn more about how Resilio Platform can help your business,&nbsp;<\/em><a target=\"_blank\" href=\"https:\/\/www.resilio.com\/schedule-demo\/\" rel=\"noreferrer noopener\"><em>schedule a demo with our team<\/em><\/a><em>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Learn about the typical S3 replication delays &#038; how to monitor and eliminate them with Resilio.<\/p>\n","protected":false},"author":47,"featured_media":10962,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[274,248,227,284],"tags":[142,158],"class_list":["post-10960","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cloud","category-disaster-recovery","category-serversync","category-storage-gateway","tag-featured-secondary","tag-featured-tertiary"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>S3 Replication Latency: What to Expect &amp; How to Reduce Delays | Resilio Blog<\/title>\n<meta name=\"description\" content=\"Learn about the typical S3 replication delays &amp; how to monitor and eliminate them with Resilio.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"S3 Replication Latency: What to Expect &amp; How to Reduce Delays\" \/>\n<meta property=\"og:description\" content=\"Learn about the typical S3 replication delays &amp; how to monitor and eliminate them with Resilio.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\" \/>\n<meta property=\"og:site_name\" content=\"Resilio Blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-08T22:15:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-04T17:36:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"2000\" \/>\n\t<meta property=\"og:image:height\" content=\"987\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Eleanor Parker\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"S3 Replication Latency: What to Expect &amp; How to Reduce Delays\" \/>\n<meta name=\"twitter:description\" content=\"Learn about the typical S3 replication delays &amp; how to monitor and eliminate them with Resilio.\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Eleanor Parker\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#article\",\"isPartOf\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\"},\"author\":{\"name\":\"Eleanor Parker\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/a1f04a7adcac173bd7a7316a7635a3f6\"},\"headline\":\"S3 Replication Latency: What to Expect &amp; How to Reduce Delays\",\"datePublished\":\"2023-06-08T22:15:25+00:00\",\"dateModified\":\"2024-05-04T17:36:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\"},\"wordCount\":2492,\"publisher\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg\",\"keywords\":[\"Featured-secondary\",\"Featured-tertiary\"],\"articleSection\":[\"Cloud Sync\",\"Disaster Recovery\",\"Server Sync\",\"Storage Gateway\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\",\"url\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\",\"name\":\"S3 Replication Latency: What to Expect &amp; How to Reduce Delays | Resilio Blog\",\"isPartOf\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg\",\"datePublished\":\"2023-06-08T22:15:25+00:00\",\"dateModified\":\"2024-05-04T17:36:48+00:00\",\"description\":\"Learn about the typical S3 replication delays & how to monitor and eliminate them with Resilio.\",\"breadcrumb\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage\",\"url\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg\",\"contentUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg\",\"width\":2000,\"height\":987,\"caption\":\"S3 Replication Latency: What to Expect & How to Reduce Delays\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.resilio.com\/blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"S3 Replication Latency: What to Expect &amp; How to Reduce Delays\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#website\",\"url\":\"https:\/\/blog.resilio.com\/blog\/\",\"name\":\"Resilio Blog\",\"description\":\"Explore Common Use cases, How to&#039;s, Comparisons &amp; More\",\"publisher\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.resilio.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#organization\",\"name\":\"Resilio\",\"url\":\"https:\/\/blog.resilio.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png\",\"contentUrl\":\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png\",\"width\":512,\"height\":512,\"caption\":\"Resilio\"},\"image\":{\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.linkedin.com\/company\/resilio-inc.\",\"https:\/\/youtube.com\/resilio\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/a1f04a7adcac173bd7a7316a7635a3f6\",\"name\":\"Eleanor Parker\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/aca5b8499f094cf3d5a48268db9af9986aa05dd0fbc48736bfccd2910f7860cf?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/aca5b8499f094cf3d5a48268db9af9986aa05dd0fbc48736bfccd2910f7860cf?s=96&d=mm&r=g\",\"caption\":\"Eleanor Parker\"},\"url\":\"https:\/\/blog.resilio.com\/blog\/author\/eparker\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"S3 Replication Latency: What to Expect &amp; How to Reduce Delays | Resilio Blog","description":"Learn about the typical S3 replication delays & how to monitor and eliminate them with Resilio.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency","og_locale":"en_US","og_type":"article","og_title":"S3 Replication Latency: What to Expect & How to Reduce Delays","og_description":"Learn about the typical S3 replication delays & how to monitor and eliminate them with Resilio.","og_url":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency","og_site_name":"Resilio Blog","article_published_time":"2023-06-08T22:15:25+00:00","article_modified_time":"2024-05-04T17:36:48+00:00","og_image":[{"width":2000,"height":987,"url":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg","type":"image\/jpeg"}],"author":"Eleanor Parker","twitter_card":"summary_large_image","twitter_title":"S3 Replication Latency: What to Expect & How to Reduce Delays","twitter_description":"Learn about the typical S3 replication delays & how to monitor and eliminate them with Resilio.","twitter_image":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg","twitter_misc":{"Written by":"Eleanor Parker","Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#article","isPartOf":{"@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency"},"author":{"name":"Eleanor Parker","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/a1f04a7adcac173bd7a7316a7635a3f6"},"headline":"S3 Replication Latency: What to Expect &amp; How to Reduce Delays","datePublished":"2023-06-08T22:15:25+00:00","dateModified":"2024-05-04T17:36:48+00:00","mainEntityOfPage":{"@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency"},"wordCount":2492,"publisher":{"@id":"https:\/\/blog.resilio.com\/blog\/#organization"},"image":{"@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage"},"thumbnailUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg","keywords":["Featured-secondary","Featured-tertiary"],"articleSection":["Cloud Sync","Disaster Recovery","Server Sync","Storage Gateway"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency","url":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency","name":"S3 Replication Latency: What to Expect &amp; How to Reduce Delays | Resilio Blog","isPartOf":{"@id":"https:\/\/blog.resilio.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage"},"image":{"@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage"},"thumbnailUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg","datePublished":"2023-06-08T22:15:25+00:00","dateModified":"2024-05-04T17:36:48+00:00","description":"Learn about the typical S3 replication delays & how to monitor and eliminate them with Resilio.","breadcrumb":{"@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.resilio.com\/blog\/s3-replication-latency"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#primaryimage","url":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg","contentUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/s3-replication-latency.jpeg","width":2000,"height":987,"caption":"S3 Replication Latency: What to Expect & How to Reduce Delays"},{"@type":"BreadcrumbList","@id":"https:\/\/blog.resilio.com\/blog\/s3-replication-latency#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.resilio.com\/blog"},{"@type":"ListItem","position":2,"name":"S3 Replication Latency: What to Expect &amp; How to Reduce Delays"}]},{"@type":"WebSite","@id":"https:\/\/blog.resilio.com\/blog\/#website","url":"https:\/\/blog.resilio.com\/blog\/","name":"Resilio Blog","description":"Explore Common Use cases, How to&#039;s, Comparisons &amp; More","publisher":{"@id":"https:\/\/blog.resilio.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.resilio.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blog.resilio.com\/blog\/#organization","name":"Resilio","url":"https:\/\/blog.resilio.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png","contentUrl":"https:\/\/blog.resilio.com\/wp-content\/uploads\/2024\/05\/cropped-resilio-icon-digital-navy-background.png","width":512,"height":512,"caption":"Resilio"},"image":{"@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/resilio-inc.","https:\/\/youtube.com\/resilio"]},{"@type":"Person","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/a1f04a7adcac173bd7a7316a7635a3f6","name":"Eleanor Parker","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.resilio.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/aca5b8499f094cf3d5a48268db9af9986aa05dd0fbc48736bfccd2910f7860cf?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/aca5b8499f094cf3d5a48268db9af9986aa05dd0fbc48736bfccd2910f7860cf?s=96&d=mm&r=g","caption":"Eleanor Parker"},"url":"https:\/\/blog.resilio.com\/blog\/author\/eparker"}]}},"_links":{"self":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/posts\/10960","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/users\/47"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/comments?post=10960"}],"version-history":[{"count":0,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/posts\/10960\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/media\/10962"}],"wp:attachment":[{"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/media?parent=10960"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/categories?post=10960"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.resilio.com\/blog\/wp-json\/wp\/v2\/tags?post=10960"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}