<\/p>\n\n\n\n
However, GSTS also has downsides. Mainly, it can be very difficult to deploy and manage. <\/strong>In situations where you\u2019ll be movingor syncing large files, larger file systems, or multiple file systems in multiple directions \u2014 for example, two-way, one-to-many, many-to-one, or many-to-many \u2014 you may want to consider alternatives. <\/p>\n\n\n\n In these cases, a solution like Resilio Platform is well suited to moving and syncing data in any direction, across any cloud <\/em>provider<\/em> \u2014 using any type of device and network. To learn more about Resilio Platform or see it live in action, <\/em>please schedule a demo<\/em><\/a>. <\/em><\/p>\n\n\n\n Specifically, limitations with GSTS include: <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n In the second part of this guide, we\u2019ll discuss how Resilio Connect<\/a> \u2014 our WAN-optimized data replication, sync, and file gateway solution \u2014 can help you overcome these downsides. <\/p>\n\n\n\n Resilio Platform enables omnidirectional, real-time sync <\/strong>across cloud regions, cloud providers, on-prem environments, and hybrid cloud infrastructure. Our solution offers:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Brands like Exxon Mobil, 2K Games, Warner Brothers, Cisco, and KFC use Resilio Platform to achieve fast and reliable data transfer, sync, and replication. To see Resilio in action for yourself, <\/em>schedule a demo with our team<\/em><\/a>.<\/em><\/p>\n\n\n\n GSTS is a software-based solution (SaaS) that can transfer data from various sources to destinations in Google Cloud Storage (unlike Google\u2019s Transfer Appliance which is a hardware-based transfer solution). <\/p>\n\n\n\n At the time of this writing, the supported sources are:<\/p>\n\n\n\n <\/p>\n\n\n\n You can also use GSTS to transfer data from Google Storage to file systems or between two file systems. Make sure to refer to Google\u2019s documentation on sources and links<\/a> for the most up-to-date info on this topic.<\/p>\n\n\n\n Regardless of the source and destination, GSTS:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Depending on the use case, you can get started in different ways, including the Google Cloud console, REST APIs, the Gcloud command-line tool, and Java or Python client libraries.<\/p>\n\n\n\n In terms of the setup, transfers where the source and\/or destination is a file system or S3-compatible storage require agents and agent pools, while transfers from other sources don\u2019t. For more details about each use case and transfer option, check out Google\u2019s documentation on agent-based transfers<\/a> and agentless transfers<\/a>.<\/p>\n\n\n\n GSTS also uses a parallelized architecture to accelerate transfer speeds. You can create multiple parallel transfers, which is especially useful (but also time-consuming and difficult to do) when transferring a large number of relatively small files.<\/p>\n\n\n\n Besides simply transferring data to the cloud, you can also use GSTS for:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n In terms of pricing, GSTS charges $0.0125 per GB transferred to the destination <\/strong>successfully for agent-based transfers to or from file systems. The service is free for agentless transfers or for agent-based transfers from S3-compatible storage. <\/p>\n\n\n\n However, remember that you\u2019ll also incur regular storage charges, as well as charges for moving data from one storage bucket to another. There are also other factors that can contribute to your charges and you can learn more about them here<\/a>.<\/p>\n\n\n\n If your transfer operation involves a file system or S3-compatible storage, you\u2019ll need to set up GSTS agents. These agents are apps that can only run on Linux servers and VMs inside a Docker container. <\/p>\n\n\n\n There are no other deployment options here, which can overcomplicate your <\/strong>workflow<\/strong> and cost you lots of time<\/strong> if Linux and Docker aren\u2019t part of your regular tech stack.<\/p>\n\n\n\n For example, say you’ve got a NAS system with Windows systems connected to it. In order to use GSTS, you first have to set up the Linux VMs and Docker containers. Then, you have to mount the storage and copy it into the Linux VM, after which it can get transferred. This whole process can take a lot of engineering hours.<\/p>\n\n\n\n Not to mention, IT teams that use Windows (or other non-Linux technologies) likely won’t be comfortable with their data running through Linux.<\/p>\n\n\n\n GSTS can be easy to use for simpler projects, like one-time transfers or cloud migrations from one site to GCP. However, things get exponentially more difficult if you want to maximize transfer speeds in a larger project.<\/strong><\/p>\n\n\n\n For example, say you have to transfer a few hundred million files. GSTS has a maximum number of allowed queries per second (QPS) per transfer job. Since transferring data can trigger list, read, and write operations, you can easily hit this limit. Theoretically, you could overcome this by partitioning up your dataset and having multiple parallel transfers running concurrently.<\/p>\n\n\n\n In reality, this can be a very cumbersome process. First, you have to do the math on exactly how many Linux VMs you\u2019ll need on the source site (or sites) to handle each part of the load based on the throughput you need to achieve. And that\u2019s before you start setting them up. <\/p>\n\n\n\n The bigger issue is that you\u2019re actually creating multiple points of management.<\/strong> For instance, if you need five Linux instances, you now have five points of management. You also have to get the data from your source servers into these instances at scale, which can be very difficult.<\/p>\n\n\n\n GSTS\u2019s features don\u2019t work the same way when it comes to cloud object storage vs. Cloud Storage transfers vs. file system transfers. For example:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n You can learn more about these differences in Google\u2019s documentation<\/a>.<\/p>\n\n\n\n Resilio Platform is a software-only, agent-based file transfer, sync, and replication solution that delivers the fastest transfer speeds across multiple locations over any distance. <\/p>\n\n\n\n You can deploy Resilio directly on your endpoint devices<\/strong> \u2014 from mobile phones to desktops, servers, cloud instances, and many more. There\u2019s no need to buy new hardware or work with a particular set of technologies (like Linux and Docker). <\/p>\n\n\n\n Our solution also lets you manage on-premise and cloud data from one unified management view, from any location. You can set up, manage, and monitor data transfer, sync, and replication jobs from one central place, without needing to partition your dataset to increase throughput (like with GSTS). Plus, all jobs can be automated via the graphical management console, scripts, or APIs.<\/p>\n\n\n\n Brands like Mercedes-Benz<\/a>, Deutsche Aircraft<\/a>, and Northern Marine Group<\/a> use Resilio Platform to:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n As we said, GSTS\u2019 transfer agents run only on Linux servers or VMs and require having Docker installed. This means you\u2019ll often be forced to use Linux and Docker even if they\u2019re not part of your usual technology stack, which can overcomplicate your workflow.<\/p>\n\n\n\n In contrast, Resilio Platform offers much simpler and more flexible deployment options. Resilio is an agent-based, cross-platform solution that runs on your choice of physical or virtual machines<\/strong>. Agents run on Windows, Linux, macOS, FreeBSD, and some NAS systems.Deployment options include:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Resilio is also a cloud-agnostic solution that can be deployed on any infrastructure<\/strong> \u2014 single-cloud, multi-cloud, hybrid cloud, on-premises, and so on. <\/p>\n\n\n For example, Resilio Platform lets you:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Put simply, Resilio lets you continue using your current solutions and gives you the freedom to move data across any number of storage systems and cloud service providers without restricting you to Docker, Linux, or any other technology.<\/p>\n\n\n\n Conventional transfer solutions like GSTS are limited by \u201cpoint-to-point\u201d architectures. These architectures usually come in one of two topologies \u2014 client-server or \u201cfollow-the-sun\u201d.<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Both of these topologies create bottlenecks by limiting data transfers or syncs to only two devices at a time (be it from hub to client or from one device to another). This leads to slower transfer speeds and creates single points of failure in your environment.<\/p>\n\n\n\n To overcome this issue, Resilio Platform uses a unique P2P (peer-to-peer) architecture. With this architecture, every device in your environment can transfer data across other devices<\/strong>. As a result, you can leverage the full bandwidth of your environment, leading to much faster transfer, sync, and replication speeds.<\/p>\n\n\n\n Resilio Platform also uses file chunking to turn files into several chunks when sharing them. Each one can be transferred independently from the others. <\/p>\n\n\n\n For example, say Device A wants to sync data to Devices B, C, D, and E. Device A can transfer the first block to Device B. Once it receives the block, Device B can share it with any other device in the network while Device A sends the remaining blocks. This mechanism results in transfer speeds that are 3-10x faster than traditional solutions.<\/strong><\/p>\n\n\n These capabilities work automatically, regardless of the size and number of files you need to transfer or sync. There\u2019s no need to manually partition your data<\/strong> in order to get fast, reliable, and efficient data transfers every time.<\/p>\n\n\n\n In short, our solution is ideal for transferring or syncing lots of files to locations all over the world, regardless of the network, number of endpoints, regions, and cloud providers. <\/p>\n\n\n\n For example, VoiceBase uses Resilio Platform to distribute 50 GB of files to 400 servers<\/a> quickly and reliably. They were able to achieve an 88% drop in software distribution time thanks to Resilio.<\/p>\n\n\n\n Besides contributing to our industry-leading speeds, the P2P architecture makes Resilio an organically scalable solution<\/strong>.<\/p>\n\n\n\n This means that adding more endpoints only speeds up transfers and increases available bandwidth. As a result, you can use the full bandwidth of your environment to sync thousands of systems and millions of files quickly, reliably, and efficiently. Resilio can sync data 50% faster than point-to-point solutions in a 1:2 scenario and 500% faster in a 1:10 scenario.<\/p>\n\n\n\n The P2P architecture also doesn\u2019t have a single point of failure<\/strong>. If one endpoint goes down, Resilio Platform can simply retrieve data from the nearest available endpoint by automatically routing around the outage. <\/p>\n\n\n Plus, in the event of a server failure or another disaster, Resilio can utilize all of your servers to achieve sub-five-second RPOs (Recovery Point Objectives) and RTOs (Recovery Time Objectives) within minutes of an outage.<\/p>\n\n\n\n This makes Resilio an ideal disaster recovery software<\/a> for use cases like:<\/p>\n\n\n\n <\/p>\n\n\n\n Unlike GSTS, and other typical file transfer<\/a> and replication solutions<\/a>, Resilio Platform can sync all data \u2014 including cloud data \u2014 in any direction: one-way, two-way, one-to-many, many-to-one, and N-way (full mesh). <\/p>\n\n\n This versatility makes Resilio Platform perfect for lots of use cases. <\/p>\n\n\n\n Let\u2019s take n-way synchronization as an example. Say you have a workforce that\u2019s distributed across the globe. With n-way sync, everyone can make changes to files and have those changes immediately distributed to every other office, regardless of where they\u2019re working from. As a result, everyone can be sure they\u2019re working on the same file versions.<\/p>\n\n\n\n The same goes for syncing a large environment of servers. With Resilio\u2019s P2P architecture and n-way sync, every server in the environment can sync across the others in real-time, without having to rely on a hub server. This makes the whole process much faster and more efficient, as you can utilize the environment\u2019s full bandwidth. <\/p>\n\n\n\n With GSTS, you may need to partition your dataset manually in order to achieve maximum transfer speeds in some cases. Besides being time-consuming, this process creates multiple points of management (i.e., servers or VMs running Docker and Linux).<\/p>\n\n\n\n Resilio Platform avoids that complexity by giving you a single point of management for all data transfer, replication, and sync jobs<\/strong> in the form of a Central Management Console. <\/p>\n\n\n\n Here are some examples of things you can do with the Console:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n The Management Console also shows you all key metrics for tracking each job\u2019s progress, including duration, number of Resilio agents, number of agents, total bytes to transfer, maximum speed, ETAs, and more.<\/p>\n\n\n Lastly, you can store the console pretty much anywhere, including: <\/p>\n\n\n\n <\/p>\n\n\n\n And, because you can easily control every data movement aspect,\u00a0you don\u2019t need to manage NFS mounts or manage data across remote devices.\u00a0<\/strong><\/p>\n\n\n\n For a real-life example of the power of Resilio\u2019s Central Management Console, check out our case study with MixHits Radio<\/a>. They were able to massively reduce their troubleshooting times thanks to the Management Console.<\/p>\n\n\n\n \u201cWe have gone from spending 15 hours on average per week troubleshooting conflicts in the prior solution to spending no time at all with Resilio. We configure jobs once in the Resilio Platform Management Console and never have to look at it again.\u201d <\/em><\/strong><\/p>\n\n\n\n \u2014 Gary Hanna, CEO of Mixhits Radio<\/em><\/p>\n\n\n\n Most file transfer solutions use the TCP protocol for transfers over wide area networks (WANs). This can be a big issue because latency and packet loss (which are defining characteristics of WANs) disrupt TCP\u2019s performance.<\/p>\n\n\n\n TCP treats packet loss as a network congestion issue and reduces the transfer speed in response. However, packet loss is not a network congestion issue in WANs, so you end up getting data transfer speeds that are significantly lower than the available bandwidth of your internet provider. This prevents you from fully utilizing expressive WAN connections and synchronizing data across multiple sites and cloud providers.<\/p>\n\n\n\n That\u2019s why Resilio Platform uses a proprietary, UDP-based transfer protocol called Zero Gravity Transport\u2122 (ZGT). <\/strong>ZGT intelligently analyzes the underlying network by measuring packet loss, latency, and throughput over time, allowing it to:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n This technology is designed for unreliable networks<\/strong>, so you can always rely on it to ingest, sync, and replicate terabytes of data from the edge of a network to a centralized location in predictable timeframes. If you want more details on how ZGT works, check out our detailed WAN Optimization Whitepaper<\/a>.<\/p>\n\n\n\n In the event of an outage, network failure, or another similar issue, Resilio Platform can also perform checksum restarts. This allows failed transfers to continue where they left off, which reduces the strain on your network since you\u2019re not transferring the same more than once.<\/p>\n\n\n\n Lastly, we have a free speed calculator on our website<\/a>, which you can use to see how much time Resilio Platform can save your business, depending on your use case (server sync, file send, remote work, and so on).<\/p>\n\n\n Overall, the combination of P2P architecture, WAN acceleration<\/a>, and file chunking enables Resilio to deliver the fastest transfer speeds in the industry<\/strong>. For example:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Resilio Platform is a flexible object storage gateway<\/a> solution that lets you ingest, sync, and access files across any cloud storage provider (including GCP, AWS, Azure, Backblaze, and more). <\/p>\n\n\n\n Additionally, our solution operates in a very efficient way to keep your cloud costs as low as possible. Here\u2019s how:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n Lastly, Resilio is also a great solution if you want to provide people in your organization with low-latency access to the data they need. This is done through a very simple interface that operates similarly to Microsoft OneDrive, as you can see below.<\/p>\n\n\n Using this interface, people in your organization can access the data they need quickly and efficiently, regardless of where it\u2019s stored<\/strong>. <\/p>\n\n\n\n For example, say you have key operational data stores in different environments, including on-prem servers and cloud storage services like Azure Blobs, Amazon S3, and Google Storage. Resilio Platform gives your teams a unified view of all that data, while TSS lets them browse, sync, or download the files they want to on-prem devices where they can be cached locally.<\/p>\n\n\n\n Our solution provides end-to-end data protection and encryption for data at rest and in transit. This means there\u2019s no reliance on 3rd-party security tools or services when working with Resilio Connect.<\/p>\n\n\n\n Some of the most essential security features of Resilio include:<\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n\n\n\n\n
\n
\n
\n
\n
\n
\n
\n
Google Storage Transfer Service: How It Works, Pricing, & Limitations<\/h2>\n\n\n\n
\n
\n
\n
\n
\n
\n
\n
\n
Downside #1: Limited Deployment Options<\/h3>\n\n\n\n
Downside #2: Time-Consuming Setup and Management for Large Projects <\/h3>\n\n\n\n
Downside #3: Differences in Transfer Features Depending on the Data Source and Destination<\/h3>\n\n\n\n
\n
\n
\n
How Resilio Platform Delivers Fast and Reliable Transfer and Sync in Any Direction<\/h2>\n\n\n
![\"Person](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/06\/TPN-banner-v3-1024x626.png\")
<\/figure>\n<\/div>\n\n\n\n
\n
\n
\n
\n
\n
Flexible Deployment Options \u2014 No Technology Limitations<\/h3>\n\n\n\n
\n
\n
\n
![\"Storage](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/08\/image3-1024x776.png\")
<\/figure>\n<\/div>\n\n\n\n
\n
\n
\n
\n
Fast, Reliable, and Predictable Transfer Speeds across Any Network<\/h3>\n\n\n\n
\n
\n
![\"GIF](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2022\/09\/image2.gif\")
<\/figure>\n<\/div>\n\n\n![\"Hot\/Live](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/04\/hot-dr-warm-dr-cold-dr-and-offsite-copy-699x1024.png\")
<\/figure>\n<\/div>\n\n\n\n
Transfer, Sync, and Replicate in Any Direction<\/h3>\n\n\n\n
![\"Resilio](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/09\/Resilio-is-peer-to-peer-1024x512.png\")
<\/figure>\n<\/div>\n\n\nCentralized Granular Control over All Ingest, Replication, and Sync Tasks<\/h3>\n\n\n\n
\n
\n
\n
\n
\n
\n
\n
![\"Resilio](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2022\/07\/resilio-connect-overview-989x1024.png\")
<\/figure>\n<\/div>\n\n\n\n
High-Speed WAN Transfers and Full Utilization of Any Network<\/h3>\n\n\n\n
\n
\n
\n
![\"Cross](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/08\/cross-region-replication-Azure-3-1024x668.png\")
<\/figure>\n<\/div>\n\n\n\n
\n
\n
Efficient File Transfer and Access<\/h3>\n\n\n\n
\n
\n
\n
\n
![\"How](\"https:\/\/blog.resilio.com\/wp-content\/uploads\/2023\/04\/always-keep-on-this-device-option-761x1024.png\")
<\/figure>\n<\/div>\n\n\nState-of-the-Art Security by Default<\/h3>\n\n\n\n
\n
\n
\n
\n
\n