{"id":16933,"date":"2023-04-24T01:53:35","date_gmt":"2023-04-23T23:53:35","guid":{"rendered":"https:\/\/contabo.com\/blog\/?p=16933"},"modified":"2023-10-10T15:12:42","modified_gmt":"2023-10-10T13:12:42","slug":"migrate-from-amazon-s3-to-contabo-object-storage","status":"publish","type":"post","link":"https:\/\/contabo.com\/blog\/migrate-from-amazon-s3-to-contabo-object-storage\/","title":{"rendered":"How to Migrate from Amazon S3 to Contabo Object Storage"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1200\" height=\"630\" src=\"https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage.jpg\" alt=\"How to Migrate from Amazon S3 to Contabo Object Storage (head Image)\" class=\"wp-image-16934\" srcset=\"https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage.jpg 1200w, https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage-600x315.jpg 600w, https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage-768x403.jpg 768w\" sizes=\"auto, (max-width: 1200px) 100vw, 1200px\" \/><\/figure>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>As businesses and individuals continue to generate vast amounts of data, the need for efficient and reliable cloud storage solutions has become increasingly important. Amazon S3 has long been a popular choice for many, offering scalability, durability, and accessibility However, as the amount of data is growing, more and more people are willing to move to cheaper S3-compatible cloud storage providers. Contabo Object Storage is one such provider, offering an affordable and flexible alternative to Amazon S3. In this article, we will guide you through the process of migrating from Amazon S3 to Contabo Object Storage, outlining the steps you need to take to ensure a smooth transition without any data loss or downtime. Whether you are a small business or a large corporation, this tutorial will help you make an informed decision and enable you to take advantage of the benefits offered by Contabo Object Storage.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-prerequisites-requirements\">Prerequisites\/Requirements<\/h2>\n\n\n\n<p>In order to flawlessly migrate from Amazon S3 to Contabo Object Storage a few things are required:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>An Amazon S3 Storge + Credentials (e.g. S3 URL, Access Key and Secret Key)&nbsp;<\/li>\n\n\n\n<li><a href=\"https:\/\/contabo.com\/en\/object-storage\" target=\"_blank\" rel=\"noreferrer noopener\">A Contabo Object Storage<\/a> + Credentials (e.g. S3 URL, Access Key and Secret Key)&nbsp;<\/li>\n\n\n\n<li>A Server with a Linux-based operating system (WSL would be enough)&nbsp;<\/li>\n\n\n\n<li>Rclone installed on your Linux-server&nbsp;<\/li>\n<\/ul>\n\n\n\n<p><em>Hint:<\/em> To install rclone use this command:&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>apt install rclone \u2013y&nbsp;<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-configure-rclone\">Configure rclone<\/h2>\n\n\n\n<p>To transfer the files from Amazon S3 to Contabo Object Storage we are going to use the tool <a href=\"https:\/\/rclone.org\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">rclone<\/a>.&nbsp;<\/p>\n\n\n\n<p>If you want to learn more about rclone and other tools that work with Contabo Object Storage check out our official documentation <a href=\"https:\/\/docs.contabo.com\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>.&nbsp;<\/p>\n\n\n\n<p>After installing it on our Linux-server, we need to configure the source-server, as well as the destination server. Although your own local PC with WSL on it or a linux workstation could do the job, we recommend using a VPS (e.g. our <a href=\"https:\/\/contabo.com\/en\/vps\/vps-s-ssd\" target=\"_blank\" rel=\"noreferrer noopener\">VPS S SSD<\/a>) because the migration process might take a while depending on the size of the files to copy. It&#8217;s crucial to execute the migration process uninterrupted.\u00a0<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-config-for-amazon-s3-source\">Config for Amazon S3 (Source)<\/h3>\n\n\n\n<p>First, we are going to start with the source server, which in this case is the Amazon S3 storage:&nbsp;<\/p>\n\n\n\n<p>To create a new config run this command:&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>rcone config<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Now type in \u201cn\u201d to make a new remote and press [Enter]&nbsp;<\/li>\n\n\n\n<li>Now enter a name for this config (e.g. Amazon S3 or source).&nbsp;<\/li>\n\n\n\n<li>In our example I will use \u201csource\u201d as the name.&nbsp;<\/li>\n\n\n\n<li>Now type in \u201c4\u201d to select \u201cAmazon S3 Compliant Storage Providers\u201d and press [Enter]&nbsp;<\/li>\n\n\n\n<li>Type \u201c1\u201d to select \u201cAmazon Web Services (AWS) S3\u201d&nbsp;<\/li>\n\n\n\n<li>Again, type in \u201c1\u201d to enter your AWS Credentials&nbsp;<\/li>\n\n\n\n<li>Now fill in your S3-Access Key ID and press [Enter]&nbsp;<\/li>\n\n\n\n<li>Now paste in your S3-Secret Access Key&nbsp;<\/li>\n\n\n\n<li>Skip the next menus by pressing [Enter] until it asks you \u201cEdit advanced config?\u201d&nbsp;<\/li>\n\n\n\n<li>Now type in \u201cn\u201d and press [Enter]&nbsp;<\/li>\n\n\n\n<li>To finish the setup process, save everything by typing in \u201cy\u201d and hitting [Enter] and typing in \u201cq\u201d to leave to configuration menu.&nbsp;<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-config-for-contabo-object-storage-destination\">Config for Contabo Object Storage (Destination)<\/h3>\n\n\n\n<p>Now we can create a second config for our destination server, which in this case will be our Contabo Object Storage.&nbsp;<\/p>\n\n\n\n<p>To create this config, again run this command:&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>rcone config<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Now type in \u201cn\u201d to make a new remote and press [Enter]&nbsp;<\/li>\n\n\n\n<li>Now enter a name for this config (e.g. Contabo S3 or destination).&nbsp;<\/li>\n\n\n\n<li>In our example I will use \u201cdest\u201d as the name.&nbsp;<\/li>\n\n\n\n<li>Now type in \u201c4\u201d to select \u201cAmazon S3 Compliant Storage Providers\u201d and press [Enter]&nbsp;<\/li>\n\n\n\n<li>In the next menu type \u201c2\u201d to select \u201cCeph Object Storage\u201d&nbsp;<\/li>\n\n\n\n<li>Type in \u201c1\u201d to enter your AWS Credentials&nbsp;<\/li>\n\n\n\n<li>Now enter your Access Key and hit [Enter]&nbsp;<\/li>\n\n\n\n<li>Now enter your Secret Key and hit [Enter]&nbsp;<\/li>\n\n\n\n<li>Skip the region by hitting [Enter]&nbsp;<\/li>\n\n\n\n<li>For Endpoint paste in the S3-URL (e.g. https:\/\/eu2.contabostorage.com)&nbsp;<\/li>\n\n\n\n<li>Skip the next two menus by hitting [Enter] two times&nbsp;<\/li>\n\n\n\n<li>Now type in \u201cn\u201d to skip the advanced config&nbsp;<\/li>\n\n\n\n<li>Hit \u201cy\u201d to save the config and exit the config menu by typing in \u201cq\u201d&nbsp;<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-start-the-migration-process\">Start the migration process<\/h2>\n\n\n\n<p>Now after setting up both configs it\u2019s finally time to start the actual migration process.&nbsp;<\/p>\n\n\n\n<p>This can be done with one single command&nbsp;<\/p>\n\n\n\n<p>The scheme for this command is:&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>rclone copy &#91;Name of the Source config]:&#91;Path] &#91;Name of the Destination Config]:&#91;Path]<\/code><\/pre>\n\n\n\n<p>In our example the full command would be:&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>rclone copy source:source dest:dest<\/code><\/pre>\n\n\n\n<p><em>Explanation<\/em>:&nbsp;<\/p>\n\n\n\n<p>The first \u201csource\u201d is the name of the config we\u2019ve just created and I named \u201csource\u201d. The second \u201csource\u201d is the name of the bucket I want copy.&nbsp;<\/p>\n\n\n\n<p>The first \u201cdest\u201d is again the name of the second config we\u2019ve just created and I named \u201cdest\u201d. The second \u201cdest\u201d is again the name of the bucket where I want my files to be copied to.&nbsp;<\/p>\n\n\n\n<p>Depending on the size of your Bucket this process can take some time.&nbsp;<\/p>\n\n\n\n<p>If you want to migrate the whole content at once and not just only a certain bucket, use this command instead:&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>rclone copy source:~ dest:~<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-verify-the-migration-process\">Verify the Migration Process<\/h2>\n\n\n\n<p>Please make sure to check if everything has been copied correctly bevor cancelling\/deleting your Amazon S3 Storage!&nbsp;<\/p>\n\n\n\n<p>This can be done in many different ways. You could for example compare the file counts of the source-server with the destination-server. To do so, use these commands:&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-for-amazon-s3-source-server\">For Amazon S3 (Source-Server):<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code>rclone ls s3:~ --recursive | wc -l<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-for-contabo-object-storage-destination-server-nbsp\">For Contabo Object Storage (Destination-Server):&nbsp;<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code>rclone ls contabo:~ --recursive | wc -l<\/code><\/pre>\n\n\n\n<p><strong>Congrats!<\/strong> You\u2019ve successfully migrated from Amazon S3 to Contabo Object Storage.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this informative guide, you&#8217;ll discover a step-by-step process on how to seamlessly migrate your data from Amazon S3 to Contabo Object Storage. Learn how to transfer your files with ease and without any hassle. Don&#8217;t miss out on this essential tutorial to make your migration process smoother and more efficient.<\/p>\n","protected":false},"author":50,"featured_media":16934,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"_uag_custom_page_level_css":"","site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[18],"tags":[],"ppma_author":[1491],"class_list":["post-16933","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tutorials"],"uagb_featured_image_src":{"full":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage.jpg",1200,630,false],"thumbnail":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage-150x150.jpg",150,150,true],"medium":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage-600x315.jpg",600,315,true],"medium_large":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage-768x403.jpg",768,403,true],"large":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage.jpg",1200,630,false],"1536x1536":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage.jpg",1200,630,false],"2048x2048":["https:\/\/contabo.com\/blog\/wp-content\/uploads\/2023\/04\/blog-head_1200x630_how2-migrate-from-amazon-s3-to-object-storage.jpg",1200,630,false]},"uagb_author_info":{"display_name":"Tobias Mildenberger","author_link":"https:\/\/contabo.com\/blog\/author\/tobias\/"},"uagb_comment_info":0,"uagb_excerpt":"In this informative guide, you'll discover a step-by-step process on how to seamlessly migrate your data from Amazon S3 to Contabo Object Storage. Learn how to transfer your files with ease and without any hassle. Don't miss out on this essential tutorial to make your migration process smoother and more efficient.","authors":[{"term_id":1491,"user_id":50,"is_guest":0,"slug":"tobias","display_name":"Tobias Mildenberger","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/077178d5dce6c3d4c0c0396857a7e544bfdf8adf04145fff5160b33a22e28b1f?s=96&d=mm&r=g","0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""}],"_links":{"self":[{"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/posts\/16933","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/users\/50"}],"replies":[{"embeddable":true,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/comments?post=16933"}],"version-history":[{"count":2,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/posts\/16933\/revisions"}],"predecessor-version":[{"id":17831,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/posts\/16933\/revisions\/17831"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/media\/16934"}],"wp:attachment":[{"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/media?parent=16933"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/categories?post=16933"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/tags?post=16933"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/contabo.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=16933"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}