S3 Product Description
S3 (Object Storage) is a Servercore service for storing and distributing unlimited amounts of unstructured and semi-structured data in one of the pools.
S3 can be connected in one of the pools.
The product supports user types and roles and projects.
Records of S3 operations are saved in audit logs.
How to work with S3
You can work with S3:
- via S3 API, Swift API and Object Storage API. You can use various tools (Rclone, AWS CLI, s3cmd, and others) to work via API;
- via FTP protocol. It uses the Swift API to translate requests to S3; ;
- via the Servercore Control Panel, which executes requests to S3 via the Swift API and Object Storage API. The control panel has limitations when working with a large number of objects and large-sized objects;
- using Terraform.
Use cases
S3 is a universal storage service that can be used for:
- distributing static information (site and application data), data streaming, etc.;
- storing backups and archives. You can schedule server backups to transfer important data to S3;
- storing large volumes of data for machine learning and analytics;
- hosting static websites.
Operating principle
S3 is built on a software-defined distributed storage system. Data is stored as objects and replicated across three independent servers located in different racks.
Objects are stored in buckets and inherit their settings.
S3 has a flat address structure—the storage has no folders or hierarchy, which allows you to quickly access objects via the HTTP protocol.
Each object in the storage contains:
- data;
- a unique identifier used by the hash function to determine the object's location;
- metadata. You can add your own metadata to implement a custom data storage and processing system.