It is compatible with Snappy content, but has two format extensions. MinIO uses a compression method based on Snappy called S2. Transparent Compression at IO SpeedĬompression for MinIO has been developed to enable transparent compression without affecting the overall performance of the system. We want to offer an option to have this data compressed before it is stored on disks. However, for custom data, it is preferable to keep data in an uncomplicated format which doesn’t include a decompression step to access. Video and images are also typically compressed with domain-specific algorithms that offer better compression than generic formats. While there are widely used formats for image, video, and sound compression, most other data is stored as text, as JSON, CSV, or other similar text-based formats.įormats like Parquet, Avro, and ORC have optional compression, so typically these formats are already compressed when stored. Most data is stored in easy to read file formats for easy application interoperability. We will look at the benefits of enabling compression, and how to fine-tune settings in MinIO. In this blog post we will discuss the transparent data compression options in MinIO. Docs Blog Resources Partner Pricing Download VMware Discover how MinIO integrates with VMware across the portfolio from the Persistent Data platform to TKGI and how we support their Kubernetes ambitions. HDFS Migration Modernize and simplify your big data storage infrastructure with high-performance, Kubernetes-native object storage from MinIO. Splunk Find out how MinIO is delivering performance at scale for Splunk SmartStores Veeam Learn how MinIO and Veeam have partnered to drive performance and scalability for a variety of backup use cases. No need to move the data, just query using SnowSQL. Snowflake Query and analyze multiple data sources, including streaming data, residing on MinIO with the Snowflake Data Cloud. Commvault Learn how Commvault and MinIO are partnered to deliver performance at scale for mission critical backup and restore workloads. Integrations Browse our vast portfolio of integrations SQL Server Discover how to pair SQL Server 2022 with MinIO to run queries on your data on any cloud - without having to move it.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |