Tim Kadlec

MARCH 22, 2018

In July of that year, Daan Jobsis discovered a technique that the Filament Group would later dub “compressive images”. We have a set of standards for responsive images, browsers have improved image loading—does the compressive images technique still have a place in our workflow? What are compressive images?

Network 76

Network Availability Performance Development 76

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. Last time out we saw how Google have been able to save millions of dollars though memory compression enabled via zswap. ” The big idea. ” The big idea. There are two big “Aha!”

Cache 61

Cache Benchmarking Hardware Java 61

SQL Shack

SEPTEMBER 16, 2020

In this article, we will explore options for a compressed backup of a TDE database. In the previous article, Transparent Data Encryption for SQL Server Always On Availability Groups, we discussed enabling TDE for the existing database in AG. Introduction TDE protects the physical database, log, backup files using the IO encryptions.

Database 104

Database Availability Servers 104

SQL Performance

DECEMBER 27, 2019

Sounds like a great job for compression, right? ON PS_OID ( OID ) ; Then, in order to put archive compression on all but the last partition, I ran the following: ALTER TABLE dbo. Finally, I applied page compression, in place, to the source table. mdf' ) TO FILEGROUP FG_CCI ; --. ALTER TABLE dbo. tblCCI_Partitioned.

Database 70

Database Storage Hardware Efficiency 70

All Things Distributed

JULY 17, 2015

Data compression today is still as important as it was in the early days of computing. We have seen a shift from generic compression to compression for specific file types, especially those in images, audio and video. Data compression , D.A. Hirschberg, Data compression, Computing Surveys 19,3 (1987) 261-297.

Storage 101

Storage 101

The Polyglot Developer

AUGUST 5, 2020

In this tutorial we’re going to see how to take a sprite atlas , composed of a compressed spritesheet and map information, and animate it within a Phaser 3.x The post Animate a Compressed Sprite Atlas in a Phaser Game appeared first on The Polyglot Developer.

Games 59

Games Processing Development 59

DZone

OCTOBER 16, 2023

Determining the most appropriate data types to store the information depends on various factors, including the required precision of float-point values, the content of the values (such as text), compressibility, and query speed. Choosing the right data types in PostgreSQL can significantly impact your database's performance and efficiency.

Best Practices 272

Best Practices Speed Database Efficiency 272

n0derunner

FEBRUARY 17, 2019

Compressability. What space savings should you expect when running databases with default compression in a Nutanix cluster? When we ran the TPCx-HCI benchmark on our cluster we realized about 2:1 savings from compression alone. Compression+Encryption. The uncompressed data size was about 45TB. Data generation.

Database 40

Database Benchmarking Engineering Development 40

DZone

AUGUST 25, 2023

This means axum gets timeouts, tracing, compression, authorization, and more, for free. One of the components of my OpenTelemetry demo is a Rust application built with the Axum web framework. In its description, axum mentions: axum doesn't have its own middleware system but instead uses tower::Service.

Systems 231

Systems 231

SQL Performance

JANUARY 7, 2020

In part 1 , I showed how both page and columnstore compression could reduce the size of a 1TB table by 80% or more. Since the regular columnstore index didn't compress better than page compression on this data set , and took 13 hours longer to get there, I'll focus solely on the more advanced solution using COLUMNSTORE_ARCHIVE compression.

Database 52

Database Processing Performance Engineering 52

Dynatrace

JULY 29, 2021

In this blog post, we announce: Compression of transaction data that’s older than three days. Transaction-data compression for Dynatrace Managed environments. Dynatrace Managed now compresses transaction data that’s older than three days and automatically decompresses the data at read time.

Storage 198

Storage Virtualization Infrastructure Availability 198

CSS Wizardry

APRIL 22, 2020

One of the more fundamental rules of building fast websites is to optimise your assets, and where text content such as HTML, CSS, and JS are concerned, we’re talking about compression. For a more detailed breakdown of the numbers, see the Compression section of the Web Almanac. Gzip is tremendously effective. That’s a 2.8× Round Trips.

Latency 269

Latency Servers Website Speed 269

Dynatrace

MAY 7, 2024

which offers a range of updates: HTTP/2 support: Fluentbit now supports HTTP/2, enabling efficient data transmission with Gzip compression for OpenTelemetry data, enhancing pipeline performance. What’s new in Fluent Bit 3.0 Fluent Bit recently released version 3.0,

Best Practices 243

Best Practices IoT Metrics Storage 243

DZone

DECEMBER 18, 2023

Each topic is discussed in detail, covering relevant techniques, challenges, and future directions while highlighting notable research contributions and their implications.

Energy 169

Energy Efficiency Systems IoT 169

Percona

JANUARY 3, 2024

port=3306 gtid_port=0 status="ONLINE" weight=1 compression=0 max_connections=1000 max_replication_lag=600 use_ssl=0 max_latency_ms=0 }, { hostgroup_id=2 hostname="192.0.0.2" Config file backup Mysqldump Physical snapshot Here will consider ProxySQL configured for async replication with Primary and Replica as shown below in topology.

Traffic 111

Traffic Hardware Cache Servers 111

DZone

OCTOBER 6, 2021

Network Compression. But along with advantages and uses, computer vision has its challenges in the department of modern applications, which deep neural networks can address quickly and efficiently. With the soaring demand for computing power and storage, it is challenging to deploy deep neural network applications.

Network 258

Network Storage Efficiency 258

Smashing Magazine

JULY 20, 2022

WebUtils Bulk Image Compress. WebUtils Bulk Image Compress allows you to compress images and convert them to WebP, JPG, PNG, AVIF, and JXL. WebUtils Bulk Image Compress converts images to WebP, AVIF and JPEG-XL. lets you optimize JPEG, PNG, SVG, GIF, and WebP using lossy or lossless compression up to 10MB per file.

Media 134

Media Programming Mobile Website 134

Dynatrace

DECEMBER 13, 2023

This can be achieved by reducing the size of files or images, using caching, and compressing data. Optimizing images and videos by reducing their size, using compression, or using lazy loading techniques can improve app performance. Optimize images and videos. Optimize battery life.

Best Practices 198

Best Practices Mobile Metrics Performance 198

Percona

JUNE 23, 2023

It is a good practice to compress the backups to save costs on storage and to encrypt the backups so those can’t be used if the files are compromised as long as you keep your encryption keys safe! Percona XtraBackup supports both compression and encryption of the backups. dbxxxx/tb1.ibd dbxxxx/tb2.ibd

Servers 82

Servers Processing Speed Open Source 82

DZone

JANUARY 14, 2021

At the start of the year, I looked into how to better compress the output of a Jekyll site. Here’s a small program to read in a file, compress it and save it as a gzip file. I’ll write up the results to that soon. For now, here’s how to gzip a file using Ruby. Enter zlib. It is used to read and write files in gzip format.

Programming 124

Programming Performance 124

DZone

FEBRUARY 20, 2021

Have you ever wanted to know: How do we compress something, without losing any data? Why do some things compress better than others? Suppose we want to compress a string (Huffman coding can be used with any data, but strings make good examples). Huffman Coding: Why Do I Care? How does GZIP work? In 5 Minutes or Less.

Code 133

Code Programming 133

The Netflix TechBlog

NOVEMBER 9, 2021

To do so, the team evaluated different tools provided by the encoder, with the goal of optimizing the tradeoff between compression efficiency and computational efficiency. With multiple iterations, the team arrived at a recipe that significantly speeds up the encoding with negligible compression efficiency changes.

Media 246

Media Open Source Efficiency Software Engineering 246

Percona

SEPTEMBER 25, 2023

ProxSQL stops routing connections to replicas when the lag is greater than 600. Replica_127.0.0.2>stop >stop replica; Query OK, 0 rows affected (0.01 sec) Still, ProxySQL routes connections to replica, though replication is stopped. Replica_127.0.0.2>stop >stop replica; Query OK, 0 rows affected (0.01 Replica_127.0.0.2>start

Traffic 95

Traffic Servers Monitoring Processing 95

The Netflix TechBlog

NOVEMBER 17, 2022

While conventional video codecs remain prevalent, NN-based video encoding tools are flourishing and closing the performance gap in terms of compression efficiency. Since we cannot directly optimize for a conventional video codec, which is non-differentiable, we exclude the effect of lossy compression in the loop.

Network 292

Network Media Innovation Efficiency 292

Percona

SEPTEMBER 19, 2023

Option 1: Login as the MySQL OS user: shell> sudo -H -u mysql bash Execute: shell> xtrabackup --no-lock=1 --compress --parallel=4 --host=localhost --user=root --password='password_string' --backup=1 --target-dir=/Backup/21Aug 2> /tmp/b0-with-redo-archiving-as-mysql-os-user.log 1.2) 29 based on MySQL server 8.0.34

C++ 107

C++ Servers Storage Speed 107

n0derunner

FEBRUARY 15, 2023

TL;DR If your storage system implements inline compression, performance results with small IO size random writes with time_based and runtime may be inflated with fio versions < 3.3 due to fio generating unexpectedly compressible data when using fio’s default data pattern.

Performance 59

Performance Storage Systems 59

Percona

FEBRUARY 1, 2023

To solve this problem, large data values are compressed and broken into multiple smaller chunks. PLAIN strategy : This strategy disables both compression and out-of-line storage and also disables using single-byte headers for varlena types. EXTENDED strategy : This strategy allows both compression and out-of-line storage.

Storage 93

Storage Scalability Strategy Performance 93

Percona

JANUARY 19, 2023

Compression: Compression is the process of restructuring the data by changing its encoding in order to store it in fewer bytes. There are many compression tools and algorithms for data out there. MySQL supports native compression for InnoDB tables using the Zlib library with the LZ77 compression algorithm.

Open Source 90

Open Source Storage Database Big Data 90

The Netflix TechBlog

FEBRUARY 5, 2020

AV1 is a high performance, royalty-free video codec that provides 20% improved compression efficiency over our VP9† encodes. While our goal is to roll out AV1 on all of our platforms, we see a good fit for AV1’s compression efficiency in the mobile space where cellular networks can be unreliable, and our members have limited data plans.

Media 160

Media Open Source Mobile Hardware 160

The Netflix TechBlog

FEBRUARY 5, 2020

AV1 is a high performance, royalty-free video codec that provides 20% improved compression efficiency over our VP9† encodes. While our goal is to roll out AV1 on all of our platforms, we see a good fit for AV1’s compression efficiency in the mobile space where cellular networks can be unreliable, and our members have limited data plans.

Media 160

Media Open Source Mobile Hardware 160

Dynatrace

NOVEMBER 6, 2023

ActiveGate acts as a secure proxy and compresses and routes observability signals in an optimized manner to Dynatrace servers. The Kubernetes-based app platform can be deployed inside or outside a data center using distributed OpenShift topologies alongside even smaller Red Hat Device Edge.

Retail 258

Retail Analytics Storage Cloud 258

Percona

JUNE 27, 2023

By default, compression, and chunking are enabled. MySQL localhost JS > util.dumpTables("sysbench", ["sbtest1"], "sysbench_dumps", {"compression":"none", "threads":6, chunking:false, dialect:"csv"}) Acquiring global read lock Global read lock acquired Initializing - done 1 tables and 0 views will be dumped.

Database 73

Database Servers Open Source Availability 73

O'Reilly

MARCH 26, 2024

Compression, Transformation, Hallucination, and Generation Training data isn’t stored in the model per se, but large chunks of it are reconstructable given the correct key (“prompt”). There are lots of conversations about whether or not LLMs (and machine learning, more generally) are forms of compression or not.

Artificial Intelligence 110

Artificial Intelligence Social Media Google Internet 110

The Netflix TechBlog

APRIL 17, 2019

A brief look into the history of video standards Historically, video compression standards have been developed by two international standardization organizations, ITU-T and MPEG (ISO). 264/AVC, currently, the most ubiquitous video compression standard supported by modern devices, often in hardware. The success was repeated by H.264/AVC,

Open Source 166

Open Source Scalability Speed Efficiency 166

Smashing Magazine

NOVEMBER 17, 2022

Use Compressed Files. The solution is to optimize our images, compressing them and reducing their size with almost no loss of quality. There’re two well-known compression techniques: Lossy compression. This compression type uses algorithms that eliminate the less critical data to reduce the file size.

Media 105

Media Cache Website Mobile 105

Percona

AUGUST 21, 2023

It is a 100% open source backup solution for all versions of Percona Server for MySQL and MySQL that performs online non-blocking, tightly compressed, highly secure full backups on transactional systems. Download Percona XtraBackup 8.0.34-29

Open Source 84

Open Source AWS Servers Database 84

The Netflix TechBlog

SEPTEMBER 18, 2020

They are continuously innovating compression algorithms to efficiently send high quality audio and video files to our customers over the internet. Chris] There’s a lot of things to consider when we roll out a new compression algorithm. Tell me about some of the exciting projects you’re a part of. Which devices get this treatment?

Analytics 223

Analytics Education Innovation Engineering 223