Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

InfoQ

JUNE 16, 2023

The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Caching partially stores your data and is not used as permanent storage. Caching Schemes.

Cache 125

Cache Performance Servers Social Media 125

VoltDB

JULY 10, 2018

There are further requirements for high performance in the following: Telecom: vEPC or 5G Core. In these use cases, data processing usually has less than a 5 milliseconds latency budget. The post Scalable MicroService Architecture appeared first on VoltDB. Problem solved, right? Close, but not quite. Call fraud prevention.

Architecture 40

Architecture Scalability Ecommerce Latency 40

VoltDB

JULY 10, 2018

There are further requirements for high performance in the following: Telecom: vEPC or 5G Core. In these use cases, data processing usually has less than a 5 milliseconds latency budget. The post Scalable MicroService Architecture appeared first on VoltDB. Problem solved, right? Close, but not quite. Call fraud prevention.

Architecture 40

Architecture Scalability Ecommerce Latency 40

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Morning Paper

AUGUST 29, 2019

We group the DBMS design choices and tradeoffs into three broad categories, which result from the need for dealing with (A) external storage; (B) query executors that are spun on demand; and (C) DBMS-as-a-service offerings. InS does now offer an NVMe variant too, and the authors perform limited testing on that as well. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The best they can usually do in real-time using general purpose tools is to filter and look for patterns of interest.

IoT 78

IoT Analytics Big Data Architecture 78

ScaleOut Software

JULY 21, 2020

Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval. From its inception, the design philosophy behind ScaleOut StateServer has been to simultaneously maximize both performance and ease of use.

Analytics 52

Analytics Airlines Cache Scalability 52

ScaleOut Software

JULY 21, 2020

Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval. From its inception, the design philosophy behind ScaleOut StateServer has been to simultaneously maximize both performance and ease of use.

Analytics 52

Analytics Airlines Cache Scalability 52

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Managed DBaaS solutions like ScaleGrid.io

Cache 130

Cache Storage Scalability Architecture 130

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dotcom-Montior

OCTOBER 6, 2021

Site reliability engineers are focused with creating scalable and reliable software systems, so this also includes ensuring that development work is efficient and reliable, so when the finished product is ready for production, there are no surprises. Performance. appeared first on Dotcom-Monitor Web Performance Blog.

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Customers can provision up to 10,000 IOPS (input/output operations per second) per database instance to help ensure that their databases can run the most stringent workloads with rock solid, consistent performance. High Performance I/O. Comments ().

Cloud 117

Cloud AWS Storage Database 117

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. This new Region has been highly requested by companies worldwide, and it provides low-latency access to AWS services for those who target customers in South America. Driving Storage Costs Down for AWS Customers. All Things Distributed. Comments ().

AWS 114

AWS Latency Storage Big Data 114

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. Pipeline reliability and performance go hand in hand. If tuned for performance, there is a good change reliability is compromised - and vice versa.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 127

Performance Hardware Tuning Storage 127

All Things Distributed

NOVEMBER 13, 2014

Capital-intensive storage solutions became as simple as PUTting and GETting objects in Amazon S3. We’re excited about event-driven computing – using AWS Lambda to extend other AWS services helps developers create applications that are simple, powerful, and inherently scalable.

Lambda 136

Lambda AWS Cloud Scalability 136

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). overall performance comparable to bare metal. The good news is all of these challenges including performance can be tackled and in several cases, there are new developments to overcome them. Performance. Storage provisioning. Native frameworks.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Dynatrace

JANUARY 17, 2024

An AI observability strategy—which monitors IT system performance and costs—may help organizations achieve that balance. AI requires more compute and storage. Training AI data is resource-intensive and costly, again, because of increased computational and storage requirements. AI performs frequent data transfers.

Strategy 219

Strategy Artificial Intelligence Storage Cloud 219

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Almost immediately after the launch of Amazon EC2, our customers started to use it for High Performance Computing.

Cloud 118

Cloud AWS Automotive Latency 118

HammerDB

DECEMBER 5, 2020

The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput.

C++ 40

C++ Benchmarking Virtualization Open Source 40

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. This achieves very low-latency for queries which is crucial for the overall performance of internet applications.

Cloud 117

Cloud Internet Internet AWS 117

Scalegrid

MARCH 14, 2024

This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential. Tailoring resource allocation efficiently ensures faster application performance in alignment with organizational demands. A hybrid cloud strategy could be your answer.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments ().

AWS 60

AWS Cloud Latency Storage 60

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Storage is a critical aspect to consider when working with cloud workloads. What is workload in cloud computing?

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. There are four main reasons to do so: Performance - For many applications and services, data access latency to end users is important. The new Singapore Region offers customers in APAC lower-latency access to AWS services. All Things Distributed.

AWS 61

AWS Cloud Latency Storage 61

High Scalability

JULY 20, 2018

This is where your performance goes. A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds.

Internet 121

Internet Internet Scalability Automotive 121

The Netflix TechBlog

OCTOBER 27, 2020

Iceberg is widely adopted in Netflix as a data warehouse table format that addresses many of the usability and performance problems with Hive tables. The data warehouse is not designed to serve point requests from microservices with low latency. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

NOVEMBER 3, 2022

When a new leader is elected it loads all data from external storage. In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. Active data includes jobs and tasks that are currently running.

Cache 224

Cache Latency Traffic Systems 224

Dynatrace

SEPTEMBER 25, 2019

Citrix is a sophisticated, efficient, and highly scalable application delivery platform that is itself comprised of anywhere from hundreds to thousands of servers. Platform performance —get visibility into the performance of the Citrix platform to optimize application delivery. Dynatrace Extension: SAP ABAP platform performance.

Latency 117

Latency Performance Virtualization Infrastructure 117

The Netflix TechBlog

APRIL 26, 2022

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. Then we started hitting roadblocks while optimizing the query performance. We plan to split these Keystone streams into multiple streams for horizontal scalability.

Storage 187

Storage Design Scalability Latency 187