Dynatrace

JANUARY 26, 2021

Traditional computing models rely on virtual or physical machines, where each instance includes a complete operating system, CPU cycles, and memory. REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms. The provider is essentially your system administrator.

Serverless 243

Serverless Efficiency Lambda Azure 243

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. Our Premium High Availability comes with the following features: Active-active deployment model for optimum hardware utilization. Save on costs for hardware and network bandwidth to optimize total cost of ownership. Self-contained turnkey solution.

Availability 246

Availability Hardware Latency Traffic 246

Dynatrace

APRIL 5, 2021

AWS Lambda is a serverless compute service that can run code in response to predetermined events or conditions and automatically manage all the computing resources required for those processes. Real-time file processing, for quickly indexing files, processing logs, and validating content. How does AWS Lambda work?

Lambda 179

Lambda AWS Serverless Hardware 179

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 102

Database Benchmarking Latency C++ 102

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post.

Latency 213

Latency Traffic Transportation Hardware 213

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. So why mess with it?

Cache 251

Cache Latency Airlines Logistics 251

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success.

Best Practices 84

Best Practices Hardware Tuning Scalability 84

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

The Morning Paper

NOVEMBER 15, 2020

This stems from a combination of Jevon’s paradox and the interconnectedness of systems – doing more in one area often leads to a need for more elsewhere too. At the end of the day, there are three basic ways we can increase capacity: Increasing the number of units in a system (subject to Amdahl’s law ). IDS/IPS requirements.

Servers 128

Servers Hardware Latency Design 128

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. As datasets continue to grow in size, the amount of RAM required to store and process these datasets also increases. Refer to innodb_redo_log_capacity below.

Performance 123

Performance Hardware Tuning Storage 123

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. A key step in digital transformation is migrating from traditional on-prem IT processes to adopting cloud services. What is cloud migration?

Cloud 165

Cloud Traffic Best Practices Strategy 165

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. An advanced observability solution can also be used to automate more processes, increasing efficiency and innovation among Ops and Apps teams.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. A distributed file system provides a unified view over aggregated storage from multiple physical machines.

Storage 64

Storage Systems Hardware Efficiency 64

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The Mobile Web Worker (MWW) System. The current system assumes an application specific regression model is available on the servers which can predict processing time given the current parameters of the job (e.g.

Mobile 104

Mobile Cloud Latency Games 104

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. A finely tuned database processes queries more efficiently, leading to swifter results. MySQL relies heavily on the availability of hardware resources to perform at its best.

Tuning 52

Tuning Database Performance Hardware 52

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand. Emphasis mine).

Network 92

Network Transportation Latency Entertainment 92

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Percona

JUNE 22, 2023

There are multiple tables MySQL internal system manages that come in handy, identifying the inefficient indexes, to name a few: sys.schema_unused_indexes, and information_schema.index_statistics. It is advisable to have a dedicated production MySQL Server that can independently claim the system resources as needed.

Performance 102

Performance Monitoring Traffic Database 102

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

Dotcom-Montior

MAY 12, 2020

They now allow users to interact more with the company in the form of online forms, shopping carts, Content Management Systems (CMS), online courses, etc. A request will be sent from the client-side and an HTTP check waits on the server port to get the message, process it, and then send back the response. Network latency.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set.

Latency 68

Latency C++ Cache Programming 68

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. What about short-lived processes, like a service restarting in a loop? Microbenchmark os::javaTimeMillis() on both systems.

Speed 126

Speed Java AWS Virtualization 126

Dotcom-Montior

DECEMBER 8, 2021

Systems, web applications, servers, devices, etc., SREs and DevOps teams can use these incidents to build back better and improve their systems and services. Now that we have talked about what an incident is, incident management is the process by which teams resolve these events and bring systems and services back to normal operation.

Social Media 90

Social Media Monitoring Latency DevOps 90

HammerDB

OCTOBER 18, 2019

So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests. So by default, the system boots into powersave. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00 uname -a Linux ubuntu19 5.3.0-rc3-custom

Benchmarking 63

Benchmarking Performance Hardware C++ 63

The Morning Paper

MAY 21, 2019

” This paper describes a “far memory” system that has been in production deployment at Google since 2016. This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions.

Software 78

Software Software Google Hardware 78

Dotcom-Montior

NOVEMBER 11, 2020

Serverless computing can be a huge benefit to organizations that don’t have the necessary resources or teams to manage physical resources, like servers/hardware, and all the maintenance and licensing that goes along with that, allowing them to focus on developing their code and applications. Benefits of a Serverless Model.

Serverless 57

Serverless Monitoring Lambda Latency 57

The Morning Paper

JULY 4, 2019

Are you ready to take your system assurance programme to the next level? In all cases we need to be able to carefully monitor the impact on the system, and back out if things start going badly wrong. Netflix’s system is deployed on the public cloud as complex set of interacting microservices.

Latency 77

Latency Engineering Metrics Traffic 77

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

APRIL 14, 2019

Just as today’s systems offer memory protection, they call this time protection. The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. set out a principled basis for protecting against this class of attacks.

Hardware 44

Hardware Cache Latency Speed 44

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. A guiding principle.

Database 106

Database AWS Network Design 106

Percona

MAY 2, 2023

Let’s look at some questions I did that a MySQL DBA usually needs to answer in an interview process. Keep in mind that setting the buffer pool size too high may result in other processes on your server competing for memory, which can impact performance. Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB.

Social Media 119

Social Media Database Servers Cache 119

Brendan Gregg

AUGUST 8, 2017

Linux load averages are "system load averages" that show the running thread (task) demand on the system as an average number of running plus waiting threads. This measures demand, which can be greater than what the system is currently processing. then your system is idle. - cat /proc/loadavg. 42/3411 43603.

Latency 111

Latency Metrics C++ Systems 111

HammerDB

OCTOBER 23, 2023

Stored Procedures and Client SQL comparison To test the stored procedures and client implementations, we ran both workloads against a system equipped with Intel Xeon 8280L. This in itself is not an issue as it means we are well within the systems bandwidth capabilities. On MySQL, we saw a 1.5X performance advantage.

Benchmarking 62

Benchmarking Database Network C++ 62