Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 160

Cloud Traffic Best Practices Strategy 160

Percona

MAY 2, 2023

Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB. Keep in mind that setting the buffer pool size too high may result in other processes on your server competing for memory, which can impact performance. Q: I have a MySQL server, and my application is writing at a rate of 100 MB/hour in my redo logs.

Social Media 120

Social Media Database Servers Cache 120

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. First off there still is a model of course (but then there are servers hiding behind a serverless abstraction too!). autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

Dotcom-Montior

NOVEMBER 11, 2020

Well, to start, serverless, or serverless computing , doesn’t really mean there aren’t servers involved, because there are, rather it refers to the fact that the responsibility of having to manage, scale, provision, maintain, etc., Focus on Application Development. Benefits of a Serverless Model. Scalability. Response Times.

Serverless 57

Serverless Monitoring Lambda Latency 57

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

APRIL 16, 2020

This is why our BYOC pricing is less than our Dedicated Hosting pricing, as the costs listed for BYOC are only what you pay for ScaleGrid and don’t include your hardware costs. Deploying your application and database on the same VPC also provides the lowest possible latency path. Where to host your cloud database? Security Groups.

Cloud 242

Cloud Azure AWS Database 242

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. Advantages and Disadvantages of Serverless.

Serverless 64

Serverless Architecture Lambda Azure 64

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. The simple answer is to just spin up more servers. More servers means more capacity. Spinning up more servers just won’t cut it.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. The simple answer is to just spin up more servers. More servers means more capacity. Spinning up more servers just won’t cut it.

Performance 40

Performance Hardware Latency Infrastructure 40

Abhishek Tiwari

JULY 12, 2018

In recent times, in order to gain valuable insights or to develop the data-driven products companies such as Netflix, Spotify, Uber, AirBnB have built internal data pipelines. This includes both data pipeline developed using batch-driven frameworks such as Apache AirFlow, Luigi, etc.

Latency 63

Latency Analytics Scalability Engineering 63

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

All Things Distributed

JULY 13, 2010

Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use. Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

JANUARY 23, 2012

VM Import allows our customers to move virtual machine images from their datacenters to the Cloud and Amazon Direct Connect makes the network latencies and bandwidth between on-premises and AWS more predictable. AWS Identity and Access Management brings together on-premises and cloud identity management. blog comments powered by Disqus.

Storage 115

Storage AWS Virtualization Cloud 115

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. These storage nodes collaborate to manage and disseminate the data across numerous servers spanning multiple data centers.

Storage 130

Storage Systems Big Data Azure 130

O'Reilly

JANUARY 16, 2024

I’ve been diligent about data backup throughout my life, but my files are fragmented amongst different media over the years—burning CDs and DVDs back in the day, several generations of external hard drives (that are in various states of decay), university servers, Dropbox, and other cloud services.

Entertainment 76

Entertainment Internet Internet Design 76

KeyCDN

AUGUST 15, 2019

In the context of web development, performance testing entails using software tools to simulate how an application runs under specific circumstances. Bottlenecks can occur, for example, if you have a sudden surge in traffic that your servers are not equipped to handle. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. AWS Lambda functions are an example of how a serverless framework works: Developers write a function in a supported language or platform.

Serverless 241

Serverless Efficiency Lambda Azure 241

Tim Kadlec

SEPTEMBER 25, 2014

Another interesting note was how significant the impact of hardware has on the timing. So what’s a web developer to do? Render on the server If you’re using a client-side MVC framework, make sure you pre-render on the server. The result was a 10x reduction in startup latency. Use less JavaScript.

Latency 41

Latency Google Hardware Servers 41

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe.

AWS 116

AWS Airlines Latency Games 116

Dotcom-Montior

NOVEMBER 24, 2021

Web developers or administrators did not have to worry or even consider the complexity of distributed systems of today. Do you have a web server? Is the web server running? The last item to check was if the web server was able to talk to the database? There is no single server or machine that takes care of the workload.

Systems 74

Systems Monitoring Hardware Network 74

SQL Server According to Bob

JANUARY 11, 2020

Microsoft, ​​ Windows, ​​ Windows NT, ​​ and Windows Server ​​ are registered trademarks of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

Servers 40

Servers Cache Database Media 40

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. We’ve developed the fundamental skill of managing the “blast radius” of a failure occurrence such that the overall health of the system can be maintained. It started by providing server-side encryption in S3 for compliance use cases.

AWS 144

AWS Hardware Retail Virtualization 144

Smashing Magazine

AUGUST 22, 2021

This part is a bit more technical than the first, though it offloads most of the really deep stuff to outside sources, focusing on explaining why these things matter to the average web developer. Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth.

Performance 107

Performance Network Latency Servers 107

The Netflix TechBlog

FEBRUARY 9, 2021

Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. To reduce latency, assets should be generated in an offline fashion and not in real time. Localized images for each of the titles.

Engineering 165

Engineering Storage Latency Entertainment 165

Percona

NOVEMBER 9, 2023

Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. Telecommunications : By guaranteeing low-latency communication, Kubernetes assists the telecom sector in quickly deploying 5G and edge computing applications.

Efficiency 99

Efficiency Cloud Healthcare Open Source 99

The Morning Paper

JULY 4, 2019

degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors).

Latency 77

Latency Engineering Metrics Traffic 77

All Things Distributed

JANUARY 18, 2012

s Dynamo technology , which was one of the first non-relational databases developed at Amazon. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity. History of NoSQL at Amazon â??

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy.

AWS 52

AWS Database Serverless Storage 52

Alex Russell

JUNE 20, 2020

is an open collaboration between Google, Microsoft , Intel , Samsung , and others to safely bring capabilities to the web which native developers have come to expect. 1] Expansions of the web's power can seem by turns scary, capricious, or a distraction from the real problems developers face. [2]. Chromium's Project Fugu ??

Hardware 55

Hardware Games Java Media 55

The Morning Paper

MARCH 3, 2020

This work is latency critical, because volume IO is blocked until it is complete. Cells are spread across a mesh of nodes (each node running on a single server). Larger cells have better tolerance of tail latency (e.g. Thus the configuration master is under stress just when you need it the most. Cells have seven nodes.

Database 106

Database AWS Network Design 106

Alex Russell

MARCH 6, 2021

Meanwhile, developer behaviour offers little hope: Median mobile JavaScript payloads have only grown since 2016, now hovering above 400KiB of script transferred, or nearly 2.5MiB of uncompressed JS. Hardware Past As Performance Prologue. Compared to devices wealthy developers carry, the performance is night and (blinding) day.

Performance 124

Performance Network Cache Metrics 124

Brendan Gregg

SEPTEMBER 5, 2017

Switching from Solaris to Linux has become much easier in the last two years, with Linux developments in ZFS, Zones, and DTrace. Linux has also been developing its own ZFS-like filesystem, btrfs. Since ZFS is an add-on developed out-of-tree, it will always be harder to get the same level of attention. LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

MAY 20, 2020

This metric shows how much time it takes for the server to respond with something. This metric is important, but quite vague because it can include anything — starting from server rendering time and ending up with latency problems. Let’s assume that you’ve decided to develop a library and publish it to NPM.

Performance 100

Performance Metrics Best Practices Code 100