The Morning Paper

NOVEMBER 10, 2019

Snap: a microkernel approach to host networking Marty et al., This paper describes the networking stack, Snap , that has been running in production at Google for the last three years+. The desire for CPU efficiency and lower latencies is easy to understand. SOSP’19. Emphasis mine). It reminds me of ZeroMQ.

Network 92

Network Transportation Latency Entertainment 92

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device.

Analytics 214

Analytics Monitoring Artificial Intelligence DevOps 214

Dynatrace

FEBRUARY 23, 2022

IaC, or software intelligence as code , codifies and manages IT infrastructure in software, rather than in hardware. According to a Gartner report, “By 2023, 60% of organizations will use infrastructure automation tools as part of their DevOps toolchains, improving application deployment efficiency by 25%.”. and 2.14.1.

Serverless 271

Serverless Infrastructure Innovation DevOps 271

Dynatrace

JULY 8, 2019

I’ve been speaking to customers over the last few months about our new cloud architecture for Synthetic testing locations and their confusion is clear. When we wanted to add a location, we had to ship hardware and get someone to install that hardware in a rack with power and network. Hardware was outdated.

Cloud 202

Cloud Hardware Testing Logistics 202

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 105

Availability Database Open Source Hardware 105

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. Network effects are not the same as monopoly control. You can even go old school and use non cloud-native architectures. Cloud providers incur huge fixed costs for creating and maintaining a network of datacenters spread throughout the word.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Dynatrace

OCTOBER 28, 2021

But with the complexity that comes with digital transformation and cloud-native architecture, teams need a way to make sure applications can withstand the “chaos” of production. Dynatrace news. Testing for mishaps you can predict is essential. Any failures in the stack break the hypothesis. Blast radius. That’s a good thing.

Engineering 231

Engineering Entertainment Cloud Infrastructure 231

Scalegrid

JANUARY 8, 2024

Real-world examples like Spotify’s multi-cloud strategy for cost reduction and performance, and Netflix’s hybrid cloud setup for efficient content streaming and creation, illustrate the practical applications of each model. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. What is Hybrid Cloud?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

AUGUST 30, 2019

Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. Reducing performance and architectural issues in their backend system gave them a 99% performance improvement! A highly distributed architecture like this has a lot of potential for performance and architectural hotspots.

Cache 201

Cache Architecture Database Government 201

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. Gone are the days of monolithic architecture. These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network.

Systems 74

Systems Monitoring Hardware Network 74

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Dynatrace news. What is AWS Lambda? Customizing and connecting these services requires code.

Lambda 184

Lambda AWS Serverless Hardware 184

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 85

Database Hardware Open Source Strategy 85

The Morning Paper

NOVEMBER 15, 2020

Improving the efficiency with which we can coordinate work across a collection of units (see the Universal Scalability Law ). An IDS/IPS monitors network flows and matches incoming packets (or more strictly, Protocol Data Units, PDUs) against a set of rules. Increasing the amount of work we can do on a single unit. Introducing Pigasus.

Servers 128

Servers Hardware Latency Design 128

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. This ensures each Redis® instance optimally uses the in-memory data store and aligns with the operating system’s efficiency.

Strategy 130

Strategy Monitoring Latency DevOps 130

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. TFLOPS FP-64, 14.8

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Dynatrace

SEPTEMBER 30, 2021

Like any move, a cloud migration requires a lot of planning and preparation, but it also has the potential to transform the scope, scale, and efficiency of how you deliver value to your customers. This can fundamentally transform how they work, make processes more efficient, and improve the overall customer experience. Here are three.

Cloud 169

Cloud Traffic Best Practices Strategy 169

The Morning Paper

MAY 19, 2019

The net result of rapid advancements in the networking world is that inter-tier communications latency will approach the fundamental lower bound of speed-of-light propagation in the foreseeable future. At one extreme we have a ‘16 x 1’ architecture with 16 queues each with one associated processing unit.

Latency 80

Latency Hardware Network Architecture 80

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 111

Virtualization AWS Hardware Storage 111

Sutter's Mill

NOVEMBER 11, 2023

If you want to do efficient linear algebra, you don’t want to write your own code by hand; that would be slow. Instead, you want a library that is tuned for your target hardware architecture and ready for par_unseq vectorized algorithms, for blazing speed. This is that library.

C++ 107

C++ Lambda Network Programming 107

All Things Distributed

MARCH 11, 2016

The expectation was that with each order or two of magnitude, we would need to revisit and revise the architecture to make sure we could address the issues of scale. We needed to build such an architecture that we could introduce new software components without taking the service down. The importance of the network.

AWS 144

AWS Hardware Retail Virtualization 144

The Netflix TechBlog

DECEMBER 23, 2020

This abstraction allows the compute team to influence the reliability, efficiency, and operability of the fleet via the scheduler. Titus internally employs a cellular bulkhead architecture for scalability, so the fleet is composed of multiple cells. We do this for reliability, scalability, and efficiency reasons.

Media 286

Media Metrics Systems Processing 286

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We formulate the problem as a Mixed Integer Program (MIP).

Cache 251

Cache Latency Airlines Logistics 251

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

High Scalability

NOVEMBER 25, 2019

Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice. To add elasticity, reliability and durability, these data centers are connected to Google Cloud platform using high speed, secure Google Interconnect network.

Architecture 52

Architecture Cache Azure Storage 52

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. What's changed since last year? and 75KiB of JavaScript.

Performance 90

Performance Network Mobile Speed 90

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Race logic has four primary operations that are easy to implement in hardware: MAX, MIN, ADD-CONSTANT, and INHIBIT. One efficient way of doing that in analog hardware is the use of current-starved inverters.

Energy 52

Energy Hardware Efficiency Architecture 52

All Things Distributed

JULY 20, 2015

Today, I want to explore the Amazon ECS architecture and what this architecture enables. The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). Let’s talk about what Amazon ECS is actually doing.

Latency 166

Latency Architecture AWS Open Source 166

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

MARCH 8, 2020

When I think about cloud-native architectures, I think about disaggregation (enabling each resource type to scale independently), fine-grained units of resource allocation (enabling rapid response to changing workload demands, i.e. elasticity), and isolation (keeping tenants apart). From shared-nothing to disaggregation. The scorecard.

Storage 112

Storage Engineering Cache Serverless 112

ACM Sigarch

OCTOBER 25, 2018

Over the last two decades, processor designers have extracted significant performance by leveraging architectural solutions and process innovations. So does this mean the current generation of out-of-order architecture is approaching fundamental limits in ST performance? to extract ILP during execution.

Architecture 67

Architecture Technology Technology Innovation 67

Sutter's Mill

FEBRUARY 13, 2017

.” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. Note that the class size is limited to about 100, so that I’ll be able to interact with most attendees directly. Description.

Latency 51

Latency C++ Hardware Performance 51

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. When available, it can use hardware level performance counters.

Big Data 45

Big Data Cloud Performance Hardware 45

Percona

AUGUST 15, 2023

Network Connectivity: Establish a reliable network connection between the primary and replica servers. Below is an example architecture for Group Replication. Failover ensures that if the primary MySQL server becomes unavailable due to hardware failure or another issue, the system seamlessly switches to a standby replica.

Servers 52

Servers Database Availability Traffic 52

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

JUNE 25, 2019

There’s another emerging option that we didn’t talk about there: the use of far-memory , memory attached to the network that can be remotely accessed without mediation by a local processor. That said, I’m excited to see where far memory architectures might take us in a few years time!

Design 80

Design Cache Hardware Scalability 80

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. As a consequence, the vast majority of the papers in the past has usually focused on conventional X86 or GPU-accelerated architectures.

Architecture 12

Architecture Hardware Cache Storage 12