Dynatrace

APRIL 5, 2021

AWS Lambda enables organizations to access many types of functions from AWS’ cloud-based services, such as: Data processing, to execute code based on triggers, system states, or user actions. Real-time stream processing to perform live activity tracking, data cleansing, metrics generation, and more. Data entering a stream.

Lambda 181

Lambda AWS Serverless Hardware 181

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. When a new hardware device is connected, the Local Registry detects and collects a set of information about it, such as networking information and ESN.

Latency 213

Latency Traffic Transportation Hardware 213

CSS Wizardry

AUGUST 7, 2019

The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. TTFB isn’t just time spent on the server, it is also the time spent getting from our device to the sever and back again (carrying, that’s right, the first byte of data!).

Latency 269

Latency Ecommerce Servers Mobile 269

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. The first 5G networks are now deployed and operational.

Energy 130

Energy Latency Performance Network 130

The Morning Paper

NOVEMBER 15, 2020

An IDS/IPS monitors network flows and matches incoming packets (or more strictly, Protocol Data Units, PDUs) against a set of rules. This makes the whole system latency sensitive. The FPGA hardware really wants to operate in a highly parallel mode using fixed size data structures. IDS/IPS requirements.

Servers 128

Servers Hardware Latency Design 128

Percona

NOVEMBER 9, 2023

Kubernetes manages and orchestrates these containers, handling tasks such as deployment, scaling, load balancing, and networking. Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. have adopted Kubernetes.

Efficiency 106

Efficiency Cloud Healthcare Open Source 106

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all.

Best Practices 52

Best Practices Design Tuning Database 52

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. The recipe was straightforward. Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

VoltDB

JUNE 19, 2017

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. This requires 1 ms network latency. These have to communicate with each other.

Latency 40

Latency Retail Virtualization Hardware 40

VoltDB

JUNE 19, 2017

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. This requires 1 ms network latency. These have to communicate with each other.

Latency 40

Latency Retail Virtualization Hardware 40

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. With an on-prem data center, the organization bears the burden of securing the physical infrastructure and its digital assets. What is cloud migration?

Cloud 167

Cloud Traffic Best Practices Strategy 167

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. Until and unless teams have better data about their performance, the global baseline budget should be enforced. What's changed since last year? And how much more HTML, CSS, and (particularly) JavaScript can a new project afford?

Performance 90

Performance Network Mobile Speed 90

Dotcom-Montior

MAY 12, 2020

Network or connection error. Network latency. Hardware resources. Network Latency. With the evolution of cloud technologies, such as Single Page Applications (SPAs), Web APIs, and Model View Controller (MVC), network latency has become a crucial factor to be monitored. Hardware Resources.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Abhishek Tiwari

JULY 12, 2018

Building data pipelines can offer strategic advantages to the business. Often companies underestimate the necessary effort and cost involved to build and maintain data pipelines. Data pipeline initiatives are generally unfinished projects. In this post, we will discuss why you should avoid building data pipelines in first place.

Latency 63

Latency Analytics Scalability Engineering 63

Scalegrid

APRIL 16, 2020

Since our BYOC plans are hosted through your own AWS or Azure account, all cloud instances, backups and data transfer costs are paid directly through your cloud provider. While this is a good way to get a rough estimate, your monthly cloud costs will indeed vary based on the amount of backups performed and your data transfer activity.

Cloud 242

Cloud Azure AWS Database 242

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., When a QoS violation is predicted to occur and a culprit microservice located, Seer uses a lower level tracing infrastructure with hardware monitoring primitives to identify the reason behind the QoS violation.

Big Data 45

Big Data Cloud Performance Hardware 45

Percona

JUNE 22, 2023

Database uptime and availability Monitoring database uptime and availability is crucial as it directly impacts the availability of critical data and the performance of applications or websites that rely on the MySQL database. Disk space usage Monitor the disk space usage of MySQL data files, log files, and temporary files.

Performance 108

Performance Monitoring Traffic Database 108

The Morning Paper

JANUARY 28, 2020

Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " User functions need to be isolated from each other, and from the parts of the data that they shouldn’t be allowed to see. In databases you probably know it as stored procedures.

Serverless 99

Serverless Storage Latency Cloud 99

HammerDB

OCTOBER 23, 2023

With a simple example such as this, it would not necessarily be expected for the additional network traffic to be significant between the 2 approaches. However, with more complex application logic this network round trip soon becomes a key focus area for improving performance. On MySQL, we saw a 1.5X performance advantage.

Benchmarking 62

Benchmarking Database Network C++ 62

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

O'Reilly Software

APRIL 4, 2018

Considerations for setting the architectural foundations for a fast data platform. Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. Back in the days of Web 1.0,

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

SQL Performance

APRIL 27, 2020

Many of the newer features we have in SQL Server were initially launched in Azure SQL Database, including (but not limited to) Always Encrypted, Dynamic Data Masking, Row Level Security, and Query Store. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. DTU Pricing Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs.

Big Data 154

Big Data Processing Lambda Database 154

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

Percona

MAY 2, 2023

Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB. ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. Since my data set is 100GB, I would like to see ChatGPT explicitly mention that a good starting point would be 100GB. What could it be? What could it be?

Social Media 125

Social Media Database Servers Cache 125

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

CSS Wizardry

OCTOBER 27, 2018

Things always always feel fast when we’re developing because, more often than not, we’re working on high-spec machines on dedicated networks, and also serving from localhost which removes the bulk of the latency and bandwidth issues that a real user would suffer. need to go out of our way to spot the problems.

Performance Testing 172

Performance Testing Testing Performance Strategy 172

The Morning Paper

MARCH 3, 2020

You’d probably prefer it if your EBS volume didn’t fail (lose data, or become unavailable). EBS uses chain replication for availability, with data flowing from client to primary to replica. This work is latency critical, because volume IO is blocked until it is complete. A node may participate in many cells.

Database 106

Database AWS Network Design 106

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Highly Scalable

SEPTEMBER 18, 2012

Although it can hardly be said that NoSQL movement brought fundamentally new techniques into distributed data processing, it triggered an avalanche of practical studies and real-life trials of different combinations of protocols and algorithms. Data Placement. Data Placement. Data Consistency. Read/Write latency.

Database 213

Database Latency C++ Scalability 213

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. There are also stateless interconnects including buses and on-chip networks. Microarchitectural channels. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44