Dynatrace

JUNE 7, 2023

A typical design pattern is the use of a semantic search over a domain-specific knowledge base, like internal documentation, to provide the required context in the prompt. Our example dashboard below visualizes OpenAI token consumption. This includes OpenAI as well as Azure OpenAI services, such as GPT-3, Codex, DALL-E, or ChatGPT.

Monitoring 164

Monitoring Latency Metrics Azure 164

Dynatrace

JANUARY 31, 2024

For example, a Stanford University and UC Berkeley team noted in a research study that ChatGPT behavior deteriorates over time. Using the example of a chatbot, once the user submits a natural language prompt, RAG summarizes that prompt using semantic data. Consequently, AI model drift and hallucinations emerge as primary concerns.

Cache 204

Cache Azure Infrastructure Monitoring 204

Scalegrid

AUGUST 26, 2020

ScaleGrid MySQL on Azure so you can see which provider offers the best throughput and latency performance. We measure latency in ms 95th percentile latency. During Read-Intensive Workloads, ScaleGrid manages to achieve up to 3 times higher throughput and averages 66% better latency compared to Azure Database.

Azure 299

Azure Benchmarking Database Latency 299

The Netflix TechBlog

MARCH 7, 2024

Since its inception , Metaflow has been designed to provide a human-friendly API for building data and ML (and today AI) applications and deploying them in our production infrastructure frictionlessly. Example use case: Building model explainers Here’s a fascinating example of the usefulness of portable execution environments.

Systems 226

Systems Media Cache Open Source 226

The Netflix TechBlog

NOVEMBER 17, 2022

For example, we invest in next-generation, royalty-free codecs and sophisticated video encoding optimizations. Video downscaling is the most pertinent example herein, which tailors our encoding to screen resolutions of different devices and optimizes picture quality under varying network conditions. A visual example is shown below.

Network 292

Network Media Innovation Efficiency 292

Dynatrace

MARCH 16, 2023

Monitors signals The first attribute of a good SLO is the ability to monitor the four “golden signals”: latency, traffic, error rates, and resource saturation. In practice, however, SLOs’ value varies significantly based on how teams design, deploy, and manage them.

DevOps 214

DevOps Latency Metrics Traffic 214

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. For example, optimizing resource utilization for greater scale and lower cost and driving insights to increase adoption of cloud-native serverless services.

AWS 246

AWS Efficiency Azure Cloud 246

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. For example, on a 128GB memory host, this can allow up to 38.4GB of dirty pages. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

MAY 17, 2023

The Dynatrace Site Reliability Guardian is designed for this practice; it allows development teams to define quality objectives in their code, which is validated throughout the delivery process before the code reaches production. The queries are depicted below (sensitive data has been removed).

DevOps 186

DevOps Traffic Latency Best Practices 186

The Netflix TechBlog

OCTOBER 26, 2021

Continuing on an example from Part 3 , a false negative corresponds to labeling the photo of the cat as a “not cat.” False negatives are closely related to the statistical concept of power , which gives the probability of a true positive given the experimental design and a true effect of a specific size.

Testing 202

Testing Latency Metrics Innovation 202

The Netflix TechBlog

SEPTEMBER 8, 2020

As an example, to render the screen shown here, the app sends a query that looks like this: paths: ["videos", 80154610, "detail"] A path starts from a root object , and is followed by a sequence of keys that we want to retrieve the data for.

Latency 233

Latency Cache Java Traffic 233

Dynatrace

JULY 24, 2023

For example, consider an e-commerce website that automatically sends personalized discount codes to customers who abandon their shopping carts. Let’s examine a few examples of answer-driven automation using AI and context. DevOps automation example #2: Threat detection and response Let’s build on the previous example.

DevOps 220

DevOps Traffic Efficiency Servers 220

Dynatrace

JUNE 25, 2020

For example, in a three-node cluster, one node can go down; in a cluster with five or more nodes, two nodes can go down. The network latency between cluster nodes should be around 10 ms or less. Regular Dynatrace Managed deployments can work seamlessly when a maximum of two nodes are down at a time and the network has low latency.

Availability 246

Availability Hardware Latency Traffic 246

The Netflix TechBlog

MARCH 10, 2023

This feature support required a significant update in the data table design (which includes new tables and updating existing table columns). Data Sharding strategy in elasticsearch is updated to provide low search latency (as described in blog post) Design of new Cassandra reverse indices to support different sets of queries.

Media 237

Media Traffic Processing Design 237

Dynatrace

JANUARY 13, 2022

For example, data collected on load actions can include navigation start, request start, and speed index metrics. For example, one user may fill in several fields, click multiple buttons, and upload a file, while another may click several other buttons and fail to upload the file. Examples of real user monitoring.

Monitoring 179

Monitoring Latency Mobile Best Practices 179

CSS Wizardry

MAY 31, 2019

A classic example is jQuery, that we might link to like so: There are a number of perceived benefits to doing this, but my aim later in this article is to either debunk these claims, or show how other costs vastly outweigh them. I’m going to use an example taken straight from Bootstrap’s own Getting Started. What Am I Talking About?

Cache 274

Cache Latency Infrastructure Website 274

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. As an illustrative example, let’s consider a toy instance of 16 hyperthreads.

Cache 251

Cache Latency Airlines Logistics 251

Dynatrace

JANUARY 31, 2024

Davis AI, Grail, and data observability By grouping common data observability issues into industry-standard pillars, we can provide tangible examples and showcase current capabilities. Solution : Like the freshness example, Dynatrace can monitor the record count over time.

DevOps 194

DevOps Analytics Airlines Metrics 194

Dynatrace

AUGUST 27, 2019

Welcome back to the blog series in which we share how you can easily solve three common problem scenarios by using Dynatrace and xMatters Flow Designer. This is where xMatters Flow Designer comes into play, by automating remediation steps at the touch of a button. Step 5 – xMatters triggers a runbook in Ansible to fix the disk latency.

Systems 176

Systems DevOps Latency Azure 176

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

APRIL 5, 2021

This is where Lambda comes in: Developers can deploy programs with no concern for the underlying hardware, connecting to services in the broader ecosystem, creating APIs, preparing data, or sending push notifications directly in the cloud, to list just a few examples. Some common examples include: A request through API Gateway or Amplify.

Lambda 179

Lambda AWS Serverless Hardware 179

Percona

MARCH 29, 2023

Snappy compression is designed to be fast and efficient regarding memory usage, making it a good fit for MongoDB workloads. engineConfig: cacheSizeGB: 4 In the above example, blockCompressorQuality is set to 6, which is the default. Block compression can improve performance by allowing data to be read and written in smaller chunks.

Storage 106

Storage Network Open Source Latency 106

IO River

NOVEMBER 2, 2023

The Four Pillars of CDN Design‍CDN architecture can be broken down into several building blocks, known as the Four Pillars of CDN Design. When an edge server goes down, end users in the affected region may experience an increase in latency for that specific location. Here are a few examples.

Architecture 52

Architecture Cache Performance Latency 52

Dynatrace

FEBRUARY 2, 2022

For example, the IT team of a bank wants to ensure that for a trailing 30-day period there is 99.9% service availability with <50ms latency for an application with no revenue impact. To avoid this, start the SLO discussion early in the design process. Let’s take service availability for example.

DevOps 195

DevOps Metrics Best Practices Latency 195

The Netflix TechBlog

AUGUST 30, 2021

For example, when running tests, the state of the device will change from “available for testing” to “in test.” By the following morning, alerts were received regarding high memory consumption and GC latencies, to the point where the service was unresponsive to HTTP requests. In this blog post, we will focus on the latter feature set.

Latency 213

Latency Traffic Transportation Hardware 213

CSS Wizardry

MAY 19, 2020

Take for example Vitamix, a client for whom I implemented asynchronous CSS for their own font provider(s): While Chrome can do asynchronous DNS/TCP/TLS, it will serialise and stall non-critical requests on slower connections. On a high-latency connection, this spells bad news. Let’s see what happens.

Google 364

Google Media Latency Metrics 364

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The kind of edge server envisaged here might, for example, be integrated with your WiFi access point. One example from the paper is an application using the ammo.js Why would we want to live migrate web workers?

Mobile 104

Mobile Cloud Latency Games 104

Dynatrace

DECEMBER 2, 2021

For example, an SLA between a web host provider and customer can guarantee 99.95% uptime for all web services of a company over a year. For example, if the SLA for a website is 99.95% uptime, its corresponding SLO could be 99.95% availability of the login services. For example, if your SLO guarantees 99.5% What are SLOs?

Metrics 190

Metrics Best Practices DevOps Infrastructure 190

Dynatrace

APRIL 26, 2022

STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables).

Monitoring 203

Monitoring Social Media IoT Metrics 203

Percona

DECEMBER 26, 2023

Installation (example: CENTOS8, pg14) The simplest way to get pg_stat_monitor is to install it via Percona Distribution for PostgreSQL. Dashboard example 2: Monitoring in real time These two panels show read/write IO performance to the persistent storage while benchmarking a live run. And yes, it even works in PostgreSQL.

Benchmarking 120

Benchmarking Metrics C++ Database 120

The Netflix TechBlog

MARCH 4, 2024

In some cases–for example, diagnosing and remediating job failures caused by Out-Of-Memory (OOM) errors–joint effort across teams is required, involving not only the users themselves, but also the support engineers and domain experts. The most notable example is memory configuration errors.

Tuning 210

Tuning Efficiency Big Data Engineering 210

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand.

Network 92

Network Transportation Latency Entertainment 92

CSS Wizardry

AUGUST 13, 2019

Although this response has a 0B filesize, we will always take the latency hit on every single page view (and this response is basically 100% latency). com , which introduces yet more latency for the connection setup. If you’re interested in seeing a real-world example of this, consider the following filmstrip comparison.

Latency 203

Latency Cache Strategy Media 203

Dynatrace

DECEMBER 22, 2019

But to understand if your cloud-based applications, as well as environments they run in, are working as designed, you need to see how every single application component communicates and interacts with the others. You can observe the metrics across service instances split by region (in this example, API Gateways in us-east-1 and us-east-2 ).

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

But to understand if your cloud-based applications, as well as environments they run in, are working as designed, you need to see how every single application component communicates and interacts with the others. You can observe the metrics across service instances split by region (in this example, API Gateways in us-east-1 and us-east-2 ).

AWS 133

AWS Metrics IoT Storage 133

Scalegrid

JANUARY 12, 2024

Various forms can take shape when discussing workloads within the realm of cloud computing environments – examples include order management databases, collaboration tools, videoconferencing systems, virtual desktops, and disaster recovery mechanisms. What is an example of a workload?

Cloud 130

Cloud Virtualization Storage Efficiency 130

CSS Wizardry

MARCH 3, 2019

If, however, there wasn’t a new file on the server, we’ll bring back a 304 header, no new file, but an entire roundtrip of latency. We can completely cut out the overhead of a roundtrip of latency. On high latency connections, this saving could be tangible. Examples and Recipes. stale-while-revalidate. assets/style.1.2.14.css

Cache 264

Cache Latency Strategy Servers 264