The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

Dynatrace

JULY 6, 2020

Azure Virtual Network Gateways. Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. It enables you to use popular open-source frameworks such as Hadoop, Spark, and Kafka in Azure cloud environments. Azure DB for PostgreSQL.

Azure 147

Azure Cloud Big Data Virtualization 147

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Testsigma

AUGUST 24, 2020

Maintaining test data in a central repository and then accessing it from different test environments may ease this problem but may introduce other issues like network latency in tests. The right combination of open source and paid test frameworks/tools can be used rather than relying solely on open-source test frameworks/tools.

Testing 69

Testing Open Source Scalability Latency 69

The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. This talk explores the journey, learnings, and improvements to performance analysis, efficiency, reliability, and security.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Scalegrid

MARCH 28, 2024

Redis Revealed: An Overview Redis, a renowned open-source, in-memory remote dictionary server, stands out for its diverse data structures and advanced features. Snapshots provide point-in-time captures of the dataset, which are efficient for recovery on startup. Memcached’s primary strength lies in its simplicity.

Cache 130

Cache Storage Scalability Architecture 130

The Morning Paper

SEPTEMBER 5, 2019

For response times (latencies) reporting a simple metric such as ‘average’ is next to useless. Instead we want to understand what’s happening at different latency percentiles (e.g A characteristic of latency distributions is that they have a long tail. Why do we need a new sketch? At the 50th percentile, an accuracy within 0.5%

Latency 52

Latency Metrics Open Source Java 52

Percona

NOVEMBER 9, 2023

At its core, Kubernetes (often abbreviated as K8s) is an open source tool that automates the deployment, scaling, and management of containerized applications. Kubernetes manages and orchestrates these containers, handling tasks such as deployment, scaling, load balancing, and networking.

Efficiency 106

Efficiency Cloud Healthcare Open Source 106

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

KeyCDN

AUGUST 15, 2019

Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. Google Lighthouse Google Lighthouse is a free and open source tool that is part of the Google Chrome DevTools family. Peak response time: The longest response time.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

MARCH 29, 2023

As the amount of data grows, the need for efficient data compression becomes increasingly important to save storage space, reduce I/O overhead, and improve query performance. In this blog, we will discuss both data and network-level compression offered in MongoDB. Network compression MongoDB also offers network compression.

Storage 112

Storage Network Open Source Latency 112

Brendan Gregg

OCTOBER 8, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 110

C++ Virtualization Programming Latency 110

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 40

C++ Virtualization Programming Latency 40

Dynatrace

APRIL 6, 2022

Endpoints include on-premises servers, Kubernetes infrastructure, cloud-hosted infrastructure and services, and open-source technologies. Not just infrastructure connections, but the relationships and dependencies between containers, microservices , and code at all network layers.

DevOps 231

DevOps Innovation Infrastructure Analytics 231

High Scalability

SEPTEMBER 8, 2018

Anna is not only incredibly fast, it’s incredibly efficient and elastic too: an autoscaling, multi-tier, selectively-replicating cloud service. The issue is that Anna is now orders of magnitude more efficient than competing systems, in addition to being orders of magnitude faster. What's changed ?

Storage 199

Storage Performance AWS Efficiency 199

Smashing Magazine

AUGUST 3, 2023

You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. You need to beware of large HTML files or slow network connections because they can lead to longer download times. Here’s how we do it at Bookaway.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

JULY 20, 2015

The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). This key/value store acts as the single source of truth for all information on the cluster (state, and all changes to state transitions) are entered and stored here.

Latency 166

Latency Architecture AWS Open Source 166

Smashing Magazine

AUGUST 22, 2021

As we will see, QUIC and HTTP/3 indeed have great web performance potential, but mainly for users on slow networks. If your average visitor is on a fast cabled or cellular network, they probably won’t benefit from the new protocols all that much. Two-way latency is often called round-trip time (RTT). Congestion Control.

Performance 105

Performance Network Latency Servers 105

The Netflix TechBlog

JANUARY 24, 2022

Technically, “performance” metrics are those relating to the responsiveness or latency of the app, including start up time. so are power levels and network bandwidth. In the future we plan to decouple anomaly and changepoint logic from our test infrastructure and offer it as a standalone open-source library.

Performance 199

Performance Metrics Performance Testing Testing 199

All Things Distributed

AUGUST 20, 2015

Developers need efficient methods to store, traverse, and query these relationships. When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow. Enter graph databases. Graph databases at Amazon.

Database 134

Database Logistics Availability Social Media 134

Abhishek Tiwari

NOVEMBER 3, 2018

Case-in-point, most enterprise CMS vendors lack robust full-site content delivery network (CDN) integration. Cost is one of the key reasons why most government organisations, mid to large sized business, and publisher prefer open source CMS options such as WordPress and Drupal.

Systems 63

Systems Cache Website Network 63

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. Embedding further simplifies database operations, reduces network overhead, and boosts read and query performance.

Best Practices 52

Best Practices Design Tuning Database 52

Alex Russell

APRIL 29, 2021

Apple Corporate is at fault, not Open Source engineers or the line managers who support them. Real-time network protocols for enabling videoconferencing, desktop sharing, and game streaming applications. Modern, asynchronous network APIs that dramatically improve performance in some situations. Delayed five years.

Media 145

Media Games Education Engineering 145

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. All these capabilities are available to customers at no additional charge, and maintain open-source Redis compatibility. Redis and Fast Data.

Scalability 130

Scalability Analytics Cache AWS 130

Rigor

OCTOBER 30, 2019

The Lighthouse Performance score is based on some of the most important performance metrics : First Contentful Paint, First Meaningful Paint, Speed Index, Time to Interactive, First CPU Idle, and Estimated Input Latency. Maintaining performant sites and applications requires you to efficiently gather and analyze data points over time.

Google 51

Google Best Practices Energy Website 51

The Morning Paper

MAY 28, 2019

The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. One efficient way of doing that in analog hardware is the use of current-starved inverters. Introducing race logic. An end-to-end architecture.

Energy 52

Energy Hardware Efficiency Architecture 52

Smashing Magazine

SEPTEMBER 6, 2021

Next, we’ll look at how to set up servers and clients (that’s the hard part unless you’re using a content delivery network (CDN)). Using just a few (but still more than one), however, could nicely balance congestion growth with better performance, especially on high-speed networks. Servers and Networks.

Network 104

Network Servers Cache Traffic 104

Alex Russell

JUNE 20, 2020

full TCP/IP & UDP networking, including local network discovery. Java arrived with a focus on structured programming (including threads), GUI controls , networking, device access, and graphics. high-color image raster. vector rendering and graphics filter APIs. rich multimedia (animations, video, audio). floppy/CD/DVD).

Hardware 55

Hardware Games Java Media 55

Alex Russell

JULY 14, 2021

Because they lean on the system-provided WebView component, they do not need to pay the expense of a heavier app download to support rendering HTML, running JavaScript, decoding images, or loading network resources. Facebook engineers have noted that the FB IAB is important in fighting bad behaviour on their social network.

Google 121

Google Mobile Engineering Internet 121

Smashing Magazine

SEPTEMBER 29, 2021

Users appreciate high-quality visuals, but care needs to be taken to deliver those hero images, product photos and cat memes as efficiently and effectively as possible. The efficiency of a codec can be mainly measured by how much compression it can achieve. It was released in February 2019 by the Alliance for Open Media (AOMedia).

Open Source 144

Open Source Speed Website Google 144

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Large preview ). There are many tools allowing you to achieve that: SiteSpeed.io 300ms RTT, 1.6

Performance 145

Performance Cache Network Metrics 145