The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 94

AWS Benchmarking Performance Traffic 94

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., In this paper we explore the implications microservices have across the cloud system stack. The bottom line shows the tail latency impact in the microservices-based applications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. Observability relies on telemetry derived from instrumentation that comes from the endpoints and services in your multi-cloud computing environments.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. So, what makes DigitalOcean a compelling alternative to other popular MongoDB hosting providers like AWS and Azure ? DigitalOcean, along with AWS and Azure, offer a 99.99% uptime SLA, but while that sounds close to perfect, that 0.01% equates to 52.6

Azure 187

Azure AWS Latency Database 187

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. Vector is open source and in use by multiple companies.

Performance 211

Performance Latency Open Source Metrics 211

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB!

Storage 199

Storage Performance AWS Efficiency 199

High Scalability

MARCH 22, 2019

Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. skamille : I worry that the cloud is just moving us back to a world of proprietary software. Hell, many of these providers are just providing open source API compatibility with custom-built backends! Do you like this sort of Stuff?

Internet 134

Internet Internet Scalability Wireless 134

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

DZone

OCTOBER 31, 2019

Improve AWS performance! AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

AWS 36

AWS Latency Performance Open Source 36

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

High Scalability

DECEMBER 21, 2018

What could be better than a book on the cloud? Explain the Cloud Like I'm 10. swardley: X : What's going to happen in cloud in 2019? 2) Cloud will decentralise in terms of provision not power i.e. Amazon will "invade" more of those holdouts with AWS Outpost. Do you like this sort of Stuff? I'd really appreciate it.

Internet 137

Internet Internet Scalability Serverless 137

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. Monitoring DNS query time is important for understanding network latency, ensuring that services are available, troubleshooting issues, and optimizing application performance.

Metrics 176

Metrics Monitoring Database Network 176

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. All these capabilities are available to customers at no additional charge, and maintain open-source Redis compatibility. Redis and Fast Data.

Scalability 130

Scalability Analytics Cache AWS 130

All Things Distributed

AUGUST 20, 2015

When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow. Like many AWS innovations, the desire to build a solution for a scalable graph database came from Amazon’s retail business. Enter graph databases.

Database 134

Database Logistics Availability Social Media 134

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. All aboard the Databus!:

Database 197

Database Traffic Transportation Open Source 197

Percona

MAY 2, 2023

Also, we will take a look at our open-source backup utility custom-built to help avoid costs and proprietary software – Percona Backup for MongoDB or PBM. It also supports storing the backups on filesystem and AWS S3 buckets. root@ip-172-31-37-92 tmp]# time mongo < hot.js 8 connecting to: mongodb://127.0.0.1:27017/?compressors=disabled&gssapiServiceName=mongodb

Best Practices 52

Best Practices Database Storage Servers 52

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. All aboard the Databus!:

Database 212

Database Traffic Transportation Open Source 212

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. And while it’s easy to say “spin up more AWS servers”, you’re only adding to your cloud provider bill.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. And while it’s easy to say “spin up more AWS servers”, you’re only adding to your cloud provider bill.

Performance 40

Performance Hardware Latency Infrastructure 40

Smashing Magazine

AUGUST 20, 2021

It was a battle of not only proprietary vs open source but also static vs dynamic. In addition, they introduced a hosted version of MovableType in 2003 called TypePad to compete with other popular cloud platforms. Twitch developer documentation hosted on AWS, edited on CloudCannon. The site will load in a snap.

Ecommerce 139

Ecommerce Website Government Internet 139

The Symphonia

MAY 22, 2018

I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. Also there’s been a lot of open source updates, including from Amazon and Microsoft. and products like AWS Fargate have made this distinction murkier still. I also wrote an article on just this area last year.

Serverless 40

Serverless Architecture Lambda Azure 40

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. The third team is the infrastructure platform team, who deal with datacenter and cloud based resources.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. The third team is the infrastructure platform team, who deal with datacenter and cloud based resources.

Latency 53

Latency Engineering Systems Hardware 53

O'Reilly Software

MARCH 7, 2018

Over the years, these patterns have been implemented by numerous products, ranging from commercial ESBs and enterprise message buses to open source libraries and products. The Alpakka project is an open source library initiative to implement stream-aware, reactive, integration pipelines for Java and Scala.

Transportation 72

Transportation Java Programming Architecture 72

Smashing Magazine

JANUARY 11, 2021

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. There are many tools allowing you to achieve that: SiteSpeed.io Large preview ). Large preview ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Large preview ). There are many tools allowing you to achieve that: SiteSpeed.io

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. There are many tools allowing you to achieve that: SiteSpeed.io Assets Optimizations.

Performance 104

Performance Cache Network Metrics 104