Brendan Gregg

APRIL 14, 2022

I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive [work culture]. I could help not only Netflix but all customers of the cloud. Netflix has been the best job of my career so far, and I'll miss my colleagues and the culture. offer letter logo (2014). flame graphs (2014). eBPF tools (2014-2019).

Java 145

Java Cloud Cache AWS 145

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

OCTOBER 7, 2021

For many companies, the journey to modern cloud applications starts with serverless. Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases.

Serverless 273

Serverless AWS Lambda Storage 273

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. All Things Distributed. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Without cloud-based rendering, this ambitious project would not have met its targeted delivery date!

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] , Mar 2020 [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. I could help not only Netflix but all customers of the cloud.

Java 52

Java Cache Cloud AWS 52

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. My templates and blog posts are now located in DropBox and thus locally cached at each machine I use. Driving Storage Costs Down for AWS Customers.

Servers 126

Servers Social Media AWS Website 126

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. It is worth pointing out that cloud processing is always subject to variable network conditions.

Cloud 237

Cloud Media Storage Cache 237

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe.

Cache 224

Cache Latency Traffic Systems 224

The Morning Paper

JUNE 16, 2019

In the prototype implementation, policies are expressed in a language similar to Google Cloud Firestore security rules. If we do that naively though, we’re going to end up with a lot of universes to store and maintain and the storage requirements alone will be prohibitive. Expressing privacy policies.

Database 90

Database Cache Benchmarking Efficiency 90

The Netflix TechBlog

MARCH 8, 2021

One of our first partners for the Netflix Workstations is NetFX , a cloud-based VFX platform that enables vendors, artists, and creators worldwide to collaborate on Netflix VFX content. Below is a broad technical overview of how to go from an AWS instance to a Netflix Workstation. Now that you know why, here is how we did it.

Entertainment 306

Entertainment Storage Hardware Open Source 306

Dynatrace

OCTOBER 4, 2022

Data warehouses offer a single storage repository for structured data and provide a source of truth for organizations. Unlike data warehouses, however, data is not transformed before landing in storage. A data lakehouse provides a cost-effective storage layer for both structured and unstructured data. Data management.

Artificial Intelligence 202

Artificial Intelligence Storage Analytics Government 202

High Scalability

FEBRUARY 19, 2019

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

Availability 204

Availability Open Source Cache Storage 204

Percona

MAY 2, 2023

Cons of logical backups As it reads all data, it can be slow and will require disk reads too for databases that are larger than the RAM available for the WT cache—the WT cache pressure increases, which slows down the performance. Especially if going into or out of storage types that may throttle bandwidth/network traffic.

Best Practices 52

Best Practices Database Storage Servers 52

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started As businesses grow and demand fluctuates, infrastructure needs to adapt.

Open Source 52

Open Source DevOps AWS Azure 52

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. As businesses grow and demand fluctuates, infrastructure needs to adapt.

Open Source 40

Open Source DevOps AWS Azure 40

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. That means multiple data indirections mean multiple cache misses. It would mean a great deal to me. They'll love you even more.

Internet 121

Internet Internet Scalability Automotive 121

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

APRIL 27, 2011

We use high-performance transactions systems, complex rendering and object caching, workflow and queuing systems, business intelligence and data analytics, machine learning and pattern recognition, neural networks and probabilistic decision making, and a wide variety of other techniques. Driving Storage Costs Down for AWS Customers.

Technology 151

Technology Technology AWS Storage 151

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. While caching continues to be a dominant use of ElastiCache for Redis, we see customers increasingly use it as an in-memory NoSQL database.

Scalability 130

Scalability Analytics Cache AWS 130

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. We’ll also discuss the costs and benefits of CDNs and dedicated file storage solutions. First, you’ll need to install the libraries boto3 and django-storages.

Media 70

Media Cache Storage AWS 70

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Oh, you mean a cache? Yes, a bit like those 2nd-level caches we were talking about earlier, e.g. Ehcache from 2003 onwards.

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. This consistent performance is a big part of why the Snapchat Stories feature , which includes Snapchat's largest storage write workload, moved to DynamoDB. The opposite is true. Take Expedia, for example.

Database 167

Database AWS Games Latency 167

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity.

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

JANUARY 17, 2019

On multi-core machines – which is the majority of the hardware nowadays – and in the cloud, we have multiple cores available for use. AWS Aurora (based on MySQL 5.6) now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). row.

Cache 46

Cache C++ AWS Airlines 46

Enprowess

JANUARY 12, 2022

So it is convenient for all to use irrespective of internet speed and it works offline using cached data. Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. Blockchain technology is an encrypted database storage system.

Blockchain 59

Blockchain IoT Development Serverless 59

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Disk Caching? — ? Regional caching? —?Netflix

Media 214

Media Storage Processing Cache 214

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Edge caching.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

The idea is quite straightforward: Push the minimal code needed to get interactive for the initial route to render quickly, then use service worker for caching and pre-caching resources and then lazy-load routes that you need, asynchronously. An application shell is the minimal HTML, CSS, and JavaScript powering a user interface.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

The idea is quite straightforward: Push the minimal code needed to get interactive for the initial route to render quickly, then use service worker for caching and pre-caching resources and then lazy-load routes that you need, asynchronously. An application shell is the minimal HTML, CSS, and JavaScript powering a user interface.

Performance 104

Performance Cache Metrics Network 104