All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 135

Analytics Cloud Healthcare Retail 135

All Things Distributed

AUGUST 18, 2011

Many of our Big-Data customers already saw a big drop in their AWS bill last month when the cost of incoming bandwidth was dropped to $0.00. However, this cannot be done without efficient, scalable data analytics. The posting on the AWS developer blog also has some more background. Driving Storage Costs Down for AWS Customers.

Big Data 111

Big Data Analytics AWS Cloud 111

Brendan Gregg

FEBRUARY 28, 2023

The video is now on YouTube : The slides are online and as a PDF : first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video).

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

SEPTEMBER 24, 2021

After content ingestion, inspection and encoding, the packaging step encapsulates encoded video and audio in codec agnostic container formats and provides features such as audio video synchronization, random access and DRM protection. Packaging has always been an important step in media processing.

Cloud 237

Cloud Media Storage Cache 237

Brendan Gregg

NOVEMBER 29, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. The first was c3.

Virtualization 111

Virtualization AWS Hardware Storage 111

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The processed data is typically stored as data warehouse tables in AWS S3. Figure 1 shows how we use Bulldozer to move data at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

APRIL 26, 2022

Figure 1: Netflix ML Architecture Fact: A fact is data about our members or videos. An example of data about members is the video they had watched or added to their My List. An example of video data is video metadata, like the length of a video. Time is a critical component of Axion?—?When

Storage 187

Storage Design Scalability Latency 187

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. The first was c3.

Virtualization 40

Virtualization AWS Hardware Storage 40

The Netflix TechBlog

MARCH 10, 2023

By Burak Bacioglu , Meenakshi Jindal Asset Management at Netflix At Netflix, all of our digital media assets (images, videos, text, etc.) are stored in secure storage layers. Amsterdam is built on top of three storage layers. It is also responsible for asset discovery, validation, sharing, and for triggering workflows.

Strategy 258

Strategy Cache Analytics Storage 258

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. The importance of relationships.

Database 134

Database Logistics Availability Social Media 134

O'Reilly

MAY 19, 2020

Live online training, videos, books, certification prep, and more, from O’Reilly and our partner publishers. AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. ElastiCache for Redis Multi-AZ capability is built to handle any failover case for Redis Cluster with robustness and efficiency. Building upon Redis.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

APRIL 17, 2023

Since MongoDB usually works with a replica set, it is possible to increase this parameter to get better performance: # edit /etc/mongod.conf storage: journal: enabled: true commitIntervalMs: 300 WiredTiger cache For dedicated servers, it is possible to increase the WiredTiger(WT) cache. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. What problem are we solving? Encoding is not a one-time process?—?large

Media 214

Media Storage Processing Cache 214

Brendan Gregg

SEPTEMBER 5, 2017

. ## Observability Here's the big picture of performance observability tools on Linux, from my [Linux performance] page, where I also have diagrams for other tool types, as well as videos and slides of prior Linux performance talks: I also have a USE Method: Linux Performance Checklist , as a different way to navigate and apply the tools.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Tech News Gather

JUNE 16, 2023

By leveraging the power of mobile technology, UberEats provides a seamless and efficient way for users to order their favorite meals from a wide range of eateries. UberEats also excels in providing a reliable and efficient delivery service. Once an order is placed, it is seamlessly transmitted to the restaurant, where it is prepared.

Social Media 52

Social Media Tuning Strategy Media 52

Smashing Magazine

JANUARY 11, 2021

Assets Optimizations Brotli, AVIF, WebP, responsive images, AV1, adaptive media loding, video compression, web fonts, Google fonts. Paddy Ganti’s script constructs two URLs (one normal and one blocking the ads), prompts the generation of a video comparison via WebPageTest and reports a delta.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik and detailed guide by Rick Viscomi) or Treo Sites , a RUM monitoring tool that is powered by Chrome UX Report. You can then mimic the 90th percentile’s experience for testing.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik), Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing).

Performance 104

Performance Cache Metrics Network 104

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Video Transcoding.

Architecture 52

Architecture Cache Azure Storage 52