The Netflix TechBlog

MAY 21, 2019

We thought that reinforcement learning would be a promising approach that could provide great flexibility in the training process. Likewise it has very low requirements on the initial amount of training data. We needed a way to run agents and tie the runs to the internal infrastructure for analytics, reporting, and visualizations.

Testing 163

Testing AWS Lambda Network 163

Percona

APRIL 14, 2023

Consider alternative tools, systems, and services: Many cloud providers offer long-term storage, serverless options, or component options for specific needs, with vastly different pricing models. Cross-train Investing in your employees is always a good idea, but expanding their skill sets can also reduce costs.

Database 81

Database Serverless Tuning Cloud 81

Percona

DECEMBER 27, 2023

Oftentimes, it is a pillar of modern infrastructure strategy to avoid cloud vendor lock-in. Standardization and collaboration are key to sharing common knowledge and patterns across teams and infrastructures. Nearly every vendor at Kubecon and every person we spoke to had some form of a multi-cloud requirement or strategy.

Cloud 77

Cloud Open Source Strategy Best Practices 77

All Things Distributed

DECEMBER 18, 2017

Today, I'm happy to announce that the AWS EU (Paris) Region, our 18th technology infrastructure Region globally, is now generally available for use by customers worldwide. Now, we're opening an infrastructure Region with three Availability Zones. All around us, we see AWS technologies fostering a culture of experimentation.

AWS 112

AWS Artificial Intelligence Education Energy 112

The Morning Paper

FEBRUARY 18, 2020

The following chart breaks down features in three main areas: training and auditing, serving and deployment, and data management, across six systems. Finally, an analysis of ML research directions reveals the following arc through time: systems for training, systems for scoring, AutoML, and then responsible AI.

Government 95

Government Software Engineering Storage Database 95

Adrian Cockcroft

NOVEMBER 26, 2023

SUS101: Sustainability innovation in AWS Global Infrastructure AWS is determined to make the cloud the cleanest and most energy-efficient way to run customers’ infrastructure and business. This includes providing the efficient, resilient services AWS customers expect, while minimizing their environmental footprint.

AWS 52

AWS Energy IoT Best Practices 52

Dynatrace

JANUARY 17, 2024

And an O’Reilly Media survey indicated that two-thirds of survey respondents have already adopted generative AI —a form of AI that uses training data to create text, images, code, or other types of content that reflect its users’ natural language queries. AI requires more compute and storage. AI performs frequent data transfers.

Strategy 215

Strategy Artificial Intelligence Storage Cloud 215

The Netflix TechBlog

FEBRUARY 13, 2023

Our goal in building a media-focused ML infrastructure is to reduce the time from ideation to productization for our media ML practitioners. Media Feature Storage: Amber Storage Media feature computation tends to be expensive and time-consuming. We accomplish this by paving the path to: Accessing and processing media data (e.g.

Media 290

Media Storage Infrastructure Systems 290

The Netflix TechBlog

NOVEMBER 6, 2023

In order to train the model on internal training data (video clips with aligned text descriptions), we implemented a scalable version on Ray Train and switched to a more performant video decoding library. These models are trained on large amounts of image-caption pairs via in-batch contrastive learning.

Media 225

Media Social Media Tuning Efficiency 225

Testsigma

JULY 31, 2021

From learning and upgrading to staffing and infrastructure — there are plenty of costs involved. If you can manage infrastructure costs that include devices, machines, storage, etc., But if you’re a startup or don’t have the budget for in-house infrastructure, we recommend going for a cloud-based testing tool.

Mobile 52

Mobile Software Software Testing 52

The Symphonia

JUNE 19, 2018

Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage? Since then Donna’s been bringing her expertise to Pulumi , a startup promising to make infrastructure automation much more friendly and less, well, YAML’ey. John and I (Mike) have had a fun three months. This is not as easy a task as one might imagine.

Serverless 40

Serverless AWS DevOps Open Source 40

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. We’d like to pack models as efficiently as possible on the underlying infrastructure. But the vision clearly seems to include selection of the model itself.

Hardware 58

Hardware Latency Serverless Energy 58

O'Reilly

DECEMBER 2, 2019

What would the world look like if all of our storage was in the cloud, and access to that storage was so fast we didn’t care? Whether that’s training data for AI applications or just lots of transaction records, businesses move data, and lots of it. I do regular backups, but I know I’m the exception.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Dynatrace

APRIL 26, 2023

Some of our customers run tens of thousands of storage disks in parallel, all needing continuous resizing. Davis AI analyzes the selected time series, automatically chooses the best prediction model based on the characteristics of the time series, and then trains a prediction model.

Games 205

Games Analytics Strategy Cloud 205

Scalegrid

JANUARY 12, 2024

This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure. Storage is a critical aspect to consider when working with cloud workloads. Hybrid cloud environments that integrate on-premises infrastructure with cloud services.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Brendan Gregg

APRIL 30, 2018

LISA originally stood for "Large Installation System Administration," where "large" meant systems with more than a gigabyte of storage, or with more than 100 users. Submit #lisa18 talk, training, panel, and demo proposals by May 24 [link]. Have something to say on the present & future of #ops? Hope to see you in Nashville!

DevOps 43

DevOps Network Best Practices Programming 43

Brendan Gregg

APRIL 29, 2018

LISA originally stood for "Large Installation System Administration," where "large" meant systems with more than a gigabyte of storage, or with more than 100 users. Submit #lisa18 talk, training, panel, and demo proposals by May 24 [link]. Have something to say on the present & future of #ops? Hope to see you in Nashville!

DevOps 40

DevOps Network Best Practices Programming 40

Dynatrace

JUNE 1, 2023

While gyms and fitness studios have since reopened, these apps are still extremely popular for squeezing in short home workouts, tracking fitness goals, and receiving personalized training recommendations. Response time Response time refers to the total time it takes for a system to process a request or complete an operation.

Latency 171

Latency Website Traffic Virtualization 171

Dynatrace

JUNE 1, 2023

While gyms and fitness studios have since reopened, these apps are still extremely popular for squeezing in short home workouts, tracking fitness goals, and receiving personalized training recommendations. Similarly, SLOs play a crucial role in ensuring a flawless, engaging user experiences.

Traffic 173

Traffic Latency Website Virtualization 173

The Netflix TechBlog

APRIL 26, 2022

We built Axion primarily to remove any training-serving skew and make offline experimentation faster. We make sure there is no training/serving skew by using the same data and the code for online and offline feature generation. Our machine learning models train on several weeks of data.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

DECEMBER 3, 2019

About two years ago, we, at our newly formed Machine Learning Infrastructure team started asking our data scientists a question: “What is the hardest thing for you as a data scientist at Netflix?” Our job as a Machine Learning Infrastructure team would therefore not be mainly about enabling new technical feats.

Open Source 232

Open Source AWS Infrastructure Energy 232

Dynatrace

JANUARY 31, 2024

million” – Gartner Data observability is a practice that helps organizations understand the full lifecycle of data, from ingestion to storage and usage, to ensure data health and reliability. This requires monitoring of the upstream infrastructure, applications, or platform supporting those data streams.

DevOps 189

DevOps Analytics Airlines Metrics 189

Scalegrid

MAY 13, 2020

High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages. Greenplum interconnect is the networking layer of the architecture, and manages communication between the Greenplum segments and master host network infrastructure. Polymorphic Data Storage. Greenplum Advantages.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

High Scalability

OCTOBER 24, 2022

Cloud Infrastructure Services -- An analysis of potentially anti-competitive practices by Professor Frédéric Jenny. There is no structural separation as there is with a train service. What some consider infrastructure or platform is just another cloud service. A group advocating for fair licensing. It's a choice.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 103

Hardware Storage Big Data Blockchain 103

Dynatrace

JULY 6, 2022

Organizations that have achieved SRE maturity have a better handle on the state of their infrastructure, the ability to tie reliability metrics more tightly to business objectives, and the means to ensure a consistent and responsive customer experience. Dynatrace’s 2022 State of SRE Report surveyed 450 SREs across the globe.

Best Practices 180

Best Practices Open Source Tuning Infrastructure 180

The Netflix TechBlog

DECEMBER 3, 2019

About two years ago, we, at our newly formed Machine Learning Infrastructure team started asking our data scientists a question: “What is the hardest thing for you as a data scientist at Netflix?” Our job as a Machine Learning Infrastructure team would therefore not be mainly about enabling new technical feats.

Open Source 134

Open Source AWS Infrastructure Energy 134

Percona

JANUARY 30, 2023

Release highlights include: Incremental physical backups enable you to reduce storage costs and facilitate data safety for business crucial data. As such, you save on storage space and data transfer in case of cloud setups. This is the technical preview feature , yet we welcome your feedback to improve the functionality.

Open Source 82

Open Source Storage AWS Cloud 82

O'Reilly

NOVEMBER 12, 2019

Respondents who have implemented serverless made custom tooling the top tool choice—implying that vendors’ tools may not fully address what organizations need to deploy and manage a serverless infrastructure. In our analysis, we assigned experience levels to our respondents for some of the survey questions. Industries of survey respondents.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

IO River

NOVEMBER 2, 2023

The code is declarative, which means you specify what you want the final configuration to look like, and Terraform ensures the infrastructure matches that desired state.‍So, ‍Terraform is a revolution in the way we handle infrastructure. Background‍The idea of managing infrastructure through code wasn't initiated by HashiCorp.

Open Source 52

Open Source DevOps AWS Azure 52

All Things Distributed

NOVEMBER 29, 2017

Though the AWS Cloud gives you access to the storage and processing power required for ML, the process for building, training, and deploying ML models has unique challenges that often block successful use of this powerful new technology. The challenges begin with collecting, cleaning, and formatting training data.

Tuning 94

Tuning AWS Scalability Infrastructure 94

Percona

OCTOBER 18, 2023

Does anyone on my team require further training before we start? Look closely at your current infrastructure (hardware, storage, networks, etc.) This is where you will fine-tune authentication mechanisms, storage paths, security policies, and memory allocation settings to optimize them for your specific use case(s).

Open Source 90

Open Source Database Hardware Strategy 90

Dynatrace

AUGUST 27, 2020

Missing operational insights, lack of context, and limited understanding of cloud service dependencies making it almost impossible to find the root cause of customer-facing application issues or underlying infrastructure problems. AWS Storage Gateway. Amazon Managed Apache Cassandra Service (Keyspaces). Amazon SageMaker. AWS OpsWorks.

AWS 265

AWS Cloud IoT Database 265

All Things Distributed

DECEMBER 13, 2016

In November 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in the United Kingdom. Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

IO River

NOVEMBER 2, 2023

The code is declarative, which means you specify what you want the final configuration to look like, and Terraform ensures the infrastructure matches that desired state.‍So, What Exactly is Terraform?‍Terraform Terraform is a revolution in the way we handle infrastructure. This level of granularity is not found in UI-managed systems.

Open Source 40

Open Source DevOps AWS Azure 40

CSS Wizardry

MARCH 3, 2019

Tip: There are a number of directives that Clear-Site-Data will accept: "cookies" , "storage" , "executionContexts" , and "*" (which, naturally, means ‘all of the above’). a CDN), to always serve the freshest possible copy, and not to persist anything to storage. Live Train Timetable Page. Examples and Recipes.

Cache 264

Cache Latency Strategy Servers 264

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, we add to that presence with an infrastructure Region in Stockholm with three Availability Zones. They rely on the AWS Cloud for their entire infrastructure and use almost every AWS service available.

AWS 124

AWS Cloud Games Serverless 124