Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. Who can benefit from DLV? and later v13 versions, 14.7

AWS 93

AWS Benchmarking Performance Traffic 93

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Netflix operates in multiple AWS regions. Regional caching? —?Netflix

Media 214

Media Storage Processing Cache 214

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

MARCH 14, 2024

Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. In practice, a hybrid cloud operates by melding resources and services from multiple computing environments, which necessitates effective coordination, orchestration, and integration to work efficiently.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure.

Cloud 130

Cloud Virtualization Storage Efficiency 130

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. have altered the many assumptions that guided the design and optimization of the Snowflake system. The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service.

Storage 112

Storage Engineering Cache Serverless 112

Scalegrid

JANUARY 8, 2024

Real-world examples like Spotify’s multi-cloud strategy for cost reduction and performance, and Netflix’s hybrid cloud setup for efficient content streaming and creation, illustrate the practical applications of each model. Thus making it an ideal choice for businesses seeking a successful implementation of their multi-cloud strategy.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Netflix TechBlog

SEPTEMBER 24, 2021

Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. Figure 1: A Simplified Video Processing Pipeline With this architecture, chunk encoding is very efficient and processed in distributed cloud computing instances.

Cloud 237

Cloud Media Storage Cache 237

Scalegrid

MAY 13, 2020

High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages. The MPP system leverages a shared-nothing architecture to handle multiple operations in parallel. Typically an MPP system has one leader node and one or many compute nodes. Greenplum Advantages. Major Use Cases.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

MAY 26, 2021

The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. To improve their alerting system, the team decided to move to SLO/SLI-based alerting, which require deeper knowledge of the application but are more helpful than generalized metric alerts.

AWS 217

AWS Strategy Storage Metrics 217

High Scalability

SEPTEMBER 8, 2018

Anna is not only incredibly fast, it’s incredibly efficient and elastic too: an autoscaling, multi-tier, selectively-replicating cloud service. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Efficiency 199

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Using AI for Enhanced Cloud Operations The integration of AI in cloud computing is enhancing operational efficiency in several ways.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

MARCH 8, 2021

Below is a broad technical overview of how to go from an AWS instance to a Netflix Workstation. They could need a GPU when doing graphics-intensive work or extra large storage to handle file management. We needed a system that could manage hundreds to one-day thousands of workstations. How did we get here?

Entertainment 306

Entertainment Storage Hardware Open Source 306

Brendan Gregg

NOVEMBER 29, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. The first was c3.

Virtualization 111

Virtualization AWS Hardware Storage 111

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

OCTOBER 6, 2023

Buckets are similar to folders, a physical storage location. Debug-level logs, which also generate high volumes and have a shorter lifespan or value period than other logs, could similarly benefit from dedicated storage. Suppose a single Grail environment is central storage for pre-production and production systems.

Artificial Intelligence 265

Artificial Intelligence Analytics Metrics Storage 265

Dynatrace

SEPTEMBER 7, 2022

With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost. As of today’s announcement, AWS and Dynatrace strengthen their commitment to their customers to continue to deliver quality and value. The Dynatrace VPC Flow Log analysis capability.

Traffic 220

Traffic AWS Network Cloud 220

Scalegrid

JANUARY 9, 2024

As more and more enterprises incorporate cloud-based systems, ensuring their security becomes a key concern. Defining Enterprise Cloud Security In today’s business landscape, the reliance on cloud services for data storage and processing has made enterprise cloud security a crucial factor.

Strategy 130

Strategy Cloud Best Practices Government 130

Percona

MARCH 7, 2023

One approach is to separate compute and storage to allow for independent scaling. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. So, what is Neon?

Serverless 107

Serverless Storage Open Source Architecture 107

All Things Distributed

JUNE 10, 2016

Building your applications with only managed components has become very popular, and AWS Lambda plays a crucial role in that. The Mobile Backend reference architecture demonstrates how to use AWS Lambda along with other services to build a serverless backend for a mobile application. about teletext.io are read eagerly around the globe.

Lambda 109

Lambda Serverless AWS Architecture 109

Dynatrace

NOVEMBER 3, 2022

The containerization craze has continued for enterprises, with benefits such as portability, efficiency, and scalability. These containers are software packages that include all the relevant dependencies needed to run software on any system. IaaS provides direct access to compute resources such as servers, storage, and networks.

Serverless 221

Serverless Azure Hardware Transportation 221

Dynatrace

MAY 26, 2021

The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. To improve their alerting system, the team decided to move to SLO/SLI-based alerting, which require deeper knowledge of the application but are more helpful than generalized metric alerts.

AWS 147

AWS Strategy Storage Metrics 147

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. billion in 2020 to $4.1

Analytics 214

Analytics Monitoring Artificial Intelligence DevOps 214

All Things Distributed

MAY 10, 2016

Building your applications with only managed components has become very popular, and AWS Lambda plays a crucial role in that. The Mobile Backend reference architecture demonstrates how to use AWS Lambda along with other services to build a serverless backend for a mobile application. about teletext.io are read eagerly around the globe.

Lambda 105

Lambda Serverless AWS Architecture 105

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. For how our machine learning recommendation systems leverage our key-value stores, please see more details on this presentation.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

APRIL 26, 2022

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. Since we were optimizing at the logging level for storage and performance, we had less data and metadata to play with to optimize the query performance.

Storage 187

Storage Design Scalability Latency 187

All Things Distributed

JUNE 26, 2016

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Examples of continuous sensing are found in the managed cloud platform built by Rachio on AWS IoT to enable the secure interaction of its connected devices with cloud applications/other devices. The opportunity to revolutionize.

AWS 90

AWS Cloud Healthcare Blockchain 90

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. Anyone can rent a rack in a colo and stand up a system. Of course not, but let's ignore that very few organizations in the world have the technological know-how to create such managed services, especially without low level control of the entire system.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. Amazon Aurora has become the fastest-growing service in the history of AWS and frequently is the target of migration from on-premise proprietary databases.

Database 120

Database Design Cloud Storage 120

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. to drive new efficiencies and higher reliability.

AWS 111

AWS Innovation Scalability Cache 111

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. The first was c3.

Virtualization 40

Virtualization AWS Hardware Storage 40

Adrian Cockcroft

APRIL 18, 2018

In reality, in any non-trivial installation, there are multiple tools collecting, storing and displaying overlapping sets of metrics from many types of systems and different levels of abstraction. This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads.

Monitoring 40

Monitoring Systems Virtualization Metrics 40