The Netflix TechBlog

NOVEMBER 9, 2021

by Liwei Guo , Ashwin Kumar Gopi Valliammal , Raymond Tam , Chris Pham , Agata Opalach , Weibo Ni AV1 is the first high-efficiency video codec format with a royalty-free license from Alliance of Open Media (AOMedia), made possible by wide-ranging industry commitment of expertise and resources.

Media 246

Media Open Source Efficiency Software Engineering 246

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. The term site reliability engineering first came into existence at Google in 2003 when a site reliability team was created. At that time, the team was made up of software engineers.

Engineering 67

Engineering DevOps Monitoring Google 67

Dynatrace

MAY 1, 2023

In addition to improved IT operational efficiency at a lower cost, ITOA also enhances digital experience monitoring for increased customer engagement and satisfaction. Additionally, ITOA gathers and processes information from applications, services, networks, operating systems, and cloud infrastructure hardware logs in real time.

Analytics 178

Analytics Artificial Intelligence Big Data Open Source 178

Dynatrace

JULY 11, 2023

By leveraging the Dynatrace Operator and Dynatrace capabilities on Red Hat OpenShift on IBM Power, customers can accelerate their modernization to hybrid cloud and increase operational efficiencies with greater visibility across the full stack from hardware through application processes.

Architecture 161

Architecture Availability Infrastructure Metrics 161

VoltDB

MAY 14, 2024

Low usage or over-engineered legacy systems Until the arrival of cloud hosting, nobody knew how to size anything properly, or they did know but never got a chance to. Prototypes, experiments, and tests Development and testing historically involved end-of-life or ‘spare’ hardware. When is the cloud a bad idea?

Latency 52

Latency Availability Cloud Hardware 52

Dynatrace

DECEMBER 15, 2022

Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure. Although modern cloud systems simplify tasks, such as deploying apps and provisioning new hardware and servers, hybrid cloud and multicloud environments are often complex.

Artificial Intelligence 191

Artificial Intelligence DevOps Hardware Virtualization 191

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum’s high performance eliminates the challenge most RDBMS have scaling to petabtye levels of data, as they are able to scale linearly to efficiently process data.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. The scorecard.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

NOVEMBER 1, 2022

Most IT incident management systems use some form of the following metrics to handle incidents efficiently and maintain uninterrupted service for optimal customer experience. It shows how efficiently your DevOps team is at quickly diagnosing a problem and implementing a fix. What are MTTD, MTTA, MTTF, and MTBF? Mean time to detect.

DevOps 198

DevOps Artificial Intelligence Metrics Network 198

The Netflix TechBlog

MARCH 8, 2021

As an engineer, I can work anywhere with a standard laptop as long as I have an IDE and access to Stack Overflow. They need specialized hardware, access to petabytes of images, and digital content creation applications with controlled licenses. Where we can gather and analyze the usage data to create efficiencies and automation.

Entertainment 306

Entertainment Storage Hardware Open Source 306

Dynatrace

MAY 5, 2020

Tasks such as hardware provisioning, database setup, patching, and backups are fully automated, making Amazon RDS cost efficient and scalable. When a problem arises, the Dynatrace Davis AI causation engine shows you how applications impact your databases and how you can resolve issues. Next steps.

Design 139

Design AWS Education Innovation 139

Percona

SEPTEMBER 1, 2023

Enhanced Database Efficiency By adjusting configuration settings, you can markedly enhance the overall efficiency of your MySQL database. This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

The Morning Paper

NOVEMBER 15, 2020

Improving the efficiency with which we can coordinate work across a collection of units (see the Universal Scalability Law ). FPGAs are chosen because they are both energy efficient and available on SmartNICs). The Full Matcher runs on the CPU, polling a ring buffer populated by the DMA Engine.

Servers 128

Servers Hardware Latency Design 128

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Dynatrace news. What is AWS Lambda? How does AWS Lambda work?

Lambda 173

Lambda AWS Serverless Hardware 173

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. Key features Multi-table storage : Unlike file-per-table tablespaces, which store each table in a separate file, general tablespaces can house numerous tables, enhancing storage efficiency.

Storage 85

Storage Engineering Database Hardware 85

Percona

NOVEMBER 2, 2023

Inside, you will learn: Why you should upgrade MongoDB Staying with outdated MongoDB versions can expose you to critical security vulnerabilities, suboptimal performance, and missed opportunities for efficiency. Improved performance : MongoDB continually fine-tunes its database engine, resulting in faster query execution and reduced latency.

Best Practices 85

Best Practices Hardware Tuning Scalability 85

Percona

DECEMBER 27, 2023

The field of Platform Engineering has witnessed significant advancements, as evidenced by the publication of the CNCF platform whitepaper and the introduction of a dedicated Platform Engineering day at the upcoming KubeCon event. They also remove toil and allow engineers to focus on application development vs platform engineering work.

Cloud 77

Cloud Open Source Strategy Best Practices 77

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. The time and effort saved with testing and deployment are a game-changer for DevOps.

Open Source 290

Open Source Traffic DevOps Cloud 290

Dynatrace

SEPTEMBER 30, 2021

Like any move, a cloud migration requires a lot of planning and preparation, but it also has the potential to transform the scope, scale, and efficiency of how you deliver value to your customers. This can fundamentally transform how they work, make processes more efficient, and improve the overall customer experience. Here are three.

Cloud 158

Cloud Traffic Best Practices Strategy 158

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 104

Availability Database Open Source Hardware 104

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Serverless architecture offers several benefits for enterprises. Simplicity. The first benefit is simplicity. AWS serverless offerings.

Serverless 269

Serverless AWS Lambda Storage 269

Percona

JUNE 22, 2023

We will also discuss related configuration variables to consider that can impact these KPIs, helping you gain a comprehensive understanding of your MySQL server’s performance and efficiency. Query performance Query performance is a key performance indicator (KPI) in MySQL, as it measures the efficiency and speed of query execution.

Performance 102

Performance Monitoring Traffic Database 102

Scalegrid

DECEMBER 21, 2023

This ensures each Redis® instance optimally uses the in-memory data store and aligns with the operating system’s efficiency. Command-Line Analysis Commanding the Redis CLI efficiently requires knowledge of every command’s function and how to decipher its output. It’s equally important to put preventative measures in place.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

APRIL 15, 2022

While modern cloud systems simplify tasks — such as deploying apps and provisioning new hardware and servers — cloud environments can be surprisingly complex. This enables a site reliability engineering approach to cloud operations, in which organizations improve reliability using service-level objectives (SLOs) and error budgets.

Cloud 168

Cloud Infrastructure Innovation Monitoring 168

The Morning Paper

NOVEMBER 10, 2019

You need a lot of software engineers and the willingness to rewrite a lot of software to entertain that idea. Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. The desire for CPU efficiency and lower latencies is easy to understand.

Network 92

Network Transportation Latency Entertainment 92

The Netflix TechBlog

JUNE 4, 2019

The idea CFS operates by very frequently (every few microseconds) applying a set of heuristics which encapsulate a general concept of best practices around CPU hardware use. We could then feed this information directly into the optimization engine to move towards a more supervised learning approach.

Cache 251

Cache Latency Airlines Logistics 251

The Netflix TechBlog

APRIL 29, 2019

Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites. Python has long been a popular programming language in the networking space because it’s an intuitive language that allows engineers to quickly solve networking problems.

Open Source 279

Open Source Network Infrastructure Big Data 279

All Things Distributed

MARCH 19, 2018

This post lifts the veil on some of the scientific, system design, and engineering decisions we made along the way. Amazon SageMaker training supports powerful container management mechanisms that include spinning up large numbers of containers on different hardware with fast networking and access to the underlying hardware, such as GPUs.

Scalability 159

Scalability Hardware AWS Tuning 159

Dotcom-Montior

NOVEMBER 24, 2021

Within an organization, the responsibility of monitoring these large distributed systems typically falls on site reliability engineering (SRE) teams. Software and hardware components are autonomous and execute tasks concurrently. Types of Distributed Systems. State is distributed through the system. Concurrency. Heterogeneity.

Systems 74

Systems Monitoring Hardware Network 74

ACM Sigarch

AUGUST 3, 2023

Embodied carbon is due to Scope 3, e.g., manufacturing IT hardware and datacenter construction. Several recent studies have noted that trends like dark silicon have exacerbated the disparity between embodied carbon and operational carbon because energy-efficiency optimization has traded gains in the latter for increases in the former.

Energy 98

Energy Architecture Hardware Metrics 98

Daniel Lemire

FEBRUARY 8, 2019

The division by a power of two ( / (2 N )) can be implemented as a right shift if we are working with unsigned integers, which compiles to single instruction: that is possible because the underlying hardware uses a base 2. However, engineering matters because computer registers have finite number of bits, and multiplications can overflow.

C++ 279

C++ Benchmarking Hardware Testing 279

Dynatrace

OCTOBER 28, 2020

This enables organizations to innovate faster, collaborate more efficiently, and deliver more value with dramatically less effort. There’s a more efficient way with Dynatrace. The next day, your engineering team can have a detailed look at the underlying data, including Session Replay, from the user’s perspective.

Monitoring 143

Monitoring Systems Infrastructure Cloud 143

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. So is speedy resolution and agreement.

Media 145

Media Games Education Engineering 145

ACM Sigarch

APRIL 26, 2018

HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens. Compared with Google Pixel 1, the HDR photography is accelerated by 5x and the power efficiency increased by 10x. For example, a research group from Japan proposed QUEST, an NPU which is a log-quantized DNN inference engine.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Percona

SEPTEMBER 1, 2023

To address these challenges, architects must design robust and scalable MongoDB databases and adopt appropriate sharding strategies that can efficiently handle increasing workloads while ensuring continuous availability. It’s essential to select an appropriate shard key to ensure even data distribution and efficient querying.

Best Practices 71

Best Practices Traffic Database Servers 71

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. This begins not only in designing the algorithm or coming out with efficient and robust architecture but right onto the choice of programming language.

Java 214

Java C++ Benchmarking Programming 214

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 111

Virtualization AWS Hardware Storage 111