The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

Dynatrace

APRIL 13, 2021

If you’re a Dynatrace administrator who’s responsible for installing and updating OneAgent or ActiveGate instances or you’re simply interested in learning how to get new functionality from Dynatrace as soon as possible, this blog post is for you. The OneAgent advantage. Easily configure automatic ActiveGate updates.

Processing 256

Processing Monitoring Performance Availability 256

Dynatrace

NOVEMBER 3, 2023

A platform encompasses a set of tools, services, and infrastructure that enables developers to build, test, and deploy software applications. Platform engineers design and implement these platforms, as well as ensure their security, scalability, and reliability. The result is a cloud-native approach to software delivery.

Engineering 221

Engineering DevOps Software Engineering Scalability 221

Dynatrace

NOVEMBER 17, 2023

In the first blog post of this series , we explored how the Dynatrace ® observability and security platform boosts the reliability of Site Reliability Engineers (SRE) CI/CD pipelines and enhances their ability to focus on innovation. Infrastructure layer (Kubernetes Cluster, GCP, Standalone server, etc.)

Innovation 232

Innovation Architecture Code Processing 232

Dynatrace

NOVEMBER 20, 2023

Effectively automating IT processes is key to addressing the challenges of  complex cloud environments. Relying on manual processes results in outages, increased costs, and frustrated customers. IT operations teams need ways to monitor infrastructure, even if it’s not within their data centers and under their direct management.

AWS 217

AWS Artificial Intelligence Analytics Cloud 217

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. Data dependencies and framework intricacies require observing the lifecycle of an AI-powered application end to end, from infrastructure and model performance to semantic caches and workflow orchestration.

Cache 212

Cache Azure Infrastructure Monitoring 212

Dynatrace

APRIL 3, 2024

To address this, many states apply for federal funding to build a security operations center to proactively defend against the growing rate of cybersecurity threats and ensure the resilience of digital infrastructure. What is a security operations center? Dynatrace immediately identified Log4Shell and the first attempted attack patterns.

Government 164

Government Social Media Metrics Infrastructure 164

The Netflix TechBlog

NOVEMBER 3, 2023

Democratizing Stream Processing @ Netflix By Guil Pires , Mark Cho , Mingliang Liu , Sujay Jain Data powers much of what we do at Netflix. On the Data Platform team, we build the infrastructure used across the company to process data at scale. However, this design decision led to a different set of challenges.

Processing 265

Processing Engineering Infrastructure Latency 265

Strategic Tech

JULY 21, 2020

Before jumping into either of those scenarios, have a look at what Strategic Domain-Driven Design can offer you. High-level Process Sections Conceptually, there are three major sections to a modernisation process. This means a software architecture should be purposely designed for the most favourable business consequences.

Architecture 98

Architecture Design Software Architecture Strategy 98

Strategic Tech

MARCH 16, 2021

I believe that attitude towards the design of code and architecture is one of them. In my experience, the culture is better and the results are better in orgs where engineers and architects obsess over the design of code and architecture. Both valuing design and striving for continuous delivery are necessary.

Software Engineering 80

Software Engineering Design Engineering Software 80

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Improving data processing. Boosting batch processing. Serverless architecture offers several benefits for enterprises. Simplicity.

Serverless 289

Serverless AWS Lambda Storage 289

Dynatrace

JANUARY 23, 2024

Platform engineering improves developer productivity by providing self-service capabilities with automated infrastructure operations. Why growing AI adoption requires an AI observability strategy – blog While AI adoption brings operational efficiency and innovation for organizations, it also introduces the potential for runaway AI costs.

Performance 195

Performance DevOps Innovation Artificial Intelligence 195

Dynatrace

OCTOBER 25, 2022

NoOps is a concept in software development that seeks to automate processes and eliminate the need for an extensive IT operations team. Mike Gualtieri of Forrester Research, who coined the term NoOps , once said in his blog post, “NoOps means that application developers will never have to speak with an operations professional again.”.

DevOps 225

DevOps Big Data Cloud Innovation 225

Dynatrace

JULY 7, 2022

These teams typically use standardized tools and follow a sequential process to build, review, test, deliver, and deploy code. Microservice design patterns allow developers to use their preferred programming language or framework, which helps to prevent employee churn and the need for outsourced talent.

Architecture 209

Architecture Serverless Azure Programming 209

Dynatrace

MARCH 22, 2021

While today’s IT world continues the shift toward treating everything as a service, many organizations need to keep their environments under strict control while managing their infrastructure themselves on-premises. Some SNMP-enabled devices are designed to report events on their own with so-called SNMP traps. SNMP observability.

Metrics 245

Metrics Network Infrastructure Traffic 245

Dynatrace

JANUARY 26, 2021

DevSecOps is a cross-team collaboration framework that integrates security into DevOps processes from the start rather than waiting to address security in a separate silo. DevOps has gained ground in recent years as a way to combine key operational principles with development cycles, recognizing that these two processes must coexist.

DevOps 277

DevOps Best Practices Open Source Tuning 277

The Netflix TechBlog

DECEMBER 8, 2021

Project by Netflix’s Cloud Infrastructure Security team ( Alex Bainbridge , Mike Grima , Nick Siow) Cloud security is a hard problem, but an even harder one is cloud security at scale. We knew that given our scale, we needed to rely heavily on automations and that we needed to build our solutions using battle tested scalable infrastructure.

AWS 196

AWS Cloud Infrastructure Scalability 196

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. An advanced observability solution can also be used to automate more processes, increasing efficiency and innovation among Ops and Apps teams.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Dynatrace

APRIL 21, 2022

In this blog, we’ll review the five pillars of the Azure Well-Architected Framework and illustrate how organizations can use Dynatrace to ensure their applications are architected correctly. Figure 1 – Individual Host pages show performance metrics, problem history, event history, and related processes for each host.

Azure 197

Azure Monitoring Virtualization Metrics 197

Dynatrace

MAY 15, 2020

This is especially true when we consider the explosive growth of cloud and container environments, where containers are orchestrated and infrastructure is software defined, meaning even the simplest of environments move at speeds beyond manual control, and beyond the speed of legacy Security practices. And this poses a significant risk.

Government 235

Government DevOps Infrastructure Network 235

Dynatrace

APRIL 19, 2021

In the Magic Quadrant report, Gartner defines APM as, “software that enables the observation of application behavior and its infrastructure dependencies, users, and business key performance indicators (KPIs) throughout the application’s life cycle.” We anticipated the industry’s move to dynamic multicloud environments and DevOps processes.

DevOps 268

DevOps Innovation Speed Infrastructure 268

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. As a result, we created Grail with three different building blocks, each serving a special duty: Ingest and process. Ingest and process with Grail. It’s based on cloud-native architecture and built for the cloud. Retain data.

Artificial Intelligence 275

Artificial Intelligence Analytics Storage Architecture 275

Dynatrace

JUNE 13, 2022

They can develop software applications rapidly and gain access to extensible cloud resources without having to sink costs into IT plumbing or managing this infrastructure themselves. Cloud operations and observability boost resilience for American Family – blog. The Log4j vulnerability explained (and what to do about it) – blog.

Open Source 229

Open Source DevOps Java Innovation 229

Dynatrace

SEPTEMBER 22, 2021

What was once a straightforward process in the days of monolithic applications is now considerably more complex. Organizations often start their APM journey by implementing APM tools which are typically designed to look at one specific aspect of application performance. What’s the difference between APM tools and an APM platform?

Innovation 214

Innovation Open Source Monitoring Infrastructure 214

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Architectural Design. At a glance – TLDR.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. 25.84 - Total 21.04 zone_reclaim_mode In some OS versions, the vm.zone_reclaim_mode is enabled.

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

JANUARY 18, 2023

However, getting reliable answers from observability data so teams can automate more processes to ensure speed, quality, and reliability can be challenging. SRE applies software engineering principles to operations and infrastructure processes. Unpacking the purpose and importance of an IT cultural revolution – blog.

DevOps 207

DevOps Best Practices Innovation Strategy 207

Tasktop

APRIL 11, 2022

How do you transform an infrastructure functional team into a platform team? The pace of innovation is very much determined by the organization design and how we structure this matrix of roles and responsibilities,” says Dr. Mik Kersten, Tasktop CEO and best-selling author of Project to Product , who co-hosts the webinar.

Design 52

Design Infrastructure Metrics Innovation 52

Dynatrace

NOVEMBER 22, 2021

Because of its matrix of cloud services across multiple environments, AWS and other multicloud environments can be more difficult to manage and monitor compared with traditional on-premises infrastructure. EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale.

Best Practices 220

Best Practices AWS Monitoring Serverless 220

Dynatrace

JULY 24, 2023

In this blog, we will dive into the transformative power of answer-driven automation. We will also explore the evolution of DevOps automation and the significance of data-driven answers in unlocking streamlined, automated DevOps and SRE processes. Consider an event-driven automation system designed for incident management.

DevOps 228

DevOps Traffic Efficiency Servers 228

Dynatrace

NOVEMBER 18, 2020

In short, combining development and operations makes it possible for process to keep pace with progress. Consulting firm Deloitte notes that technology teams are now expected to deliver projects four times faster with the same budget, and most of that budget goes toward running the business — not process or software innovation.

DevOps 211

DevOps Infrastructure Open Source C++ 211

Dynatrace

JULY 7, 2022

But as IT teams increasingly design and manage cloud-native technologies, the tasks IT pros need to accomplish are equally variable and complex. Observability technology is how modern IT teams “sense” what is going on with user experience, application performance, and infrastructure health. Sense’ with observability.

Artificial Intelligence 189

Artificial Intelligence Automotive DevOps Infrastructure 189

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. Bitrate versus quality comparison HDR-VMAF is designed to be format-agnostic — it measures the perceptual quality of HDR video signal regardless of its container format, for example, Dolby Vision or HDR10. The graphic below (Fig.

Open Source 252

Open Source Software Engineering Internet Internet 252

Dynatrace

JULY 6, 2022

Organizations that have achieved SRE maturity have a better handle on the state of their infrastructure, the ability to tie reliability metrics more tightly to business objectives, and the means to ensure a consistent and responsive customer experience. Design, implement, and tune effective SLOs.

Best Practices 196

Best Practices Open Source Tuning Infrastructure 196

Dynatrace

AUGUST 24, 2020

But there are other related components and processes (for example, cloud provider infrastructure) that can cause problems in applications running on Kubernetes. Dynatrace AWS monitoring gives you an overview of the resources that are used in your AWS infrastructure along with their historical usage. OneAgent and its Operator .

Analytics 249

Analytics Infrastructure AWS Operating System 249

The Netflix TechBlog

OCTOBER 12, 2022

We had a fun conversation with his team, and we realized that some parts of it might make a good blog post as well. So we jointly edited a bit for length and clarity, and are posting here as well as on OfferFit’s blog. And then in the last year, I’ve been the PM for all of our experimentation infrastructure and platform.

Virtualization 189

Virtualization Design Games Infrastructure 189

Dynatrace

APRIL 29, 2021

The EMCA recently implemented a new monitoring approval process, which breaks down details such as how a system functions, how information is being shared, and the overall software capabilities. The ECMA has created “cloud teams” to aid in the application monitoring process. Puckett calls “The People Problem.” Watch webinar.

Artificial Intelligence 143

Artificial Intelligence Cloud Monitoring Education 143