The Netflix TechBlog

APRIL 12, 2022

By Alex Hutter , Falguni Jhaveri and Senthil Sayeebaba Over the past few years Content Engineering at Netflix has been transitioning many of its services to use a federated GraphQL platform. it began to power a significant portion of the user experience for many applications within Content Engineering.

Engineering 263

Engineering Architecture Java Infrastructure 263

Dynatrace

MARCH 15, 2024

Getting insights into the health and disruptions of your networking or infrastructure is fundamental to enterprise observability. Even for a supported component, delivering logs from applications and infrastructure to DevSecBizOps workflows requires significant manual configuration.

Open Source 206

Open Source Infrastructure Network Government 206

Dynatrace

MAY 28, 2024

You can easily pivot between a hot Kubernetes cluster and the log file related to the issue in 2-3 clicks in these Dynatrace® Apps: Infrastructure & Observability (I&O), Databases, Clouds, and Kubernetes. Finding answers begins with opening the right app for your use case. A sudden drop in received log data?

Analytics 176

Analytics Infrastructure Database Monitoring 176

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

Dynatrace

MARCH 15, 2024

Developers and operators can gain insights into their applications and infrastructure without fear of vendor lock-in because OpenTelemetry is fully open source and owned by CNCF. So, stay tuned. The OpenTelemetry project is supported and maintained by representatives from Microsoft, Google, Amazon, and many others, including Dynatrace.

Open Source 288

Open Source Best Practices Infrastructure Tuning 288

The Netflix TechBlog

FEBRUARY 9, 2021

The Growth Engineering team is responsible for executing growth initiatives that help us anticipate and adapt to this change. For more background on Growth Engineering and the signup funnel, please have a look at our previous blog post that covers the basics. We need to be constantly adapting and innovating as a result of this change.

Engineering 142

Engineering Scalability Architecture Innovation 142

Dynatrace

NOVEMBER 14, 2023

To bring these practices to life within an organization at scale, the discipline of platform engineering has gained popularity. From a high-level point of view, platform engineering aims to: Reduce the cognitive load on development teams. Improve reliability and resiliency of products that rely on platform capabilities.

Government 199

Government Best Practices DevOps Engineering 199

Dynatrace

JULY 6, 2022

As organizations continue to adopt multicloud strategies, the complexity of these environments grows, increasing the need to automate cloud engineering operations to ensure organizations can enforce their policies and architecture principles. This requires significant data engineering efforts, as well as work to build machine-learning models.

Artificial Intelligence 194

Artificial Intelligence Tuning Strategy Big Data 194

Dynatrace

APRIL 20, 2023

With more automated approaches to log monitoring and log analysis, however, organizations can gain visibility into their applications and infrastructure efficiently and with greater precision—even as cloud environments grow. They enable IT teams to identify and address the precise cause of application and infrastructure issues.

Analytics 193

Analytics Infrastructure Storage Efficiency 193

The Netflix TechBlog

MARCH 7, 2019

To unlock these innovations we are making a strategic choice that our focus should be geared towards developing the surrounding infrastructure so that scientists’ work can be easily absorbed into the wider Netflix Experimentation Platform. Graduation We need a process for graduating new research into the experimentation platform.

Engineering 174

Engineering Design Innovation Java 174

Dynatrace

JANUARY 14, 2022

Its ability to densely schedule containers into the underlying machines translates to low infrastructure costs. Tuning thousands of parameters has become an impossible task to achieve via a manual and time-consuming approach. SREcon21 – Automating Performance Tuning with Machine Learning. Additional resources.

Latency 210

Latency Tuning Efficiency AWS 210

InfoQ

MAY 8, 2024

Jules Damji discusses which infrastructure should be used for distributed fine-tuning and training, how to scale ML workloads, how to accommodate large models, and how can CPUs and GPUs be utilized? By Jules Damji

Tuning 89

Tuning Infrastructure Artificial Intelligence Data Engineering 89

The Netflix TechBlog

JUNE 7, 2021

Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices. These metrics are visualized using Lumen , a self-service dashboarding infrastructure. What is BPF?

Network 325

Network Transportation AWS Cloud 325

Dynatrace

JULY 18, 2023

While infrastructure has historically been treated as a bottleneck where proper scaling and compute power are applied to improve performance, these aspects are now typically addressed by hyperscalers that offer cloud-based infrastructure and infrastructure as a service.

Best Practices 195

Best Practices Code Infrastructure Latency 195

The Netflix TechBlog

NOVEMBER 3, 2023

On the Data Platform team, we build the infrastructure used across the company to process data at scale. Based on the sources that the processor is connected to, the SQL Processor will automatically convert the upstream sources as tables within Flink’s SQL engine. Stay tuned for more updates!

Processing 265

Processing Engineering Infrastructure Latency 265

Dynatrace

FEBRUARY 17, 2022

Principal engineer at Google and co-founder of KubeCon, Hightower advocates simplicity and automation. With automatic and intelligent observability of all their infrastructure, apps, services, and workloads and their dependencies, Dynatrace pinpoints exactly where something is going wrong. Dynatrace news.

Technology 216

Technology Technology Cloud Infrastructure 216

Dynatrace

JULY 10, 2023

Here is what a few of these customers say about Dynatrace: “ Dynatrace has been a game changer in our ability to respond to incidents, identify areas for performance tuning, and gain meaningful data from user behavior analysis.” Director of infrastructure, software sector “ Strong technology and stronger people.

Monitoring 225

Monitoring Retail Performance Government 225

The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. Pensive infrastructure comprises two separate systems to support batch and streaming workloads. What’s Next? But our job is nowhere near done.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

The Netflix TechBlog

MAY 26, 2020

Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the Cloud Network Infrastructure to address the identified problems. It is easier to tune a large Spark job for a consistent volume of data. As with any sustainable engineering design, focusing on simplicity is very important.

Network 150

Network Tuning AWS Big Data 150

The Netflix TechBlog

NOVEMBER 6, 2023

Building in-video search To build such a visual search engine, we needed a machine learning system that can understand visual elements. To train these parameters as well as fine-tune the pretrained image-text model weights, we leverage in-house datasets that pair shots of varying durations with rich textual descriptions of their content.

Media 225

Media Social Media Tuning Efficiency 225

Dynatrace

FEBRUARY 9, 2022

Engineers often choose best-of-breed services from multiple sources to create a single application. 2 Automatic detected queues anomaly by AI engine Davis. Stay tuned for updates. This enables proactive AI-driven analysis and easy troubleshooting in serverless scenarios. 3 End-to-end distributed trace including Azure Functions.

Serverless 193

Serverless Azure Lambda AWS 193

The Netflix TechBlog

JUNE 14, 2023

By the summer of 2020, many UI engineers were ready to move to GraphQL. The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations.

Traffic 353

Traffic Latency Cache Metrics 353

Dynatrace

FEBRUARY 9, 2022

More recently, teams have begun to apply DevOps best practices to infrastructure automation, giving developers a more active role with GitOps as an operational framework. Key components of GitOps are declarative infrastructure as code, orchestration, and observability.

Code 222

Code Software Software DevOps 222

The Morning Paper

JULY 7, 2019

Software engineering for machine learning: a case study Amershi et al., More specifically, we’ll be looking at the results of an internal study with over 500 participants designed to figure out how product development and software engineering is changing at Microsoft with the rise of AI and ML. ICSE’19. A general process.

Software Engineering 92

Software Engineering Engineering Software Software 92

Dynatrace

MARCH 15, 2024

Developers and operators can gain insights into their applications and infrastructure without fear of vendor lock-in because OpenTelemetry is fully open source and owned by CNCF. So, stay tuned. The OpenTelemetry project is supported and maintained by representatives from Microsoft, Google, Amazon, and many others, including Dynatrace.

Open Source 130

Open Source Best Practices Infrastructure Tuning 130

The Netflix TechBlog

AUGUST 22, 2019

Artisan Crafted Images In the Netflix full cycle DevOps culture the team responsible for building a service is also responsible for deploying, testing, infrastructure, and operation of that service. A key responsibility of Netflix engineers is identifying gaps and pain points in the development and operation of services.

DevOps 207

DevOps AWS Tuning Infrastructure 207

Dynatrace

FEBRUARY 8, 2021

Putting logs into context with metrics, traces, and the broader application topology enables and improves how companies manage their cloud architectures, platforms and infrastructure, optimizing applications and remediate incidents in a highly efficient way. Now, Dynatrace applies Davis, its AI engine, to monitor the new log sources.

Cloud 261

Cloud Azure Analytics AWS 261

The Netflix TechBlog

JANUARY 10, 2024

Reloaded was created as a single monolithic system, where developers from various media teams in ET and our platform partner team Content Infrastructure and Solutions (CIS)¹ worked on the same codebase, building a single system that handled all media assets. The service also provides options that allow fine-tuning latency, throughput, etc.,

Processing 229

Processing Media Latency Innovation 229

Dynatrace

JULY 24, 2023

Imagine having an AI engine that comprehends the complete context of the transaction and intelligently determines whether to send a discount code—and which one to send. Full contextual awareness helps the AI engine make informed decisions. Has the user purchased this product before? But it doesn’t stop there.

DevOps 225

DevOps Traffic Efficiency Servers 225

Dynatrace

MAY 17, 2022

To solve this problem , Dynatrace offers a fully automated approach to infrastructure and application observability including Kubernetes control plane, deployments, pods, nodes, and a wide array of cloud-native technologies. None of this complexity is exposed to application and infrastructure teams. A look to the future.

Availability 322

Availability Scalability Cloud Metrics 322

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. Compatibility. Extensions.

Open Source 244

Open Source Tuning C++ Database 244

Dynatrace

SEPTEMBER 29, 2021

Think of containers as the packaging for microservices that separate the content from its environment – the underlying operating system and infrastructure. Running containers : Docker Engine is a container runtime that runs in almost any environment: Mac and Windows PCs, Linux and Windows servers, the cloud, and on edge devices.

Open Source 307

Open Source Traffic DevOps Cloud 307

Dynatrace

OCTOBER 7, 2020

With this announcement, Dynatrace brings the value of its AI engine, the scale, security, and automation of Dynatrace OneAgent and the scale of our platform (which can handle 50,000 hosts) to open source technologies so that you get the best of both worlds. Dynatrace unlocks over 200 new technology integrations.

Open Source 258

Open Source Metrics Analytics Tuning 258

Dynatrace

JULY 6, 2022

Organizations everywhere are adopting site reliability engineering (SRE) to cope with the growing complexity of hybrid and cloud-native environments. These reduce the need to hire specialists while providing a unified view of processes and infrastructure that make SRE more focused and effective. Dynatrace news.

Best Practices 193

Best Practices Open Source Tuning Infrastructure 193

The Netflix TechBlog

DECEMBER 8, 2021

Project by Netflix’s Cloud Infrastructure Security team ( Alex Bainbridge , Mike Grima , Nick Siow) Cloud security is a hard problem, but an even harder one is cloud security at scale. We knew that given our scale, we needed to rely heavily on automations and that we needed to build our solutions using battle tested scalable infrastructure.

AWS 196

AWS Cloud Infrastructure Scalability 196

The Netflix TechBlog

AUGUST 13, 2020

You’re half awake and wondering, “Is there really a problem or is this just an alert that needs tuning? Over the years we’ve learned from on-call engineers about the pain points of application monitoring: too many alerts, too many dashboards to scroll through, and too much configuration and maintenance. Infrastructure change events.

Monitoring 210

Monitoring Tuning Traffic Metrics 210