The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. And we can’t discount the productivity impact it causes on data platform users.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

OCTOBER 1, 2020

The Dynatrace Software Intelligence Platform gives you a complete Infrastructure Monitoring solution for the monitoring of cloud platforms and virtual infrastructure, along with log monitoring and AIOps. Network traffic data aggregation and filtering for on-premises, cloud, and hybrid networks. Average query response time.

Traffic 264

Traffic Network Infrastructure Artificial Intelligence 264

Dynatrace

DECEMBER 9, 2020

HANA maintains all the business and analytics data that your business runs on. However, if you’re an operations engineer who’s been tasked with migrating to HANA from a legacy database system, you’ll need to get up to speed quickly. Enable the Davis AI causation engine to automatically analyze every metric.

Infrastructure 200

Infrastructure Database Monitoring Metrics 200

Dynatrace

OCTOBER 13, 2021

Protecting IT infrastructure, applications, and data requires that you understand security weaknesses attackers can exploit. Cloud infrastructure analysis ensures the secure configuration of cloud infrastructure including virtual machines, containers, cloud-hosted databases, and serverless services. Dynatrace news.

Infrastructure 170

Infrastructure Open Source Virtualization Operating System 170

Uber Engineering

JULY 22, 2021

We built a team with varied … The post Containerizing Apache Hadoop Infrastructure at Uber appeared first on Uber Engineering Blog.

Infrastructure 145

Infrastructure Analytics Engineering Architecture 145

Adrian Cockcroft

FEBRUARY 9, 2023

Picture by Adrian — Ka’anapali sunset 2023 There’s been a lot of discussion about platforms recently, I talked about why I think it’s a current hot meme on the WTF Podcast with Charles Humble recently, and Sam Newman just wrote a blog post “ Don’t call it a platform ”. Each of those organizations had their own platform team.

Engineering 137

Engineering Serverless Lambda AWS 137

Dynatrace

JULY 13, 2022

Today, Google announced virtual machines (VMs) based on the Arm architecture on Compute Engine called Tau T2A , which are optimized for cost-effective performance for scale-out workloads, as well as GKE Arm. Dynatrace’s AI engine, Davis® , uses this map to automatically identify and prioritize anomalies, and enable automatic remediation.

Google 232

Google Infrastructure Architecture Engineering 232

Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog.

Efficiency 103

Efficiency Engineering Design Storage 103

Dynatrace

FEBRUARY 28, 2024

In the previous blog post of this series , we discussed the crucial role of Dynatrace as an orchestrator that steps in to stop the testing phase in case of any errors. In this blog post of the series, we will explore the use of Site Reliability Guardian (SRG) in more detail.

DevOps 203

DevOps Metrics Engineering Analytics 203

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. It also shows how data observability relates to business outcomes as organizations embrace generative AI. RAG augments user prompts with relevant data retrieved from outside the LLM.

Cache 204

Cache Azure Infrastructure Monitoring 204

Dynatrace

MARCH 5, 2021

In today’s complex IT environments, the sheer volume of data created makes it impossible for humans to monitor, comprehend, or troubleshoot problems before they impact the experience of your end users. Still, you might have use cases that rely on important custom data streams. Now you can: Alert on the outage of a custom data source.

Metrics 213

Metrics Network Monitoring Infrastructure 213

Dynatrace

NOVEMBER 9, 2022

But many companies’ IT infrastructure doesn’t start out in the cloud. Many organizations turn to cloud migration and cloud application modernization to gain the benefits of serverless environments, such as flexibility, scalability, and more cost-effective cloud infrastructure. . Moreover, according to IDC data,? – blog

AWS 130

AWS Cloud Serverless DevOps 130

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. According to recent Dynatrace data, 59% of CIOs say the increasing complexity of their technology stack could soon overload their teams without a more automated approach to IT operations. Digital transformation shows no signs of slowing down.

Efficiency 276

Efficiency Performance Analytics DevOps 276

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. A vital aspect of such development is subjective testing with HDR encodes in order to generate training data. The pandemic, however, posed unique challenges in conducting a conventional in-lab subjective test with HDR encodes.

Open Source 252

Open Source Software Engineering Internet Internet 252

The Netflix TechBlog

JUNE 1, 2023

This tier extended existing infrastructure by adding new backend components and a new remote call to our ads partner on the playback path. An exception to this trend is when we redirect traffic between AWS data centers during regional evacuations, which leads to sudden spikes in traffic in multiple regions.

Traffic 342

Traffic Best Practices Systems Testing 342

Dynatrace

FEBRUARY 17, 2022

Principal engineer at Google and co-founder of KubeCon, Hightower advocates simplicity and automation. I’ll make some assumptions, read multiple blog posts, and I need to run it myself a couple of times. Grabner notes that Kubernetes already provides some data of its own. Infrastructure as code vs infrastructure as data.

Technology 210

Technology Technology Cloud Infrastructure 210

Dynatrace

JANUARY 17, 2023

OpenTelemetry signals are often analyzed in data silos with missing context and relationships between the data and underlying topology. This leads to significant time wasted in connecting data with application workloads by manually applying labels, or by building crosslinks between the dashboards of incompatible tools.

Analytics 280

Analytics Metrics Open Source Java 280

Dynatrace

NOVEMBER 17, 2023

In the first blog post of this series , we explored how the Dynatrace ® observability and security platform boosts the reliability of Site Reliability Engineers (SRE) CI/CD pipelines and enhances their ability to focus on innovation. Infrastructure layer (Kubernetes Cluster, GCP, Standalone server, etc.)

Innovation 223

Innovation Architecture Code Processing 223

Dynatrace

AUGUST 11, 2022

DevOps teams, SREs (site reliability engineers), platform teams, and SecOps teams aren’t always working from a common source of truth: SAST tools (static application security testing) provide scanning code for vulnerabilities. AI-powered risk assessment based on observability data provided by the Davis® Security Advisor.

Java 240

Java Cloud Virtualization DevOps 240

Dynatrace

JULY 29, 2022

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. At the same time, log analytics can present challenges as data volumes explode, particularly in traditional environments that lack end-to-end observability solutions.

Analytics 214

Analytics Storage Retail Monitoring 214

Uber Engineering

DECEMBER 17, 2019

Uber’s busy 2019 included our billionth delivery of an Uber Eats order, 24 million miles covered by bike and scooter riders on our platform, and trips to top destinations such as the Empire State Building, the Eiffel Tower, and the … The post Uber’s Data Platform in 2019: Transforming Information to Intelligence appeared first on Uber Engineering (..)

Engineering 130

Engineering Big Data Infrastructure Analytics 130

Dynatrace

JULY 7, 2022

AIOps and observability—or artificial intelligence as applied to IT operations tasks, such as cloud monitoring—work together to automatically identify and respond to issues with cloud-native applications and infrastructure. The framework forms the basis of the SAE (Society of Automotive Engineers) automation levels 1 through 5 for cars.

Artificial Intelligence 180

Artificial Intelligence Automotive DevOps Infrastructure 180

Dynatrace

FEBRUARY 8, 2021

Also, these modern, cloud-native architectures produce an immense volume, velocity, and variety of data. Every service and component exposes observability data (metrics, logs, and traces) that contains crucial information to drive digital businesses. Collecting data requires massive and ongoing configuration efforts.

Cloud 259

Cloud Azure Analytics AWS 259

Dynatrace

JULY 12, 2022

AIOps and observability for infrastructure management. Ultimately, this IT automation helps organizations garner real-time data for precise troubleshooting, robust application performance, and solid customer experience. IT teams need to address such infrastructure blind spots with modern observability.

Innovation 219

Innovation Infrastructure DevOps Azure 219

Testsigma

JANUARY 12, 2021

Infrastructure. You would be choosing either of the following ways when setting up your cross browser testing infrastructure: Use emulators or simulators and test browsers on these. Cross browser testing can be quite daunting for a QA engineer. You may read this post to get started with automated cross browser testing.

Website 65

Website Benchmarking Operating System Testing Tools 65

Dynatrace

JULY 29, 2022

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. At the same time, log analytics can present challenges as data volumes explode, particularly in traditional environments that lack end-to-end observability solutions.

Analytics 181

Analytics Storage Retail Monitoring 181

Dynatrace

JULY 6, 2022

Scripts and procedures usually focus on a particular task, such as deploying a new microservice to a Kubernetes cluster, implementing data retention policies on archived files in the cloud, or running a vulnerability scanner over code before it’s deployed. The range of use cases for automating IT is as broad as IT itself.

Artificial Intelligence 188

Artificial Intelligence Tuning Strategy Big Data 188

Dynatrace

APRIL 21, 2022

While applications are built using a variety of technologies and frameworks, there is one thing they usually have in common: the data they work with must be stored in databases. Now, Dynatrace has gone a step further and expanded its coverage and intelligent observability into the next layer: database infrastructure. Dynatrace news.

Database 241

Database DevOps Analytics Servers 241

The Netflix TechBlog

NOVEMBER 11, 2022

By Vi Iyengar , Keila Fong , Hossein Taghavi , Andy Yao , Kelli Griggs , Boris Chen , Cristina Segalin , Apurva Kansara , Grace Tang , Billur Engin , Amir Ziai , James Ray , Jonathan Solorzano-Hamilton Welcome to the first post in our multi-part series on how Netflix is developing and using machine learning (ML) to help creators make better media?—?

Media 239

Media Virtualization Efficiency Innovation 239

Dynatrace

FEBRUARY 10, 2022

“They bring a scale and complexity that is well beyond that of the data center world and it isn’t manageable manually.”. As they increase the speed of product innovation and software development, organizations have an increasing number of applications, microservices and cloud infrastructure to manage. That ushers in IT complexity.

Artificial Intelligence 185

Artificial Intelligence Performance Innovation Speed 185

Dynatrace

NOVEMBER 22, 2021

These resources generate vast amounts of data in various locations, including containers, which can be virtual and ephemeral, thus more difficult to monitor. EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale. AWS: A service for everything. Amazon EC2. Amazon Fargate.

Best Practices 211

Best Practices AWS Monitoring Serverless 211

Dynatrace

JULY 25, 2022

VPC Flow Logs is a feature that gives you the capability to capture more robust IP traffic data that traverses your VPCs. Flow log data can be published to Amazon CloudWatch Logs or Amazon S3 after which you can retrieve and view its data in the Dynatrace Intelligent Observability Platform. What is VPC Flow Logs. Log Events.

AWS 218

AWS Transportation Network Traffic 218

Dynatrace

FEBRUARY 10, 2021

You need to go deeper into the stack — into the infrastructure itself. Davis, the Dynatrace AI-engine, uses exposure information to assess risk and impact and helps avoid false positives. The Dynatrace Davis AI-engine automatically detects and analyzes every vulnerability to assess risk and impact based on exposure information.

Java 243

Java Open Source Engineering Database 243

Dynatrace

APRIL 15, 2022

As organizations expand their cloud footprints, they are combining public, private, and on-premises infrastructures. But modern cloud infrastructure is large, complex, and dynamic — and over time, this cloud complexity can impede innovation. Dynatrace news. As a result, VA had to rapidly scale its on-premises Citrix environment.

Cloud 177

Cloud Infrastructure Innovation Monitoring 177

Dynatrace

DECEMBER 15, 2022

In this blog, we share three log ingestion strategies from the field that demonstrate how building up efficient log collection can be environment-agnostic by using our generic log ingestion application programming interface (API). Yet observability into syslog data on Dynatrace would help you monitor and troubleshoot infrastructure.

Strategy 180

Strategy AWS Open Source Transportation 180

Uber Engineering

APRIL 12, 2018

As the Vice President of Engineering for Uber’s Core Infrastructure group, Matthew Mengerink faces a daunting task.

Infrastructure 81

Infrastructure Engineering Architecture Cloud 81

Dynatrace

FEBRUARY 14, 2020

Modern microservices infrastructure commonly contain thousands of individual business-critical services and related dependencies. Managing highly dynamic service and application infrastructures with a CMDB database can be cumbersome and error prone. appeared first on Dynatrace blog. Dynatrace news.

Infrastructure 232

Infrastructure Website Monitoring Efficiency 232