The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty In the inaugural blog post of this series, we introduced you to the state of our pipelines before Psyberg and the challenges with incremental processing that led us to create the Psyberg framework within Netflix’s Membership and Finance data engineering team.

Processing 226

Processing Data Engineering Efficiency Analytics 226

Dynatrace

OCTOBER 28, 2021

Chaos engineering answers this need so organizations can deliver robust, resilient cloud-native applications that can stand up under any conditions. What is chaos engineering? Chaos engineers ask why. As chaos engineers grow confident in their testing, they change more variables and broaden the scope of the disaster.

Engineering 227

Engineering Entertainment Cloud Infrastructure 227

The Netflix TechBlog

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. Rule Execution Engine is responsible for matching the collected logs against a set of predefined rules.

Tuning 210

Tuning Efficiency Big Data Engineering 210

The Netflix TechBlog

JUNE 30, 2020

Our mission in Studio Engineering is to build a unified, global, and digital studio that powers the effective production of amazing content. link] Why Does Studio Engineering Exist? In this overview, we will shed light on the complexity and magnitude of this journey and update this post with links to deeper technical blogs over time.

Engineering 238

Engineering Entertainment Logistics Innovation 238

Dynatrace

SEPTEMBER 14, 2022

As an industry leader, Dynatrace promotes primarily using software and AI to deal with this complexity at scale instead of just putting data on dashboards. Does that mean that reactive and exploratory data analysis, often done manually and with the help of dashboards, are dead? Why today’s data analytics solutions still fail us.

Metrics 230

Metrics Analytics Monitoring Efficiency 230

The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. And we can’t discount the productivity impact it causes on data platform users.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

OCTOBER 4, 2022

Some time ago, at a restaurant near Boston, three Dynatrace colleagues dined and discussed the growing data challenge for enterprises. At its core, this challenge involves a rapid increase in the amount—and complexity—of data collected within a company. Work with different and independent data types. Thus, Grail was born.

Artificial Intelligence 269

Artificial Intelligence Analytics Storage Architecture 269

Dynatrace

MARCH 15, 2024

As organizations strive for observability and data democratization, OpenTelemetry emerges as a key technology to create and transfer observability data. Understanding OpenTelemetry OpenTelemetry is an open, vendor-neutral standard for creating, collecting, and transferring telemetry data, like traces, metrics, and logs.

Open Source 130

Open Source Best Practices Infrastructure Tuning 130

Dynatrace

AUGUST 26, 2020

We are proud to s hare Dynatrace has been named the winner in the “ Best Overall AI-based Analytics Company ” category, recognized for our innovation and the business-driving impact of our AI engine, Davis. . The post Dynatrace wins AI Breakthrough Award for Davis AI engine appeared first on Dynatrace blog.

Engineering 303

Engineering DevOps Innovation AWS 303

CSS Wizardry

JULY 23, 2023

If you’re happy just to trust me, then this is all you need to know right now: Google takes URL-level Core Web Vitals data from CrUX into account when deciding where to rank you in a search results page. All Core Web Vitals data used to rank you is taken from actual Chrome-based traffic to your site.

Engineering 246

Engineering Google Speed Mobile 246

Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog.

Efficiency 110

Efficiency Engineering Design Storage 110

Dynatrace

MAY 28, 2020

In this blog, I will be going through a step-by-step guide on how to automate SRE-driven performance engineering. This is what this blog is all about. Its a detailed tutorial blog that explains how you can make the first steps towards SLI/SLO-based Quality Gates. For this blog I will be using the same Node.js

Engineering 193

Engineering Performance Metrics Best Practices 193

Dynatrace

APRIL 30, 2021

But because of the complexity involved in executing and analyzing test results of dynamic systems, performance engineering is difficult to scale — especially with lean staff or resources. Grabner also introduced four ways organizations can turbocharge their performance engineering with automation.

Engineering 201

Engineering Testing Performance Performance Testing 201

Dynatrace

SEPTEMBER 7, 2022

Dynatrace and the Dynatrace Intelligent Observability Platform have added support for the newly introduced Amazon VPC Flow Logs to Amazon Kinesis Data Firehose. This support enables customers to define specific endpoint delivery of real-time streaming data to platforms such as Dynatrace. What is VPC Flow Logs? Why Dynatrace?

Traffic 217

Traffic AWS Network Cloud 217

Dynatrace

JUNE 15, 2021

The path to “Architected for Resiliency” is long, but it clearly pays off in the long run, especially when outages occur, as I want to show you in this blog post. Through the RUM data, Dynatrace’s AI engine, Davis, detected seven users were impacted by the outage when they tried to access the Web Interface.

AWS 191

AWS Traffic Architecture Azure 191

Scalegrid

MAY 13, 2020

It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data. This feature-packed database provides powerful and rapid analytics on data that scales up to petabyte volumes.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Adrian Cockcroft

FEBRUARY 9, 2023

Picture by Adrian — Ka’anapali sunset 2023 There’s been a lot of discussion about platforms recently, I talked about why I think it’s a current hot meme on the WTF Podcast with Charles Humble recently, and Sam Newman just wrote a blog post “ Don’t call it a platform ”. Each of those organizations had their own platform team.

Engineering 137

Engineering Serverless Lambda AWS 137

Dynatrace

MARCH 23, 2020

Our procurement decisions were based on trace data that was pulled from a handful of fragmented monitoring solutions. The data had to be painstakingly stitched together over the course of a few weeks, across each layer of our stack. High fidelity data, zero developer involvement. The effort was exhausting to say the least.

Google 194

Google Engineering Metrics Hardware 194

Dynatrace

FEBRUARY 15, 2023

Now we’re adding Smartscape to DQL and two new data sources to Grail: Metrics on Grail and Traces on Grail. Ensuring observability across these environments requires access to data at a massive scale. You no longer need to split, distribute, or pre-aggregate your data. Grail solves this scalability issue!

Analytics 231

Analytics Social Media Metrics Efficiency 231

Uber Engineering

AUGUST 5, 2021

While growing rapidly, we’re also committed to maintaining data quality, as it can greatly … The post How Uber Achieves Operational Excellence in the Data Quality Experience appeared first on Uber Engineering Blog.

Transportation 145

Transportation Engineering Efficiency Architecture 145

Dynatrace

APRIL 19, 2024

In this blog post, we explore real-life scenarios shared by our customers, partners, and internal users at Dynatrace, offering inspiration to kickstart your own journey with custom solutions powered by AppEngine. Using AppEngine as the foundation, they fed disk utilization data into Davis ® AI to forecast the required resizing operation.

AWS 222

AWS Analytics Cloud Monitoring 222

Uber Engineering

NOVEMBER 10, 2021

This generates a large number of financial transactions that need to be stored with provable completeness, consistency, and compliance. … The post How Uber Migrated Financial Data from DynamoDB to Docstore appeared first on Uber Engineering Blog.

Engineering 136

Engineering Systems Architecture 136

Uber Engineering

JANUARY 15, 2020

Uber leverages real-time analytics on aggregate data to improve the user experience across our products, from fighting fraudulent behavior on Uber Eats to forecasting demand on our platform. .

Engineering 134

Engineering Analytics Big Data Database 134

Percona

SEPTEMBER 14, 2023

However, modern business is very much dependent on analytical data. I recommend you read our previous blog, Using ClickHouse as an Analytic Extension for MySQL , from Vadim to know more about this. In this blog post, I will show you how to replicate MySQL data in real-time to ClickHouse. We can do the filter as well.)

Engineering 89

Engineering Database Servers Analytics 89

Dynatrace

DECEMBER 18, 2023

In the last blog post of this series, we delved into how Dynatrace, functioning as a deploy-stage orchestrator, solves the challenges confronted by Site Reliability Engineers (SREs) during the early of automating CI/CD processes. Integrate performance test tools with Dynatrace by adding headers to HTTP requests.

Testing 252

Testing Best Practices Performance Testing Engineering 252

Dynatrace

AUGUST 10, 2021

And, they got the chance to do just that at our recent event, DynatraceGo, which I’ll tell you a bit more about in this blog. Vikash Chhaganlal , GM of Engineering and Infrastructure at Kiwibank said it. These two are tied together, because as Yorck puts it, “If we don’t keep our data secure, who would believe in us?

DevOps 246

DevOps Innovation Big Data Cloud 246

Percona

JANUARY 4, 2024

This blog discusses general tablespaces and explores their functionalities, benefits, and practical usage, along with illustrative examples. They provide flexibility in data organization and performance optimization compared to the default setup. What are MySQL general tablespaces? sec) root@mysql8:/etc/mysql/mysql.conf.d#

Storage 89

Storage Engineering Database Hardware 89

Dynatrace

FEBRUARY 28, 2024

In the previous blog post of this series , we discussed the crucial role of Dynatrace as an orchestrator that steps in to stop the testing phase in case of any errors. In this blog post of the series, we will explore the use of Site Reliability Guardian (SRG) in more detail.

DevOps 205

DevOps Metrics Engineering Analytics 205

Dynatrace

FEBRUARY 1, 2024

The complexity and numerous moving parts of Kubernetes multicloud clusters mean that when monitoring the health of these clusters—which is critical for ensuring reliable and efficient operation of the application—platform engineers often find themselves without an easy and efficient solution.

Engineering 265

Engineering Efficiency Azure Monitoring 265

Dynatrace

NOVEMBER 28, 2023

In the previous installment of this blog series , we explored how to set up Dynatrace as a build-stage orchestrator to effectively address the challenges faced by Site Reliability Engineers (SREs). Davis AI can leverage this data to enable predictive analysis. This approach effectively combats configuration drift. What’s next?

Traffic 263

Traffic Best Practices Strategy Engineering 263

Smashing Magazine

DECEMBER 17, 2020

Search Engine Optimization Checklist (PDF). Search Engine Optimization Checklist (PDF). Search engine optimization (SEO) is an essential part of a website’s design, and one all too often overlooked. A Smashing Guide To The World Of Search Engine Optimization. Frederick O’Brien. 2020-12-17T15:00:13+00:00. Like, literally.

Engineering 130

Engineering Google Website Analytics 130

Dynatrace

MARCH 16, 2022

Over the last year, Dynatrace extended its AI-powered log monitoring capabilities by providing support for all log data sources. We added monitoring and analytics for log streams from Kubernetes and multicloud platforms like AWS, GCP, and Azure, as well as the most widely used open-source log data frameworks.

Metrics 216

Metrics Lambda Infrastructure Monitoring 216

Uber Engineering

DECEMBER 10, 2018

From low-level system metrics, such as memory utilization of a host, to high-level business metrics, including the number of Uber Eats orders in a … The post The Billion Data Point Challenge: Building a Query Engine for High Cardinality Time Series Data appeared first on Uber Engineering Blog.

Engineering 76

Engineering Metrics Monitoring Technology 76

Dynatrace

DECEMBER 13, 2023

That’s why many organizations are turning to generative AI—which uses its training data to create text, images, code, or other types of content that reflect its users’ natural language queries—and platform engineering to create new efficiencies and opportunities for innovation. Data indicates these technology trends have taken hold.

Technology 205

Technology Technology Artificial Intelligence Analytics 205

Dynatrace

APRIL 22, 2022

Although many companies adopt solutions such as OpenTelemetry, Prometheus, and Grafana as part of their observability strategy, they often confront a common data analysis problem: data silos. When teams, tools, and data are siloed, it’s harder for organizations to succeed. This leads to multiple tool-specific dashboards.

Open Source 175

Open Source Metrics Cloud Tuning 175

Scalegrid

AUGUST 30, 2019

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. Instead, Redis stores data in data structures which makes it very flexible to use. Data Structures in Redis.

Cache 232

Cache Ecommerce Social Media Database 232

Dynatrace

APRIL 8, 2022

Fluentd is an open-source data collector that unifies log collection, processing, and consumption. Built-in resiliency ensures data completeness and consistency even if Fluentd or an endpoint service goes down temporarily. All metrics, traces, and real user data are also surfaced in the context of specific events.

Metrics 181

Metrics Analytics Software Architecture Open Source 181