The Netflix TechBlog

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. We have also noted a great potential for further improvement by model tuning (see the section of Rollout in Production).

Tuning 210

Tuning Efficiency Big Data Engineering 210

SQL Shack

APRIL 15, 2024

The purpose of this article is to give newbies some basic advice about SQL performance tuning that helps to improve their query tuning skills in SQL Server. Introduction The performance tuning aims to optimize and reduce the response time of the queries so that we can provide fast and reliable access to data for the […]

Tuning 52

Tuning Performance Servers Monitoring 52

Dynatrace

NOVEMBER 6, 2023

Recently, the Parliament of India released the Digital Personal Data Protection Act 2023 , which regulates the processing of digital personal data in India and recognizes the right of individuals to protect their data in India. Dynatrace is constantly evaluating the further expansion of its regional presence of Dynatrace SaaS.

AWS 235

AWS Azure Tuning Analytics 235

DZone

MARCH 7, 2023

Apache Spark is a powerful open-source distributed computing framework that provides a variety of APIs to support big data processing. In addition, pySpark applications can be tuned to optimize performance and achieve better execution time, scalability, and resource utilization.

Big Data 161

Big Data Code Tuning Open Source 161

DZone

DECEMBER 4, 2019

You may also like: How to Properly Plan JVM Performance Tuning. While Performance Tuning an application both Code and Hardware running the code should be accounted for. Use concurrent data structures only in situations where you have multiple threads accessing the data structure. It improves read concurrency.

Java 147

Java Tuning Performance Hardware 147

Dynatrace

MARCH 11, 2024

In recent years, technologists and business leaders have dubbed data as “the new oil.” Because both oil and data require their owners to refine them to unleash their true value. So how do you realize the vast potential of data while protecting it from threats? Is data the new oil?

Artificial Intelligence 189

Artificial Intelligence Government Games Tuning 189

Dynatrace

MARCH 15, 2024

As organizations strive for observability and data democratization, OpenTelemetry emerges as a key technology to create and transfer observability data. Understanding OpenTelemetry OpenTelemetry is an open, vendor-neutral standard for creating, collecting, and transferring telemetry data, like traces, metrics, and logs.

Open Source 130

Open Source Best Practices Infrastructure Tuning 130

DZone

JUNE 6, 2023

When building an IoT-based service, we need to implement a messaging mechanism that transmits data collected by the IoT devices to a hub or a server. That mechanism is known as a messaging protocol. A messaging protocol is a set of rules and formats that are agreed upon among entities that want to communicate with each other.

IoT 293

IoT Tuning Storage Network 293

DZone

AUGUST 21, 2021

This article describes 3 different tricks that I used in dealing with big data sets (order of 10 million records) and that proved to enhance performance dramatically. Trick 1: CLOB Instead of Result Set.

Big Data 246

Big Data Performance Tuning Mobile 246

SQL Performance

APRIL 13, 2020

In my last post , I started to outline the process I go through when tuning queries – specifically when I discover that I need to add a new index, or modify an existing one. Once we have that data, we can move on to the next steps in the process. This is where index tuning becomes an art. Step 6: Testing. Step 7: Implementation.

Tuning 137

Tuning Cache Metrics Testing 137

SQL Shack

AUGUST 27, 2020

In this article, we will learn some basic tips for SQL Server performance tuning. Tuning the SQL Server performance will help to access data faster so the applications data interaction performances will enhance. SQL Server […].

Tuning 114

Tuning Servers Performance Database 114

DZone

MAY 23, 2019

How do you tune the Snowflake data warehouse when there are no indexes, and few options available to tune the database itself? Snowflake was designed for simplicity, with few performance tuning options. This article summarizes the top five best practices to maximize query performance.

Best Practices 100

Best Practices Tuning Performance Database 100

Dynatrace

JULY 13, 2023

Krishan and I discuss the data privacy and security concerns associated with TikTok and its parent company, Bytedance. This two-part episode of Tech Transforms explores how the federal government is addressing artificial intelligence and data privacy, specifically as it relates to ChatGPT and TikTok.

Artificial Intelligence 177

Artificial Intelligence Social Media Media Government 177

SQL Performance

MARCH 26, 2020

A performance tuning engagement can end up taking many turns as you work through it – it all depends on what is showing up as the problem and what the data tells you. I think of index tuning as an art and a science. Both of those are data-driven and thus in the category of science. Step 4 : Index Usage Stats. What's Next?

Tuning 130

Tuning Cache Database Strategy 130

The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. As our subscribers grow worldwide and Netflix enters the world of gaming , the number of batch workflows and real-time data pipelines increases rapidly.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

APRIL 20, 2023

Modern organizations ingest petabytes of data daily, but legacy approaches to log analysis and management cannot accommodate this volume of data. based financial services group, discussed how the bank uses log monitoring on the Dynatrace platform with an emphasis on observability and security data.

Analytics 184

Analytics Infrastructure Storage Efficiency 184

Percona

MAY 1, 2023

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. What is PostgreSQL performance tuning? Why is PostgreSQL performance tuning important?

Tuning 52

Tuning Efficiency Database Performance 52

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

Dynatrace

MARCH 4, 2020

It helps you identify errors, analyze areas of struggle, and provides tons of analytical data for your testing teams. We’ve developed Session Replay with data privacy regulations and laws in mind, including GDPR (in Europe), California Consumer Privacy Act (CCPA), and Brazilian General Data Protection Law (LGPD).

Tuning 227

Tuning Analytics Strategy Website 227

Dynatrace

FEBRUARY 16, 2023

How do you get more value from petabytes of exponentially exploding, increasingly heterogeneous data? The short answer: The three pillars of observability—logs, metrics, and traces—converging on a data lakehouse. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 182

Analytics Innovation Metrics Database 182

Dynatrace

JULY 2, 2019

not data errors) will be picked up automatically. How to fine-tune failure detection. Simply because if the data produced by the services are of good quality, you are giving Davis a better chance to detect genuine failures! The post How to fine tune failure detection appeared first on Dynatrace blog. Conclusion.

Tuning 115

Tuning Artificial Intelligence Code Java 115

Dynatrace

APRIL 23, 2024

How Dynatrace will support you The Dynatrace secret weapon is data. The Dynatrace data-centric approach ensures compliance isn’t a burden; it’s an opportunity to fine-tune operations. It’s not about stockpiling ones and zeros; it’s about turning raw information into actionable insights.

Tuning 239

Tuning Strategy Servers Technology 239

DZone

MARCH 13, 2024

Whether it’s optimizing algorithms or fine-tuning data structures, every decision we make can have a significant impact on the overall performance of our applications. As software engineers, we are always striving for high performance and efficiency in our code.

Benchmarking 141

Benchmarking Tuning Performance Open Source 141

Dynatrace

APRIL 22, 2022

Although many companies adopt solutions such as OpenTelemetry, Prometheus, and Grafana as part of their observability strategy, they often confront a common data analysis problem: data silos. When teams, tools, and data are siloed, it’s harder for organizations to succeed. This leads to multiple tool-specific dashboards.

Open Source 170

Open Source Metrics Cloud Tuning 170

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

Uber Engineering

MAY 2, 2024

Want to improve the reliability of your Presto cluster with just a few lines of code? Come read how we reduced errors by 90% through improving garbage collection.

Tuning 60

Tuning Code 60

DZone

OCTOBER 1, 2023

As a distributed database, your data is partitioned into “shards” which are then allocated to one or more servers. Because of this sharding, a read or write request to an Elasticsearch cluster requires coordinating between multiple nodes as there is no “global view” of your data on a single server.

Open Source 247

Open Source Tuning Analytics Scalability 247

SQL Performance

SEPTEMBER 17, 2019

This article will cover many areas that database administrators need to be aware of in order to properly license, recover, and tune a Reporting Services installation. Unless the key is backed up, any protected data, such as connection strings and passwords, can't be decrypted. Tuning Options. General Tuning.

Tuning 67

Tuning Servers Database Best Practices 67

InfoQ

APRIL 15, 2024

He specifically delved into Venice DB, the NoSQL data store used for feature persistence. At the QCon London 2024 conference, Félix GV from LinkedIn discussed the AI/ML platform powering the company’s products. By Rafal Gancarz

Artificial Intelligence 105

Artificial Intelligence Big Data Data Engineering Latency 105

Percona

JANUARY 4, 2024

They provide flexibility in data organization and performance optimization compared to the default setup. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning. sec) root@mysql8:/etc/mysql/mysql.conf.d#

Storage 90

Storage Engineering Database Hardware 90

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. For this third and final part of our series, we saved the best for last: How you can enhance telemetry data even more and with less effort on your end with Dynatrace OneAgent.

Metrics 168

Metrics Monitoring Database Network 168

Percona

OCTOBER 11, 2023

In this blog post, we will discuss how we can migrate data from MongoDB Atlas to self-hosted MongoDB. There are a couple of third-party tools in the market to migrate data from Atlas to Pecona Server for MongoDB (PSMDB), like MongoPush, Hummingbird, and MongoShake. It will ask for load sample data. only copy the data).

Database 89

Database Open Source Testing Servers 89

DZone

JANUARY 6, 2024

By harnessing runtime profiling data, PGO empowers developers to fine-tune their code and apply optimizations that align with their application's real-world usage patterns. Profile-Guided Optimization (PGO) stands as a potent technique capable of substantially enhancing the efficiency of your Java programs.

Java 177

Java Performance Tuning Programming 177

The Netflix TechBlog

MARCH 5, 2024

Operational simplicity Service owners often reach out to us with questions about excessive pause times and for help with tuning. We have several frameworks that periodically refresh large amounts of on-heap data to avoid external service calls for efficiency. No explicit tuning has been required to achieve these results.

Latency 228

Latency Java Tuning Efficiency 228

DZone

MAY 1, 2023

The main purpose of this article and use case is to scrape AWS CloudWatch metrics into the Prometheus time series and to visualize the metrics data in Grafana. Prometheus allows us to define the scraping frequency, so we can adjust the frequency of calls to CloudWatch to eventually tune the cost.

AWS 256

AWS Open Source Tuning Metrics 256

The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This technique facilitates validation on multiple fronts.

Traffic 339

Traffic Latency Tuning Systems 339

Percona

AUGUST 31, 2018

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. That means data is stored in memory twice, first in PostgreSQL buffer and then kernel buffer.

Tuning 57

Tuning Database Performance Benchmarking 57