The Netflix TechBlog

JULY 15, 2021

Data Engineers of Netflix?—?Interview Interview with Kevin Wylie This post is part of our “Data Engineers of Netflix” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Kevin Wylie is a Data Engineer on the Content Data Science and Engineering team.

Data Engineering 189

Data Engineering Engineering Entertainment Big Data 189

DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. In this article, we will explore the benefits of leveraging IaC for data engineering projects and provide detailed implementation steps to get started.

Data Engineering 141

Data Engineering Infrastructure Engineering Code 141

Dynatrace

DECEMBER 9, 2020

If you’re running SAP, you’re likely already familiar with the HANA relational database management system. However, if you’re an operations engineer who’s been tasked with migrating to HANA from a legacy database system, you’ll need to get up to speed quickly.

Infrastructure 208

Infrastructure Database Monitoring Metrics 208

Dynatrace

AUGUST 10, 2023

There are also many cases where business data—transactional, inventory, or financial—is at rest or in use , stored in a database. Dynatrace extensions can easily query data from various databases and store the results in Grail™, the Dynatrace data lakehouse. This can be accomplished using Dynatrace extensions.

Database 130

Database Metrics Retail Analytics 130

Adrian Cockcroft

FEBRUARY 9, 2023

There are three current underlying reasons for the platform engineering meme today. That calls into your custom business logic, which is written using a language and libraries platform, makes calls into web services and databases, and is built and deployed by a Continuous Integration/Continuous Deployment (CICD) pipeline.

Engineering 137

Engineering Serverless Lambda AWS 137

DZone

MARCH 13, 2023

The Southwest Airlines fiasco from December 2022 and the FAA Notam database fiasco from January 2023 had one thing in common: their respective root causes were mired in technical debt. At its most basic, technical debt represents some kind of technology mess that someone has to clean up.

Airlines 152

Airlines Engineering Database Technology 152

Dynatrace

APRIL 30, 2021

But because of the complexity involved in executing and analyzing test results of dynamic systems, performance engineering is difficult to scale — especially with lean staff or resources. Grabner also introduced four ways organizations can turbocharge their performance engineering with automation. Automating root cause analysis.

Engineering 208

Engineering Testing Performance Performance Testing 208

Scalegrid

NOVEMBER 12, 2019

PostgreSQL is an amazing relational database. However, beyond just the features, there are other important aspects of a database that need to be considered. However, beyond just the features, there are other important aspects of a database that need to be considered. Feature-wise, it is up there with the best, if not the best.

Database 184

Database Open Source Storage Servers 184

DZone

JANUARY 18, 2023

Disclaimer: I’ll be using Django in my code examples, but the ideas can be generalized; however, a relational database is a stronger requirement. Therefore, I thought this was the perfect opportunity to offer a deep dive into the research, problems, and dead-end roads we encountered on this journey.

Efficiency 152

Efficiency Engineering Database Monitoring 152

High Scalability

JANUARY 4, 2019

Database-as-a-Service (DBaaS) is quickly gaining in popularity across the tech world. These software platform solutions helps users easily manage their database operations without having to really understand any of the abstractions. This post was written by Wendy Dessler of The Blog Frog. Outsourced Security and Administration.

DevOps 207

DevOps Database Development Scalability 207

Percona Community

FEBRUARY 22, 2023

In this blog, we will explore databases on containers. We will use Docker as a container engine tool and Percona Server for MySQL as a database administration tool. MySQL is a relational database management system that stores data on disk. Both are open source tools.

Database 89

Database Servers Open Source Engineering 89

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

Database 177

Database Cloud Open Source Systems 177

Percona

APRIL 14, 2023

Below, we outline some proactive steps for achieving cost efficiency and maintaining performant database environments amid a turbulent economy: 1. Tune and optimize to improve performance Even if you consider your database platform modern, simple database tuning and optimization can speed up your processes significantly.

Database 83

Database Serverless Tuning Cloud 83

Percona

AUGUST 4, 2023

This fast pace of development, however, was combined with long-term support of five years for all releases, which meant many releases to maintain created an undue burden for the engineering team. As Kaj Arno explains , expensive changes to Optimizer and its cost model are the main reason for this change. operates now).

Database 80

Database Servers Innovation Open Source 80

Percona

OCTOBER 10, 2023

mysql> create database if not exists atsaloux; Query OK, 1 row affected (0.02 mysql> create database if not exists atsaloux; Query OK, 1 row affected (0.02 mysql> create database if not exists atsaloux; Query OK, 1 row affected (0.02 Other names may be trademarks of their respective owners. drop_triggers:10000:0.25,copy_rows:10000:0.25,swap_tables:10000:0.25,update_foreign_keys:10000:0.25,analyze_table:10000:0.25

Database 97

Database Performance C++ Engineering 97

Alex Russell

JUNE 22, 2022

As penance for this error, and for being short with Miguel , I must deconstruct the ways Apple has undermined browser engine diversity. Contrary to claims of Apple partisans, iOS engine restrictions are not preventing a "takeover" by Chromium — at least that's not the primary effect. And that's a choice. "WebKit

Engineering 110

Engineering Traffic Government Google 110

Dynatrace

FEBRUARY 1, 2024

But organizations must also be aware of the pitfalls of AI: security and compliance risks, biases, misinformation, and lack of insight into critical metrics (including availability, code development, infrastructure, databases, and more). After updating the query to ask for log data, the engineer was able to identify attack attempts.

Artificial Intelligence 194

Artificial Intelligence Analytics Efficiency Database 194

DZone

OCTOBER 24, 2023

The ELK stack is an abbreviation for Elasticsearch, Logstash, and Kibana, which offers the following capabilities: Elasticsearch: a scalable search and analytics engine with a log analytics tool and application-formed database, perfect for data-driven applications.

Analytics 255

Analytics Storage Infrastructure Scalability 255

Dynatrace

MARCH 27, 2024

As teams and their structure and metadata are often maintained in a dedicated database, such as Microsoft Entra ID (formerly Azure Active Directory) or ServiceNow. A dedicated workflow allows automatic synchronization of the database information with Dynatrace and keeps the ownership team information up-to-date.

Best Practices 207

Best Practices Azure Database Code 207

Uber Engineering

JANUARY 15, 2020

As Uber’s operations became more complex and we offered additional features and … The post Engineering SQL Support on Apache Pinot at Uber appeared first on Uber Engineering Blog.

Engineering 134

Engineering Analytics Big Data Database 134

n0derunner

NOVEMBER 24, 2021

I have worked for Nutanix in the performance engineering group since 2013. We already have a lot of customers running database … The post Nutanix Performance for Database Workloads appeared first on n0derunner.

Database 52

Database Performance Storage Engineering 52

n0derunner

NOVEMBER 24, 2021

I have worked for Nutanix in the performance engineering group since 2013. We already have a lot of customers running database … The post Nutanix Performance for Database Workloads appeared first on n0derunner.

Database 52

Database Performance Storage Engineering 52

DZone

FEBRUARY 9, 2024

These users are typically IT admins who require these privileges to perform their job duties, such as system administrators, database administrators , and network engineers. A privileged user is someone who has been granted elevated permissions to access certain data, applications, or systems within an organization.

Strategy 183

Strategy Architecture Network Database 183

Dynatrace

MARCH 20, 2024

External dependencies Many applications rely on external services, such as databases, APIs, or third-party services. For instance, deploying a new version of a web application that introduces inefficient database queries could lead to increased response times and decreased user satisfaction.

Open Source 275

Open Source Hardware DevOps Infrastructure 275

Percona

SEPTEMBER 1, 2023

MySQL performance tuning offers several significant advantages for effective database management and optimization. Enhanced Database Efficiency By adjusting configuration settings, you can markedly enhance the overall efficiency of your MySQL database. Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

Simform

JULY 20, 2022

As the number of Snapchat users increased to millions, the company required a database solution that could scale and adapt to changing daily needs. Eventually, Snap’s wise selection of databases resulted in lower latency, desired scalability, and infrastructure cost savings. The post How to Choose the Right Database on AWS?

AWS 52

AWS Database Latency Scalability 52

The Morning Paper

JUNE 16, 2019

Towards multiverse databases Marzoev et al., The central idea behind multiverse databases is to push the data access and privacy rules into the database itself. With multiverse databases, each user sees a consistent “parallel universe” database containing only the data that user is allowed to see.

Database 90

Database Cache Benchmarking Efficiency 90

DZone

JULY 18, 2023

But having spent half a decade stewarding a Ruby monolith from 20 to 200 engineers and watched its modest 10GB Postgres database grow beyond 5TB, there’s definitely a point where the pain outweighs the benefits.

Architecture 225

Architecture Network Database Engineering 225

SQL Shack

JULY 10, 2020

In this article, we will be talking about the Sphinx search engine and how to use it to install it on the Windows operating system. This is the first article in the “Sphinx Search Engine” series, where we will explain how to install and use this search engine to create full-text indexes over relational databases […].

Engineering 62

Engineering Operating System Database Systems 62

Dynatrace

JANUARY 31, 2024

The RAG process begins by summarizing and converting user prompts into queries that are sent to a search platform that uses semantic similarities to find relevant data in vector databases, semantic caches, or other online data sources.

Cache 211

Cache Azure Infrastructure Monitoring 211

Percona

MAY 2, 2023

The common use cases involve sharing pt-mysql-summary, pt-stalk, and other OS-related details to assist Support Engineers or any other third-party team troubleshoot database-related issues. Sometimes crucial data sharing is avoided because of compliance rules, organizational policies, or numerous security concerns.

Database 94

Database Systems Open Source Engineering 94

The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. Engineers want their alerting system to be realtime, reliable, and actionable.

Storage 288

Storage Cache Metrics Database 288

DZone

DECEMBER 17, 2021

The load testing for the database needs to be conducted usually so that the impact on the system can be monitored in different scenarios, such as query language rule optimization, storage engine parameter adjustment, etc. Why Load Testing Matters in Nebula Graph? The operating system in this article is the x86 CentOS 7.8.

Testing 240

Testing Operating System Storage Performance 240

Scalegrid

JANUARY 5, 2024

If you’re considering a database management system, understanding these benefits is crucial. DBMS enhances data security with encryption, implements various access controls, and enables improved data sharing and concurrent access, thus facilitating quick response to changes and maintaining consistent database accuracy.

Efficiency 147

Efficiency Storage Database Scalability 147

Testsigma

OCTOBER 21, 2021

James Espie is a test specialist, a quality engineering proponent, and a continuous learner from Auckland, New Zealand. Testers become test automation engineers and end up building more and more automated tests. We decided that the fix for it was to refactor our database so that everything used the same time zone.

Engineering 78

Engineering Metrics Testing Games 78

Dynatrace

MARCH 29, 2023

AlloyDB is a fully managed, PostgreSQL-compatible database service for highly demanding enterprise database workloads. Through our partnership, customers can utilize Dynatrace alongside AlloyDB to gain more visibility and insights into data stored across databases and locations, including in AlloyDB.”

Google 227

Google Metrics Cloud Analytics 227

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. For a long time, these requirements were almost exclusively served by commercial, proprietary databases.

Database 120

Database Design Cloud Storage 120