The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. Let’s dive in! What is late-arriving data? Some techniques we used were: 1.

Data Engineering 264

Data Engineering Engineering Processing Games 264

Dynatrace

NOVEMBER 14, 2023

Site reliability engineering (SRE) has become increasingly important to organizations looking to keep up with the rapid pace of digital transformation. Effective site reliability engineering requires enterprise-wide transformation Without a unified understanding of SRE practices, organizational silos can quickly form between departments.

Best Practices 201

Best Practices Engineering DevOps Software Engineering 201

Dynatrace

AUGUST 17, 2021

This method of structuring, developing, and operating complex, multi-function software as a collection of smaller independent services is known as microservice architecture. ” it helps to understand the monolithic architectures that preceded them. Understanding monolithic architectures.

Architecture 246

Architecture Software Software Development 246

Dynatrace

AUGUST 17, 2021

This method of structuring, developing, and operating complex, multi-function software as a collection of smaller independent services is known as microservice architecture. ” it helps to understand the monolithic architectures that preceded them. Understanding monolithic architectures.

Architecture 246

Architecture Software Software Development 246

Dynatrace

OCTOBER 28, 2021

But with the complexity that comes with digital transformation and cloud-native architecture, teams need a way to make sure applications can withstand the “chaos” of production. Chaos engineering answers this need so organizations can deliver robust, resilient cloud-native applications that can stand up under any conditions.

Engineering 235

Engineering Entertainment Cloud Infrastructure 235

Dynatrace

JULY 7, 2022

Many organizations are taking a microservices approach to IT architecture. However, in some cases, an organization may be better suited to another architecture approach. Therefore, it’s critical to weigh the advantages of microservices against its potential issues, other architecture approaches, and your unique business needs.

Architecture 209

Architecture Serverless Azure Programming 209

The Netflix TechBlog

JUNE 30, 2020

Our mission in Studio Engineering is to build a unified, global, and digital studio that powers the effective production of amazing content. In an effort to effectively and efficiently produce this content we are looking to improve and automate many areas of the production process. link] Why Does Studio Engineering Exist?

Engineering 238

Engineering Entertainment Logistics Innovation 238

Dynatrace

FEBRUARY 4, 2021

What is site reliability engineering? Site reliability engineering (SRE) is the practice of applying software engineering principles to operations and infrastructure processes to help organizations create highly reliable and scalable software systems. Dynatrace news. SRE focuses on automation.

Engineering 260

Engineering DevOps Government Latency 260

Dynatrace

JANUARY 31, 2022

Key takeaways from this article on modern observability for serverless architecture: As digital transformation accelerates, organizations need to innovate faster and continually deliver value to customers. Companies often turn to serverless architecture to accelerate modernization efforts while simplifying IT management.

Serverless 185

Serverless Architecture Open Source Innovation 185

DZone

JANUARY 31, 2024

The reality of the startup is that engineering teams are often at a crossroads when it comes to choosing the foundational architecture for their software applications. The allure of a microservice architecture is understandable in today's tech state of affairs, where scalability, flexibility, and independence are highly valued.

Architecture 278

Architecture Scalability Design Engineering 278

Dynatrace

FEBRUARY 4, 2021

Site reliability engineering (SRE) is the practice of applying software engineering principles to operations and infrastructure processes to help organizations create highly reliable and scalable software systems. Shift-left using an SRE approach means that reliability is baked into each process, app and code change.

Engineering 184

Engineering DevOps Government Latency 184

Dynatrace

JUNE 2, 2022

Site reliability engineering (SRE) continues to gain popularity as organizations embrace hybrid cloud strategies and IT automation at scale. By applying software engineering principles to operations and infrastructure practices, SRE enables organizations to streamline and automate IT processes. Dynatrace news.

DevOps 148

DevOps Innovation Engineering Benchmarking 148

Dynatrace

JULY 11, 2023

We’re delighted to share that IBM and Dynatrace have joined forces to bring the Dynatrace Operator, along with the comprehensive capabilities of the Dynatrace platform, to Red Hat OpenShift on the IBM Power architecture (ppc64le).

Architecture 176

Architecture Availability Infrastructure Monitoring 176

The Netflix TechBlog

JUNE 15, 2022

By Alex Hutter , Falguni Jhaveri , and Senthil Sayeebaba In a previous post , we described the indexing architecture of Studio Search and how we scaled the architecture by building a config-driven self-service platform that allowed teams in Content Engineering to spin up search indices easily.

Engineering 183

Engineering Architecture Availability Tuning 183

The Netflix TechBlog

JUNE 1, 2021

Data Engineers of Netflix?—?Interview Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. What drew you to Netflix?

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

DZone

NOVEMBER 7, 2023

With businesses constantly in the race to stay ahead, the process of integrating this data becomes crucial. However, it's no longer enough to assimilate data in isolated, batch-oriented processes. Businesses were content with accumulating data over defined intervals and then processing it in scheduled batches.

Systems 281

Systems Analytics Architecture Engineering 281

ACM Sigarch

OCTOBER 10, 2022

Although, only recently the security attacks on quantum computers have begun to be demonstrated, this brings to the forefront the need to consider security of quantum computer architectures as a first-class design objective. Why Research Security of Quantum Computers?

Architecture 72

Architecture Hardware Programming Cloud 72

Dynatrace

SEPTEMBER 8, 2020

Very often, I heard that chaos engineering is only a technique used by larger companies (like Netflix) or in cloud native environments. You should read on if: You want to get an idea what chaos engineering is. You want to know if chaos engineering is only usable in cloud native environments. Figure 1: Sample architecture.

Engineering 143

Engineering Cloud Monitoring Testing 143

Uber Engineering

DECEMBER 16, 2021

It is currently used by hundreds of … The post Cadence Multi-Tenant Task Processing appeared first on Uber Engineering Blog. It scales horizontally to handle millions of concurrent executions from various customers.

Processing 109

Processing Engineering Development Open Source 109

Dynatrace

APRIL 19, 2024

Automate disk resizing operations with Davis AI predictive analytics The Dynatrace Site Reliability Engineering (SRE) team was looking for a way to automatically adjust disk space for cloud volumes on a regular basis to avoid over- or under-provisioning them.

AWS 230

AWS Analytics Cloud Monitoring 230

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Application architectures might not be conducive to rehosting. Reduce inter-process communications overhead. Implement intelligent retry and failover processes. Is the solution to just move all workloads to the cloud?

Cloud 218

Cloud Energy Best Practices Cache 218

Official Blog - World Web Technology

DECEMBER 4, 2023

How does it contribute to the software development process ? This article will explain why most companies and their software developers use SDLC to manage their development process. SDLC is an essential framework for the total software development process as it aids in managing software development projects effectively.

Processing 64

Processing Software Software Development 64

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. The Greenplum Architecture. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Strategic Tech

MARCH 16, 2021

There are a few qualities that differentiate average from high performing software engineering organisations. I believe that attitude towards the design of code and architecture is one of them. In Accelerate , Nicole Forsgren shows a link between well-designed, loosely-coupled architecture and more frequent software delivery.

Software Engineering 80

Software Engineering Design Engineering Software 80

Uber Engineering

SEPTEMBER 23, 2021

This article focuses on how we … The post Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot appeared first on Uber Engineering Blog. With this new ability came new challenges that needed to be solved at Uber, such as systems for ad auctions, bidding, attribution, reporting, and more.

Processing 139

Processing Engineering Systems Architecture 139

Dynatrace

OCTOBER 4, 2022

Grail architectural basics. The aforementioned principles have, of course, a major impact on the overall architecture. A data lakehouse addresses these limitations and introduces an entirely new architectural design. Ingest and process with Grail. It’s based on cloud-native architecture and built for the cloud.

Artificial Intelligence 276

Artificial Intelligence Analytics Storage Architecture 276

Strategic Tech

JULY 21, 2020

Most organisations go through an architecture modernisation effort at some point as their systems drift into a state of intolerable maintenance costs and they diverge too far from modern technological advances. High-level Process Sections Conceptually, there are three major sections to a modernisation process.

Architecture 98

Architecture Design Software Architecture Strategy 98

Strategic Tech

JUNE 28, 2022

“If our teams were just organized in the right way, and we adopted the agile process, we’d be so much more efficient.” A belief that if teams are organized in the optimal way and the right process is followed, the company will be high-performing. Empowered teams are also more important than structure and process.

Processing 52

Processing Architecture Strategy Infrastructure 52

Testsigma

NOVEMBER 18, 2021

George Ukkuru is a seasoned technocrat and AVP of quality engineering, DevOps, and SRE @Marlabs Inc. He has also authored a number of books on quality engineering and test automation. Q2: What’s your battle-tested process for finding and resolving bugs in Production? This changes how teams test for quality.

Engineering 104

Engineering Social Media DevOps Azure 104

Dynatrace

APRIL 20, 2023

Causal AI—which brings AI-enabled actionable insights to IT operations—and a data lakehouse, such as Dynatrace Grail , can help break down silos among ITOps, DevSecOps, site reliability engineering, and business analytics teams. Logs are automatically produced and time-stamped documentation of events relevant to cloud architectures.

Analytics 196

Analytics Infrastructure Storage Efficiency 196

Dynatrace

JANUARY 23, 2024

Accelerating AWS migration and optimizing efficiency with Dynatrace As many companies embrace cloud modernization and begin migrating to the AWS cloud (or continuing to move existing workloads), complexity can introduce uncertainty into the process. What will the new architecture be? What can we move?

Cloud 221

Cloud Artificial Intelligence Performance AWS 221

Dynatrace

MARCH 18, 2024

Following FinOps practices, engineering, finance, and business teams take responsibility for their cloud usage, making data-driven spending decisions in a scalable and sustainable manner. Suboptimal architecture design. This awareness is important when the goal is to drive cost-conscious engineering.

Best Practices 242

Best Practices Strategy Cloud AWS 242

Dynatrace

NOVEMBER 14, 2023

Golden Paths for rapid product development Modern software development aims to streamline development and delivery processes to ensure fast releases to the market without violating quality and security standards. To bring these practices to life within an organization at scale, the discipline of platform engineering has gained popularity.

Government 203

Government Best Practices DevOps Engineering 203

Scalegrid

MARCH 14, 2024

Defining Hybrid Cloud Strategy The decision-making process about where to situate data and applications is vital to any hybrid cloud solution. Defining Hybrid Cloud Strategy The decision-making process about where to situate data and applications is vital to any hybrid cloud solution.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Strict fault-tolerance is a principal requirement for the engine.

Big Data 154

Big Data Processing Lambda Database 154

InfoQ

NOVEMBER 29, 2023

HubSpot adopted routing messages over multiple Kafka topics (called swimlanes) for the same producer to avoid the build-up in the consumer group lag and prioritize the processing of real-time traffic.

Processing 79

Processing Traffic Data Engineering Scalability 79

Simform

FEBRUARY 14, 2023

Stream processing has become a core part of enterprise data architecture today due to the explosive growth of data from sources such as IoT sensors, security logs, and web applications. This blog discusses the topic of stream processing in detail to help you navigate its landscape with ease.

Processing 52

Processing IoT Architecture Data Engineering 52