The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. Given our role on this critical path, accuracy is paramount.

Data Engineering 264

Data Engineering Engineering Processing Games 264

Dynatrace

FEBRUARY 8, 2021

Also, these modern, cloud-native architectures produce an immense volume, velocity, and variety of data. Logs and events play an essential role in this mix; they include critical information which can’t be found anywhere else, like details on transactions, processes, users and environment changes.

Cloud 258

Cloud Azure Analytics AWS 258

Dynatrace

FEBRUARY 10, 2023

In what follows, we explore some key cloud observability trends in 2023, such as workflow automation and exploratory analytics. Check out the guide from last year’s event. IT pros need a data and analytics platform that doesn’t require sacrifices among speed, scale, and cost. We’ll post news here as it happens!

Efficiency 272

Efficiency Performance Analytics DevOps 272

Dynatrace

APRIL 13, 2023

Log auditing is a cybersecurity practice that involves examining logs generated by various applications, computer systems, and network devices to identify and analyze security-related events. It requires an understanding of cloud architecture and distributed systems, with the goal of automating processes.

Analytics 182

Analytics Java Infrastructure Cloud 182

Dynatrace

OCTOBER 14, 2022

As more organizations are moving from monolithic architectures to cloud architectures, the complexity continues to increase. These systems are generating more data than ever, and teams simply can’t keep up with a manual approach. And where are these tools best used in IT operations? What is artificial intelligence?

Artificial Intelligence 172

Artificial Intelligence DevOps Analytics Cloud 172

The Netflix TechBlog

JUNE 7, 2021

Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the cloud network infrastructure to address the identified problems. Flow Collector consumes two data streams, the IP address change events from Sonar via Kafka and eBPF flow log data from the Flow Exporter sidecars. What is BPF?

Network 325

Network Transportation AWS Cloud 325

Dynatrace

APRIL 19, 2023

Security policies give authorized users access to Dynatrace capabilities, such as Grail and its add-ons, exploratory analytics, and Dynatrace AppEngine. The new architecture enables more granularity in permission management and provides the dynamics necessary to serve modern access management use cases.

Storage 205

Storage Analytics Systems Architecture 205

Dynatrace

APRIL 11, 2023

Cloud application security remains challenging because organizations lack end-to-end visibility into cloud architecture. As organizations migrate applications to the cloud, they must balance the agility that microservices architecture brings with the complexity and lack of transparency that can also come with it.

Cloud 183

Cloud DevOps Open Source Retail 183

Dynatrace

JANUARY 31, 2024

GenAI is prone to erratic behavior due to unforeseen data scenarios or underlying system issues. Figure 1: Sample RAG architecture While this approach significantly improves the response quality of GenAI applications, it also introduces new challenges.

Cache 201

Cache Azure Infrastructure Monitoring 201

Dynatrace

NOVEMBER 22, 2021

Serverless architecture enables organizations to deliver applications more efficiently without the overhead of on-premises infrastructure, which has revolutionized software development. These tools simply can’t provide the observability needed to keep pace with the growing complexity and dynamism of hybrid and multicloud architecture.

AWS 225

AWS Lambda Artificial Intelligence Serverless 225

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. This is where unified observability and Dynatrace Automations can help by leveraging causal AI and analytics to drive intelligent automation across your multicloud ecosystem.

AWS 243

AWS Efficiency Azure Cloud 243

Dynatrace

AUGUST 25, 2023

Program staff depend on the reliable functioning of critical program systems and infrastructure to provide the best service delivery to the communities and citizens HHS serves, from newborn infants to persons requiring health services to our oldest citizens. Both can result in lost productivity for IT teams and staff in the field.

Government 200

Government Infrastructure Programming Cloud 200

Dynatrace

AUGUST 7, 2023

They can also use generative AI for cybersecurity, write prototype code, and implement complex software systems. But managing the breadth of the vulnerabilities that can put your systems at risk is challenging. As security teams seek to understand malicious events, the importance of unified observability in context compounds.

DevOps 182

DevOps Analytics Best Practices Java 182

Dynatrace

OCTOBER 17, 2023

The rise of cloud-native microservice architectures further exacerbates this change. Moreover, the system lacks flexibility, imposing strict schemas that administrators and developers must adhere to avoid additional costs. As a result, the company awarded customers gift cards for system failures, creating an additional cost.

Retail 233

Retail Storage Best Practices Architecture 233

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. You might optimize your cooling system or move your data center to a colder region with reduced cooling demands. Application architectures might not be conducive to rehosting. Unfortunately, it’s not that simple.

Cloud 205

Cloud Energy Best Practices Cache 205

Dynatrace

JULY 6, 2022

At its most basic, automating IT processes works by executing scripts or procedures either on a schedule or in response to particular events, such as checking a file into a code repository. When monitoring tools release a stream of alerts, teams can easily identify which ones are false and assess whether an event requires human intervention.

Artificial Intelligence 185

Artificial Intelligence Tuning Strategy Big Data 185

Dynatrace

DECEMBER 15, 2022

This transition to public, private, and hybrid cloud is driving organizations to automate and virtualize IT operations to lower costs and optimize cloud processes and systems. Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure.

Artificial Intelligence 198

Artificial Intelligence DevOps Hardware Virtualization 198

Dynatrace

JANUARY 23, 2024

Enter AI observability, which uses AI to understand the performance and cost-effectiveness details of various systems in an IT environment. Check back here throughout the event for the latest news, insights, and announcements. And the ability to easily create custom apps enables teams to do any analytics at any time for any use case.

Performance 182

Performance DevOps Innovation Artificial Intelligence 182

ScaleOut Software

JULY 19, 2021

Real-Time Device Tracking with In-Memory Computing Can Fill an Important Gap in Today’s Streaming Analytics Platforms. The Limitations of Today’s Streaming Analytics. How are we managing the torrent of telemetry that flows into analytics systems from these devices? The list goes on.

IoT 78

IoT Analytics Big Data Architecture 78

High Scalability

JANUARY 11, 2022

Architecture. The streaming data store makes the system extensible to support other use-cases (e.g. System Components. The system will comprise of several micro-services each performing a separate task. Sending and receiving messages from other users. High Level Design. Streaming Data Model. a new like, comment, etc.).

Design 334

Design Media Storage Logistics 334

Dynatrace

MARCH 24, 2023

Containers enable developers to package microservices or applications with the libraries, configuration files, and dependencies needed to run on any infrastructure, regardless of the target system environment. This means organizations are increasingly using Kubernetes not just for running applications, but also as an operating system.

Infrastructure 182

Infrastructure Open Source Operating System Cloud 182

The Netflix TechBlog

MARCH 5, 2019

This operational component places some cognitive load on our engineers, requiring them to develop deep understanding of telemetry and alerting systems, capacity provisioning process, security and reliability best practices, and a vast amount of informal knowledge about the cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Dynatrace

MAY 7, 2019

Traditional monitoring systems cannot keep up with the speed of change in those highly dynamic large-scale container environments. They fail to understand the deployment architecture and dependencies and aren’t able to deal with the ephemeral nature of containers. Universal container-level metrics for resource contention analytics.

Monitoring 201

Monitoring Architecture Metrics Analytics 201

Dynatrace

JANUARY 12, 2022

Messaging systems can significantly improve the reliability, performance, and scalability of the communication processes between applications and services. An example of a critical event-based messaging service for many businesses is adding a product to a shopping cart. Your messaging systems at a glance with the new Queues list.

Analytics 183

Analytics Systems DevOps Healthcare 183

ScaleOut Software

JUNE 29, 2018

Having just concluded participation in another In-Memory Computing Summit , it has become even more clear to me that the key to mainstream adoption of in-memory computing software platforms is architecture — the root of a platform’s value to applications. These priorities tend to push the architecture to the back burner.

Software Architecture 40

Software Architecture Architecture Software Software 40

ScaleOut Software

JUNE 29, 2018

Having just concluded participation in another In-Memory Computing Summit , it has become even more clear to me that the key to mainstream adoption of in-memory computing software platforms is architecture — the root of a platform’s value to applications. These priorities tend to push the architecture to the back burner.

Software Architecture 40

Software Architecture Architecture Software Software 40

Dynatrace

DECEMBER 27, 2022

As more organizations embrace microservices-based architecture to deliver goods and services digitally, maintaining customer satisfaction has become exponentially more challenging. With saturation, we try to measure overall system utilization, which you can obtain from host metrics such as CPU and memory usage. Saturation.

Software 259

Software Software Benchmarking Latency 259

The Netflix TechBlog

JULY 30, 2019

External Payload Storage External payload storage was implemented to prevent the usage of Conductor as a data persistence system and to reduce the pressure on its backend datastore. Workflow Status Listener Conductor can be configured to publish notifications to external systems or queues upon completion/termination of workflows.

Lambda 189

Lambda Media Open Source Metrics 189

Dynatrace

OCTOBER 14, 2022

Achieving this from a typical enterprise’s various apps, systems, and configurations is the beginning of the observability journey and, therefore, critical to get right. All this is easier said than done because: Kubernetes-based dynamic architecture is becoming the norm.

Storage 223

Storage Government Network Infrastructure 223

High Scalability

DECEMBER 18, 2018

Senior DevOps Engineer : Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast. Fun and Informative Events. Advertise your event here!

Healthcare 122

Healthcare Best Practices DevOps Cache 122

Dynatrace

OCTOBER 4, 2022

Organizations need to unify all this observability, business, and security data based on context and generate real-time insights to inform actions taken by automation systems, as well as business, development, operations, and security teams. The next frontier: Data and analytics-centric software intelligence. Event severity.

Analytics 187

Analytics Software Software Storage 187

Dynatrace

SEPTEMBER 17, 2019

Cluster and container Log Analytics. MaaSS for Cloud Architects: Deployment and Architecture Validations. Validate correct architecture, configuration and deployment by looking at Service Flow! In the event that there’s a problem, Dynatrace will automatically highlight the hotspot and root cause in the different Dynatrace views.

AWS 127

AWS Monitoring Ecommerce Lambda 127

Dynatrace

OCTOBER 30, 2023

The growing challenge in modern IT environments is the exponential increase in log telemetry data, driven by the expansion of cloud-native, geographically distributed, container- and microservice-based architectures. By following key log analytics and log management best practices, teams can get more business value from their data.

Best Practices 239

Best Practices Analytics Artificial Intelligence Infrastructure 239

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device.

Analytics 205

Analytics Monitoring Artificial Intelligence DevOps 205

Highly Scalable

AUGUST 20, 2013

In recent years, this idea got a lot of traction and a whole bunch of solutions like Twitter’s Storm, Yahoo’s S4, Cloudera’s Impala, Apache Spark, and Apache Tez appeared and joined the army of Big Data and NoSQL systems. The system should deliver performance of tens of thousands messages per second even on clusters of minimal size.

Big Data 154

Big Data Processing Lambda Database 154

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications in operational environments such as these require. With the real-time digital twin model, the next generation of streaming analytics has arrived.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications in operational environments such as these require. With the real-time digital twin model, the next generation of streaming analytics has arrived.

Logistics 52

Logistics Retail Analytics Azure 52