The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

Dynatrace

MARCH 14, 2022

As patient care continues to evolve, IT teams have accelerated this shift from legacy, on-premises systems to cloud technology to more build, test, and deploy software, and fuel healthcare innovation. This is a critical challenge: When software breaks, finding the root cause of the problem may take time, fuel finger-pointing among teams.

Healthcare 232

Healthcare Artificial Intelligence Innovation Strategy 232

Testsigma

FEBRUARY 12, 2021

The implementation of emerging technologies has helped improve the process of software development, testing, design and deployment. Any organization recruits experienced testing agencies to comply with their specifications for software testing. Here is the list of software testing trends you need to look out for in 2021.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Dynatrace

DECEMBER 15, 2022

ITOps refers to the process of acquiring, designing, deploying, configuring, and maintaining equipment and services that support an organization’s desired business outcomes. Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure.

Artificial Intelligence 208

Artificial Intelligence DevOps Hardware Virtualization 208

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

The Netflix TechBlog

JUNE 1, 2021

Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Samuel Setegne is a Senior Software Engineer on the Core Data Science and Engineering team.

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

High Scalability

APRIL 14, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart.

Education 105

Education Software Engineering Scalability Engineering 105

High Scalability

MAY 12, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart.

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

APRIL 28, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart.

Education 102

Education Software Engineering Scalability Engineering 102

The Morning Paper

OCTOBER 26, 2020

On the surface this is a paper about fast data ingestion from high-volume streams, with indexing to support efficient querying. Helios also serves as a reference architecture for how Microsoft envisions its next generation of distributed big-data processing systems being built. PVLDB’20.

Cloud 104

Cloud Big Data Latency Architecture 104

Dynatrace

OCTOBER 14, 2021

Gartner defines AIOps as the combination of “big data and machine learning to automate IT operations processes, including event correlation, anomaly detection, and causality determination.” But what is AIOps, exactly? And how can it support your organization? What is AIOps? Why is AIOps needed?

Artificial Intelligence 218

Artificial Intelligence DevOps Innovation Metrics 218

High Scalability

MAY 26, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart.

Education 100

Education AWS Software Engineering Scalability 100

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. The Dynatrace Software Intelligence Platform provides all-in-one advanced observability. What sets Dynatrace apart?

Artificial Intelligence 184

Artificial Intelligence Social Media Monitoring IoT 184

High Scalability

MARCH 30, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart.

Education 105

Education Software Engineering Engineering Big Data 105

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

High Scalability

MARCH 24, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data.

Education 105

Education Software Engineering Engineering Big Data 105

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. Jason Lowe-Power (UC Davis) discussed smart memory management and the need for an efficient interface for it.

Latency 52

Latency Hardware Cache Architecture 52

The Netflix TechBlog

MARCH 2, 2021

Later I enrolled in a data science program focused on helping academics transition to industry roles. A passion for making informed decisions based on data. Working on my PhD, I was using optimization techniques to design radiotherapy fractionation schemes to improve the results of clinical practices.

Analytics 207

Analytics C++ Innovation Engineering 207

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. And I’m sure we’ve all experienced frustration when an application crashes, is slow to load, or doesn’t load at all.

Monitoring 132

Monitoring Performance Social Media Artificial Intelligence 132

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Demand Engineering Demand Engineering is responsible for Regional Failovers , Traffic Distribution, Capacity Operations and Fleet Efficiency of the Netflix cloud.

Open Source 279

Open Source Network Infrastructure Big Data 279

Percona

JANUARY 19, 2023

For instance, in Percona Managed Services , we have many clients with TBs worth of data that are well performant. In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. InnoDB will sort the data in primary key order, and that will serve to reference actual data pages on disk.

Open Source 84

Open Source Storage Database Big Data 84

All Things Distributed

DECEMBER 13, 2016

With the launch of the AWS Europe (London) Region, AWS can enable many more UK enterprise, public sector and startup customers to reduce IT costs, address data locality needs, and embark on rapid transformations in critical new areas, such as big data analysis and Internet of Things. Fraud.net is a good example of this.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

All Things Distributed

DECEMBER 20, 2017

The founders had noticed that in many companies, product designers worked in a very detached manner from the rest of production. In this way, designers are part of an ecosystem in which the functionalities of simulations, data and people come together, enabling them to develop better products faster. More than mere support.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Testsigma

MAY 26, 2021

Not only does Testsigma really eases the setup of your data-driven testing, being cloud-based gives you the ability to start with your automation soon after you signup. Opt for quick and efficient data-driven testing with Testsigma. Read about the simplicity of data-driven testing with Testsigma here. Sign up Now.

Testing 70

Testing Healthcare Performance Testing Website 70

Highly Scalable

MARCH 1, 2012

The following figure depicts imaginary “evolution” of the major NoSQL system families, namely, Key-Value stores, BigTable-style databases, Document databases, Full Text Search Engines, and Graph databases: NoSQL Data Models. The main design theme is “ What answers do I have?” ” .

Database 279

Database Ecommerce Efficiency Engineering 279

Testsigma

MAY 7, 2020

IBM Big Data and Analytics Hub website cited a case study, where a US insurance company was estimating 15% of their testing efforts to be just test data collection for the backend system and the frontend system. What is test data? Data subset creation. Data masking is an important step in data subset creation.

Testing 60

Testing Storage Database Processing 60

All Things Distributed

NOVEMBER 15, 2010

These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well.Â

AWS 136

AWS Latency Programming Architecture 136

Highly Scalable

MARCH 10, 2015

This article describes six major optimization problems related to marketing and pricing that can be solved leveraging data mining techniques. Although these problems are very different, we are trying to establish a common framework that helps to design optimization and data mining tasks required for solutions.

Retail 152

Retail C++ Analytics Metrics 152