The Netflix TechBlog

DECEMBER 3, 2019

We heard many stories about difficulties related to data access and basic data processing. A key observation was that most of our data scientists had nothing against writing Python code. Data scientists want to retain their freedom to use arbitrary, idiomatic Python code to express their business logic?—?like

Open Source 232

Open Source AWS Infrastructure Energy 232

CSS Wizardry

NOVEMBER 3, 2020

The whole point of the exercise that follows is to allow me to move quickly, spotting patterns from afar, and not having to do any slow or meticulous work yet. I want to be able to form hypotheses and draw conclusions without viewing a single URL or a line of source code. That work is what comes next. Final Word.

Speed 292

Speed Ecommerce Metrics Analytics 292

Dynatrace

DECEMBER 10, 2020

During the recent pandemic, organizations that lack processes and systems to scale and adapt to remote workforces and increased online shopping are feeling the pressure even more. Rethinking the process means digital transformation. What are the key requirements to address these challenges?

Strategy 182

Strategy Performance Logistics Monitoring 182

Particular Software

SEPTEMBER 11, 2023

Now go rewrite all your code… we’ll wait…are you done yet? Technically, this is all done over MSMQ where requests are processed and eventually granted or rejected, notifying other services of the outcome. It’s as if they’re saying, “Have you documented your system? Have you chosen a cloud provider? What are you looking at me for?

Cloud 126

Cloud Systems Azure Airlines 126

The Netflix TechBlog

DECEMBER 3, 2019

We heard many stories about difficulties related to data access and basic data processing. A key observation was that most of our data scientists had nothing against writing Python code. Data scientists want to retain their freedom to use arbitrary, idiomatic Python code to express their business logic?—?like

Open Source 134

Open Source AWS Infrastructure Energy 134

Dynatrace

MAY 15, 2020

How to assess an environment’s security posture, risk and threat profile, and possible attack vectors, where perhaps you didn’t code the application or build the infrastructure, and where new code is deployed frequently, and the infrastructure is constantly changing? Challenge: Monitoring processes for anomalous behavior.

Government 231

Government DevOps Infrastructure Network 231

The Netflix TechBlog

OCTOBER 21, 2019

Where other systems may take over ten minutes to process metrics accurately, Mantis reduces that from tens of minutes down to seconds, effectively reducing our Mean-Time-To-Detect. Instead, we should process and serve events one at a time as they arrive. Operational use cases are inherently time sensitive by nature.

Open Source 148

Open Source Metrics Engineering Processing 148

Dynatrace

APRIL 21, 2022

Figure 1 – Individual Host pages show performance metrics, problem history, event history, and related processes for each host. Right-sizing is an iterative process where you adjust the size of your resource to optimize for cost. To do that, organizations must evolve their DevOps and IT Service Management (ITSM) processes.

Azure 193

Azure Monitoring Virtualization Metrics 193

The Netflix TechBlog

SEPTEMBER 8, 2020

On the Android team, while most of our time is spent working on the app, we are also responsible for maintaining this backend that our app communicates with, and its orchestration code. Image taken from a previously published blog post As you can see, our code was just a part (#2 in the diagram) of this monolithic service.

Latency 233

Latency Cache Java Traffic 233

O'Reilly

OCTOBER 24, 2023

We already see hints of that on GitHub: in February 2023, GitHub said that 46% of all the code checked in was written by Copilot. At some point in the near future, new models will be trained on code that they have written. If we train a new AI on its output, and repeat the process, what is the result? 9 or almost anything else.

Programming 89

Programming Processing Code Artificial Intelligence 89

The Netflix TechBlog

DECEMBER 23, 2020

For example, the PID namespace makes it so that a process can only see PIDs in its own namespace, and therefore cannot send kill signals to random processes on the host. There are also more common capabilities that are granted to users like CAP_NET_RAW, which allows a process the ability to open raw sockets. User Namespaces.

Media 286

Media Metrics Systems Processing 286

Percona

OCTOBER 31, 2023

The process of gathering data will take some time, but we plan to periodically share statistics that we collect, like breakdowns of versions of database software being used or popular operating systems and architectures. The upcoming documentation release will explain this process in more detail.

Open Source 86

Open Source Database Operating System Programming 86

Strategic Tech

JUNE 21, 2020

Not only the puzzle, but in the centre of the board, we also had a visualisation of the process we were following during the workshop. When we were designing the workshop, I said to Gien that I like the idea of a puzzle, and it would be great to have it large and always visible, but how can we do that when there are a number of exercises?

Design 98

Design Logistics Transportation Architecture 98

The Netflix TechBlog

OCTOBER 21, 2019

Where other systems may take over ten minutes to process metrics accurately, Mantis reduces that from tens of minutes down to seconds, effectively reducing our Mean-Time-To-Detect. Instead, we should process and serve events one at a time as they arrive. Operational use cases are inherently time sensitive by nature.

Open Source 101

Open Source Metrics Engineering Processing 101

The Netflix TechBlog

OCTOBER 21, 2019

Where other systems may take over ten minutes to process metrics accurately, Mantis reduces that from tens of minutes down to seconds, effectively reducing our Mean-Time-To-Detect. Instead, we should process and serve events one at a time as they arrive. Operational use cases are inherently time sensitive by nature.

Open Source 100

Open Source Metrics Engineering Processing 100

Particular Software

MARCH 28, 2022

With a saga, a business process that would otherwise have been implemented as a clunky batch job 1 can be built in a much more elegant and real-time manner. You can create a class that is a lousy saga but is still perfectly valid C# code. Others will save you time by doing some of the coding for you. In NServiceBus version 7.7,

Development 52

Development C++ Virtualization Metrics 52

Percona

DECEMBER 29, 2022

The process using pg_upgrade is well documented , and you can easily find the instructions with little googling. In this blog post, I will show you a particular example I faced when working with an upgrade exercise using pg_upgrade. .” ” Let’s review the case. Example case. ii postgresql-11 11.18-1.pgdg20.04+1

C++ 81

C++ Open Source Database Programming 81

Smashing Magazine

OCTOBER 16, 2021

After working on a coding project for a good couple of hours, many developers like myself tend to hit a wall. For the most part, coding can be quite intimidating and disappointing for a beginner or even a well-versed developer. Thinking, Remembering And Processing Information Better. Dave Oscar. 2021-10-16T10:00:00+00:00.

Programming 102

Programming Energy Code Processing 102

Percona

AUGUST 30, 2023

If a PostgreSQL user wants to change these values, they need to recompile the PostgreSQL from the source code. This can be changed later using the pg_checksums utility, but that will be a painful exercise on a big database. Changing these values at compile time is not intended for common use.

Database 99

Database Servers Open Source Tuning 99

The Morning Paper

MARCH 15, 2020

In contrast, a process suffering a total failure can be quickly identified, restarted, or repaired by existing mechanisms, thus limiting the failure impact. 71% of failures are triggered by a specific environment condition, input, or faults in other processes. In 13% of cases a module became a zombie with undefined failure semantics.

Systems 98

Systems Software Software Programming 98

SQL Performance

APRIL 14, 2021

Evaluating earlier solutions, one of the important factors in getting good performance was the ability to employ batch processing. Let’s examine the plans for two of the earlier solutions that utilized batch processing. But have we exploited it to the maximum extent possible? NullBits102400 ; GO.

C++ 112

C++ Servers Testing Code 112

O'Reilly

JUNE 13, 2023

After fixing some obvious errors, I ran the program–and while it told me (correctly) that my number was non-prime, when compared to a known good implementation of Miller-Rabin, ChatGPT’s code made many mistakes. It didn’t generate any code, but provided a link to the Wolfram Alpha result page that described how to test for primality.

Google 83

Google Programming Database Testing 83

Testsigma

JANUARY 6, 2022

Tracking the processes to plan better. During a testing process, you need to track and plan the testing activities such as: Test planning Test scripts writing Test data creation and management Test versioning, review, and approvals Test case scheduling Test reporting. helps in having a clear picture of the testing process.

Testing 52

Testing Internet Internet Testing Tools 52

The Netflix TechBlog

MAY 27, 2020

From failure injection testing to regularly exercising our region evacuation abilities, Netflix engineers invest a lot in ensuring the services that comprise Netflix are robust and reliable. This process includes a write-up of what happened, what mitigations took place, and what follow-up work was discussed.

Engineering 104

Engineering Innovation Systems Architecture 104

ScaleOut Software

AUGUST 20, 2020

Simplifying the Development Process with Mock Environments. The key to meeting these challenges is to process incoming telemetry in the context of unique state information maintained for each individual data source. In contrast, real-time digital twins analyze incoming telemetry from each data source and track changes in its state.

Cloud 52

Cloud Development Analytics Azure 52

ScaleOut Software

AUGUST 20, 2020

Simplifying the Development Process with Mock Environments. The key to meeting these challenges is to process incoming telemetry in the context of unique state information maintained for each individual data source. In contrast, real-time digital twins analyze incoming telemetry from each data source and track changes in its state.

Cloud 52

Cloud Development Analytics Azure 52

SQL Performance

JANUARY 12, 2022

Despite the poor performance, working on the solution is an interesting exercise. Use the following code to create the table and populate it with a small set of sample data: DROP TABLE IF EXISTS dbo. ( ID INT NOT NULL IDENTITY ( 1 , 1 ) CONSTRAINT pk_Auctions PRIMARY KEY CLUSTERED , Code CHAR ( 1 ) NOT NULL.

Code 116

Code Servers Performance Azure 116

Percona

AUGUST 8, 2023

Does your traffic increase come with updated code changes that change the queries? In fact, the most common cause of massive CPU increase that I’ve seen isn’t traffic increase; it’s code changes that introduced inefficient revisions to existing queries or new queries. Do these queries use more caches?

Traffic 87

Traffic Cache Monitoring Database 87

Tasktop

OCTOBER 23, 2020

The code base has an open review process that every engineer can learn from with each change. We enjoy social hours such as team lunches, team exercises and happy hours. Would exercise and health be a good topic? We aim to continually learn, evolve and be better versions of ourselves.

Tuning 52

Tuning Engineering Programming Infrastructure 52

The Agile Manager

OCTOBER 31, 2020

Some years ago, I was working with a company automating its customer contract renewal process. It had licensed a workflow technology and contracted a large number of people to code and configure a custom solution around it. When that happens, the exercise tends to yield no better than "less bad."

Programming 59

Programming Testing Code Technology 59

The Agile Manager

AUGUST 31, 2021

If we accept the fact that Agile is a value system and not a set of mechanical processes, it stands to reason that there must be something different about the norms and behaviors of Agile managers vis-a-vis traditional managers. Create and adapt the mechanical processes and social systems through which the team gets things done.

Metrics 52

Metrics Design Engineering C++ 52

J. Paul Reed

AUGUST 7, 2023

(It’s worth noting: the right end of the spectrum also covers the more… “exotic” action items, like “This was caused by a Windows-issue, so let’s migrate our entire self-run physical infrastructure to Linux and rewrite the entire code base.” In practice (and I’ve done this exercise with teams), this spectrum can provide useful insight.

Engineering 52

Engineering Hardware Games Infrastructure 52

O'Reilly

JUNE 27, 2023

When a person clicked “submit,” the website would pass that form data through some backend code to process it—thereby sending an e-mail, creating an order, or storing a record in a database. That code was too trusting, though. Those 1990s web forms demonstrate the problem all too well. That’s because it is.

Social Media 89

Social Media Media Website Database 89

The Agile Manager

JANUARY 31, 2017

They were in consultants in logistics, and they were lamenting how one of their clients was struggling in the wake of a business process change that another firm - a tech consultancy - had agitated for their mutual client to adopt. Early on, business technology was mostly large-scale labor-saving data processing.

Retail 45

Retail Energy Logistics Efficiency 45

Dynatrace

JUNE 1, 2021

However, with today’s highly connected digital world, monitoring use cases expand to the services, processes, hosts, logs, networks, and of course, end-users that access these applications — including a company’s customers and employees. Mobile apps, websites, and business applications are typical use cases for monitoring.

Monitoring 148

Monitoring Mobile Social Media Artificial Intelligence 148

SQL Performance

NOVEMBER 30, 2021

Code would have to scan the entire list of buffers for the database, looking for buffers that map pages for the allocation unit in question. If you’re interested, I wrote a post a while back with some T-SQL code that scans the buffer pool and gives some metrics, using the DMV sys.dm_os_buffer_descriptors. ) ; GO.

Efficiency 54

Efficiency Servers Database Cache 54

The Morning Paper

JANUARY 23, 2020

A technique called process tracing was employed to try and recover "a record of participant data acquisition, situation assessment, knowledge activation, expectations, intentions, and actions as the case unfolds over time." The process tracing exercise included: Examning IRC transcripts from multiple channels.

Internet 53

Internet Internet Cache Engineering 53