The Netflix TechBlog

NOVEMBER 15, 2021

Even if results are statistically significant (p-value < 0.05), the estimated metric movements may be so small that they are immaterial to the Netflix member experience, and we are better off investing our innovation efforts in other areas. Similar considerations are relevant when interpreting results. Do results repeat ?

Metrics 204

Metrics Testing Innovation Design 204

Official Blog - World Web Technology

MARCH 16, 2023

You might get random answers for app development costs, but most of us don’t know how the total mobile app development cost is calculated. It can save you from headaches such as recruiting the team, interviewing them, buying licensed tools and software, training, monitoring the progress, etc. It might differ from project to project.

Development 52

Development Mobile Artificial Intelligence Design 52

The Morning Paper

NOVEMBER 21, 2019

Our checks are based on well-known problems that arise in experimental design and causal inference… PlanAlyzer checks PlanOut programs for a variety of threats to internal validity, including failures of randomization, treatment assignment, and causal sufficiency. PlanOut itself has been ported many programming languages at this point.

Programming 52

Programming Internet Internet Design 52

Highly Scalable

MARCH 10, 2015

and the optimal subset of customers can be determined as a subset that maximizes the gross margin: This approach can also be considered the maximization of targeted net value compared to random resource distribution. maximizes the difference i.e. the lift of targeting compared to the random distribution. Since the equation (1.1)

Retail 152

Retail C++ Analytics Metrics 152

Percona

AUGUST 8, 2023

Global caches like the InnoDB buffer pool and MyISAM key cache and session-level caches like the sort buffer, join buffer, random read buffer, etc. But, much like any other software that allows for concurrent session usage, there are mutexes/semaphores in the code that are used to limit the number of sessions that can access shared resources.

Traffic 87

Traffic Cache Monitoring Database 87

O'Reilly

MARCH 23, 2023

Maybe it’s surprising that ChatGPT can write software, maybe it isn’t; we’ve had over a year to get used to GitHub Copilot, which was based on an earlier version of GPT. What Software Are We Talking About? There’s a “temperature” setting in the ChatGPT API that controls how random the response is. It has helped to write a book.

Google 104

Google Open Source Programming Code 104

All Things Distributed

APRIL 27, 2011

To our shareowners: Random forests, naïve Bayesian estimators, RESTful services, gossip protocols, eventual consistency, data sharding, anti-entropy, Byzantine quorum, erasure coding, vector clocks. Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon.

Technology 151

Technology Technology AWS Storage 151

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 53

Latency Engineering Systems Hardware 53

Smashing Magazine

AUGUST 22, 2021

However, if all QUIC connections were to use random CIDs, this would heavily increase memory requirements at the load balancer, because it would need to store mappings of CIDs to back-end servers. Additionally, this would still not work with connection migration, as the CIDs change to new random values.

Performance 105

Performance Network Latency Servers 105

Highly Scalable

MARCH 1, 2012

On the other hand, it turned out that software applications are not so often interested in in-database aggregation and able to control, at least in many cases, integrity and validity themselves. An important feature of a Geohash is its ability to estimate distance between regions using bit-wise code proximity, as is shown in the figure.

Database 279

Database Ecommerce Efficiency Engineering 279

Brendan Gregg

AUGUST 8, 2017

The color is blue for off-CPU stacks (I use warm colors for on-CPU stacks), and the saturation has random variance to differentiate frames. I generated this using my offcputime tool from [bcc] (this tool needs eBPF features from Linux 4.8+), and my [flame graph] software: #./bcc/tools/offcputime.py Yes, I'd say so. They aren't idle.

Latency 111

Latency Metrics C++ Systems 111

The Netflix TechBlog

JANUARY 11, 2022

A Type-M error occurs when, given that we observe a statistically-significant result, the size of the estimated metric movement is magnified (or exaggerated) relative to the truth. A Type-M error means that we are over-estimating the impact of the treatment. Combined, these two effects reduce the risk of Type-S and Type-M errors.

Innovation 243

Innovation Metrics Engineering Testing 243