The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

SQL Shack

JULY 10, 2019

By removing disk-based storage and the challenge of copying data in and out of memory, query speeds in SQL Server can be improved by orders of magnitude. Introduction In-memory technologies are one of the greatest ways to improve performance and combat contention in computing today.

Servers 79

Servers Latency Storage Speed 79

O'Reilly

NOVEMBER 12, 2019

Serverless presents a conceptually simpler path to deploying software for those in development roles with no need to manage servers and storage. The results in Figure 12 reflect what we know of the cloud market and mirror what we found in our cloud native survey from earlier in 2019.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

Scalegrid

JULY 17, 2020

Wave 3: PostgreSQL 12 (2019) added support for SQL/JSON standard and JSONPATH queries. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint. JSONB storage does not deduplicate the key names in the JSON.

Storage 321

Storage Database Efficiency Processing 321

Brendan Gregg

APRIL 14, 2022

eBPF tools (2014-2019). A large and unexpected opportunity has come my way outside of Netflix that I've decided to try. Netflix has been the best job of my career so far, and I'll miss my colleagues and the culture. offer letter logo (2014). flame graphs (2014). PMC analysis (2017). my pandemic-abandoned desk (2020); office wall.

Java 145

Java Cloud Cache AWS 145

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

Database 177

Database Cloud Open Source Systems 177

Dynatrace

MAY 26, 2021

Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. When Dynatrace set out on contributing to OpenTelemetry in 2019, it was our hope that cloud vendors will take the opportunity to standardize the way how they collect and – more importantly – emit telemetry data.

AWS 208

AWS Strategy Storage Metrics 208

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In 2019, Netflix moved thousands of container hosts to bare metal.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

DECEMBER 5, 2019

During AWS re:Invent 2019, we announced a number of High Performance Computing (HPC) innovations including the Amazon EC2 M6g, C6g, and R6g instances powered by next-generation Arm-based AWS Graviton2 Processors. We also recently announced that new AMD-powered, compute-optimized EC2 instances are in the works.

AWS 80

AWS Storage Innovation Network 80

The Morning Paper

SEPTEMBER 19, 2019

We’ve been covering papers from VLDB 2019 for the last three weeks, and next week it will be time to mix things up again. I really do want to cover this one at some point, along with Implementation of cluster-wide logical clock and causal consistency in MongoDB from SIGMOD 2019. Autoscaling tiered cloud storage in Anna.

Blockchain 46

Blockchain Hardware Google Analytics 46

Scalegrid

JULY 13, 2020

Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. pg_repack – reorganizes tables online to reclaim storage. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

Smashing Magazine

JANUARY 7, 2019

Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. 2019-01-07T12:00:13+00:00. 2019-04-29T18:34:58+00:00. To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%.

Performance 103

Performance Cache Metrics Network 103

Dynatrace

MAY 26, 2021

Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. When Dynatrace set out on contributing to OpenTelemetry in 2019, it was our hope that cloud vendors will take the opportunity to standardize the way how they collect and – more importantly – emit telemetry data.

AWS 147

AWS Strategy Storage Metrics 147

Scalegrid

OCTOBER 7, 2019

PostgreSQL VACUUM is a technique to remove tuples that have been deleted or are now obsolete from their table to reclaim storage occupied by those dead tuples, also known as Bloat. of PostgreSQL deployments were strictly on-premises back in April from our 2019 PostgreSQL Trends Report and 55.8% #Java #Python #C Click To Tweet.

Strategy 182

Strategy Cloud Java Open Source 182

The Netflix TechBlog

OCTOBER 15, 2019

Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. To improve the recovery time for this scenario, we started using block storage volumes (Amazon Elastic Block Store) instead of local disks on the brokers. Queue 17, 1, pages 40 (February 2019), 21 pages.

Transportation 192

Transportation Architecture Processing Storage 192

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

AUGUST 8, 2019

This short blog post is a follow up to the announcement we made on May 6, 2019: OneAgent for Windows—Enhancements to *.msi-based Smaller network and Dynatrace cluster storage footprint. Dynatrace news. msi-based deployment. One of our design principles is to make sure that Dynatrace is as easy to set up and use as possible.

Efficiency 117

Efficiency Network Storage Architecture 117

SQL Performance

MARCH 17, 2020

This follow-up post revisits the question for SQL Server 2019, using a larger number of rows. It has 32GB RAM, with 24GB available to the SQL Server 2019 instance. Not everyone will be able to move to column store storage quickly, and it won't always be the right solution anyway. Test Environment. Batch Mode on Row Store (BMOR).

Servers 86

Servers Tuning Database Efficiency 86

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Percona Community

MAY 4, 2020

has been out for some time now (June 2019) and it has many new features, some of which MySQL does not have. system tables in the Aria storage engine, ability to reload SSL certificates without a restart and more! (Wed) Level: Intermediate Abstract MariaDB Server 10.4 Feature-wise, it is important to know what MariaDB Server 10.4

Servers 52

Servers Storage Engineering Systems 52

Testsigma

FEBRUARY 12, 2021

Are you aware that the scale of the app testing industry in 2019 was over USD$ 40 billion? In 2019, we had previously projected the demand for IoT research at $781.96billion. 38% of organisations were expected to introduce machine-learning initiatives in 2019, according to the Capgemini World Efficiency survey. billion in 2016.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Percona

JULY 15, 2023

Let’s test the following equivalent query: mysql> SELECT AVG(price) FROM products WHERE create_time BETWEEN '2019-10-01' AND '2019-11-01'; + + | AVG(price) | + + | 202.982582 | + + mysql> EXPLAIN SELECT AVG(price) FROM products WHERE create_time BETWEEN '2019-10-01' AND '2019-11-01'G 1.

Virtualization 80

Virtualization Speed Database Efficiency 80

CSS Wizardry

MARCH 3, 2019

— Harry Roberts (@csswizardry) 3 March, 2019. Tip: There are a number of directives that Clear-Site-Data will accept: "cookies" , "storage" , "executionContexts" , and "*" (which, naturally, means ‘all of the above’). a CDN), to always serve the freshest possible copy, and not to persist anything to storage.

Cache 264

Cache Latency Strategy Servers 264

Percona Community

MAY 14, 2019

During our presentation at Percona Live 2019 Intel and its software partners will introduce the audience to the work we’re doing to enable an open-source framework, we call Cloud Native Database. We will discuss Rockset’s RocksDB-Cloud library and how it works with Facebook’s MyRocks storage engine.

Open Source 52

Open Source Database Cloud Storage 52

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. PostgreSQL has powerful and advanced features, including asynchronous replication, full-text searches of the database, and native support for JSON-style storage, key-value storage, and XML.

Open Source 80

Open Source Healthcare Social Media Database 80

Dynatrace

NOVEMBER 17, 2020

With these release candidate APIs available, instrumentation for web frameworks, storage clients, and much more can be built. I worked on providing code-level insights for Java and.NET services and applications before shifting gears and joining the OpenTelemetry community back in May 2019. Dynatrace fully embraces OpenTelemetry.

Open Source 151

Open Source Software Engineering Government Java 151

Percona

JULY 3, 2023

CREATE TABLE employees (id INT NOt NULL , fname VARCHAR(20) , lname VARCHAR (20) , dob DATE NOT NULL , joined DATE NOT NULL) PARTITION BY RANGE (joined); CREATE TABLE employees_q1 PARTITION of employees for VALUES FROM ('2022-01-01') to ('2022-04-01'); CREATE TABLE employees_q2 PARTITION of employees for VALUES FROM ('2022-04-01') to ('2022-07-01'); (..)

Storage 84

Storage Database Performance Open Source 84

ACM Sigarch

NOVEMBER 4, 2019

The best paper runner-up was “ Dynamic Multi-Resolution Data Storage ”. . Editor’s note: Sophia was one of the recipients of the Best Paper Award at MICRO 2019. Two Test of Time awards went to: “Speculative Lock Elision: Enabling Highly Concurrent Multithreaded Execution” published at MICRO 2001 by Ravi Rajwar and James R.

Hardware 18

Hardware Architecture Programming Innovation 18

Dynatrace

OCTOBER 15, 2021

The data is incredibly plentiful and difficult to store over long periods due to capacity limitations — a reason why private and public cloud storage services have been a boon to DevOps teams. This information is gathered from remote, often inaccessible points within your ecosystem and processed by some sort of tool or equipment.

Open Source 216

Open Source Metrics Cloud Transportation 216

Percona

SEPTEMBER 1, 2023

This blog was originally published in February 2019 and was updated in September 2023. Character encoding refers to the method used to represent characters as binary data for storage and transmission. This difference in storage size can lead to variations in the size of index entries, which can impact efficiency.

Performance 52

Performance Storage Social Media Database 52

Smashing Magazine

OCTOBER 22, 2019

2019-10-22T12:30:59+02:00. 2019-10-22T13:06:35+00:00. According to HTTP Archive : The median size of a desktop website in 2019 is 1939.5 The median size of a mobile website in 2019 is 1745.0 Instead, you can integrate your existing image server (on your web host) or external storage service (like S3) with ImageKit.

Mobile 62

Mobile Media Website Storage 62

Percona

MARCH 30, 2023

Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. Non-relational databases: Instead of tables, non-relational (NoSQL) databases use document-based data storage, column-oriented storage, and graph databases.

Open Source 78

Open Source Database Storage Scalability 78

SQL Performance

APRIL 27, 2020

The basic tier provides up to 5 DTUs with standard storage. The standard tier supports from 10 up to 3000 DTUs with standard storage and the premium tier supports 125 up to 4000 DTUs with premium storage, which is orders of magnitude faster than standard storage. vCore Pricing Tier. GB per vCore. HyperScale Database.

Azure 55

Azure Database Serverless Hardware 55

The Morning Paper

NOVEMBER 8, 2020

replacing Paxos with Raft), or they could be shims over external storage systems. A minimal Loglet needs to provide totally ordered, durable storage via the shared log API. For example, Loglets might be instances of the same ordering protocol, but with different parameters, or they could be entirely different log implementations (e.g.

Virtualization 126

Virtualization Latency Storage Systems 126

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Percona

DECEMBER 20, 2018

We look forward to providing you with even better articles, news and information in 2019. As 2018 moves into 2019, let’s take a quick look back at some of the most popular posts on the blog this year. Fsync Performance on Storage Devices. We’ve had nearly 4 million visits to the blog in 2018: thank you! Interested?

Database 40

Database Tuning Performance AWS 40

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. A large and unexpected opportunity has come my way outside of Netflix that I've decided to try.

Java 52

Java Cache Cloud AWS 52