SQL Performance

NOVEMBER 30, 2021

Whether the page is dirty or not (a dirty page has changes on it that haven’t yet been written back to durable storage). Index_A has 200,000 pages at its leaf level, and Index_B has 1 million pages at its leaf level, so a complete scan of Index_B requires processing five times more pages. The table has 1 million rows. ) ; GO.

Efficiency 54

Efficiency Servers Database Cache 54

The Morning Paper

DECEMBER 8, 2019

The eagle-eyed reader will have noticed another feature of this work in that quotation: the aim is to create a global address space that spans nodes and processes. This is left as an exercise for the application developer at present. Crash-consistency by the way is treated as an orthogonal concern and not discussed in this paper.

Hardware 56

Hardware Programming Media Storage 56

SQL Performance

OCTOBER 20, 2022

The engine processes the row through parent operators before releasing the shared lock prior to locking and reading the next row. When the engine chooses page-level locking granularity, it takes and holds a shared page lock while processing rows on the current page and then releases the lock right before acquiring a lock on the next page.

Testing 91

Testing Servers Cache Engineering 91

Adrian Cockcroft

NOVEMBER 11, 2019

There are many possible failure modes, and each exercises a different aspect of resilience. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. A resilient system continues to operate successfully in the presence of failures.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

There are many possible failure modes, and each exercises a different aspect of resilience. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. A resilient system continues to operate successfully in the presence of failures.

Latency 53

Latency Engineering Systems Hardware 53

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Morning Paper

APRIL 16, 2019

During the ten week course, students implement four different assignments: an exactly-once RPC protocol; a primary-backup system; Paxos; and a scalable, transactional key-value storage system. Consider the lab exercise to implement Paxos. 175 undergraduates a year currently go through this course. So DSLabs also uses model checking.

Systems 43

Systems Efficiency Testing Strategy 43

Alex Russell

AUGUST 30, 2021

Large projects like browser engines also exercise governance through a hierarchy of "OWNER bits," which explicitly name engineers empowered to permit changes in a section of the codebase. This process can be messy and slow, but it never creates a political blockage for developing new capabilities for the web.

Engineering 98

Engineering Open Source Website Operating System 98

SQL Performance

JUNE 10, 2020

This month and the next I’m going to cover the physical processing aspects of derived tables. That is, does SQL Server perform a substitution process whereby it converts the original nested code into one query that goes directly against the base tables? And if so, is there a way to instruct SQL Server to avoid this unnesting process?

C++ 109

C++ Database Servers Code 109

SQL Performance

JUNE 10, 2020

This month and the next I’m going to cover the physical processing aspects of derived tables. That is, does SQL Server perform a substitution process whereby it converts the original nested code into one query that goes directly against the base tables? And if so, is there a way to instruct SQL Server to avoid this unnesting process?

C++ 93

C++ Database Servers Code 93

The Netflix TechBlog

DECEMBER 3, 2019

We heard many stories about difficulties related to data access and basic data processing. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. both for compute and storage.

Open Source 232

Open Source AWS Infrastructure Energy 232

Alex Russell

SEPTEMBER 20, 2020

The world didn't yet have pervasive multi-process browser sandboxing, JS JITs , or metal-speed binary isolation. Strong browser sandboxing was only then becoming A Thing (TM), and resource limits delayed mobile browsers from providing multi-process protection. Circa '07, those web apps were notably slower than native code could be.

Hardware 64

Hardware Mobile Programming Java 64

The Netflix TechBlog

DECEMBER 3, 2019

We heard many stories about difficulties related to data access and basic data processing. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. both for compute and storage.

Open Source 134

Open Source AWS Infrastructure Energy 134

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Encoding is not a one-time process?—?large We have one file?—?the

Media 214

Media Storage Processing Cache 214

All Things Distributed

OCTOBER 2, 2017

Adaptive Capacity –DynamoDB intelligently adapts to your table's unique storage needs, by scaling your table storage up by horizontally partitioning them across many servers, or down with Time To Live (TTL) that deletes items that you marked to expire. Auto Scaling is on by default for all new tables and indexes.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

NOVEMBER 15, 2010

From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. Because of its focus on latency, the generic CPU yielded rather inefficient system for graphics processing.

AWS 136

AWS Latency Programming Architecture 136