The Morning Paper

MARCH 15, 2020

In contrast, a process suffering a total failure can be quickly identified, restarted, or repaired by existing mechanisms, thus limiting the failure impact. 71% of failures are triggered by a specific environment condition, input, or faults in other processes. In 13% of cases a module became a zombie with undefined failure semantics.

Systems 98

Systems Software Software Programming 98

J. Paul Reed

AUGUST 7, 2023

In practice (and I’ve done this exercise with teams), this spectrum can provide useful insight. In a technology context, if all the database remediation items are consistently on the right end of the spectrum, that can represent a signal of increasing risk in specific areas, or even dark debt that continues to go unaddressed.

Engineering 52

Engineering Hardware Games Infrastructure 52

SQL Performance

JUNE 10, 2020

This month and the next I’m going to cover the physical processing aspects of derived tables. In my coverage of the physical treatment of named table expressions in the series I focus on the treatment in Microsoft SQL Server and Azure SQL Database. The physical treatment in other database platforms can be quite different.

C++ 109

C++ Database Servers Code 109

SQL Performance

JUNE 10, 2020

This month and the next I’m going to cover the physical processing aspects of derived tables. In my coverage of the physical treatment of named table expressions in the series I focus on the treatment in Microsoft SQL Server and Azure SQL Database. The physical treatment in other database platforms can be quite different.

C++ 93

C++ Database Servers Code 93

The Agile Manager

AUGUST 31, 2020

I've worked with quite a few companies for which long-lived software assets remain critical to day-to-day operations, ranging from 20-year-old ERP systems to custom software products that first processed a transaction way back in the 1960s. Several things stand out about these initiatives.

Architecture 52

Architecture Code Strategy Programming 52

SQL Server According to Bob

JANUARY 26, 2017

Transparent Data Encryption (TDE) is a feature that was introduced in SQL Server 2008 (and is also available for Azure SQL Database, Azure SQL Data Warehouse, and Parallel Data Warehouse) with the purpose of encrypting your data at rest. That is to ensure your database is encrypted at the file level.

Servers 40

Servers Database Azure Cache 40

SQL Server According to Bob

FEBRUARY 10, 2019

This means we are reading database pages from the master, acquiring locks, and making calls to the domain controller (DC/KDC.). The lack of wait_info* events is revealing because if we are waiting for a database read, lock or preemptive, external call for more than 5 seconds an event would have been logged. wait_info*. Network Trace.

Servers 40

Servers Network Database Systems 40

Dynatrace

SEPTEMBER 20, 2019

Here’s what we discussed so far: In Part 1 we explored how DevOps teams can prevent a process crash from taking down services across an organization. In doing so, they automate build processes to speed up delivery, and minimize human involvement to prevent error. Both use the same database back-end and app configuration.

Systems 26

Systems Traffic DevOps Database 26

Percona

DECEMBER 5, 2023

Inspired by David’s insights, I embarked on a journey to explore logical replication from a different perspective – within the realm of on-premises server databases. Also, it is a helpful method for version upgrades since the target database can run on a different (minor or major) PostgreSQL version. to PostgreSQL v15.4.

Database 76

Database Traffic C++ Servers 76

Percona

AUGUST 30, 2023

This can be changed later using the pg_checksums utility, but that will be a painful exercise on a big database. Database level setting All options discussed so far have a global scope. But there could be reasons why a PostgreSQL user wants to change that at a specific database level.

Database 101

Database Servers Open Source Tuning 101

Dynatrace

DECEMBER 10, 2020

During the recent pandemic, organizations that lack processes and systems to scale and adapt to remote workforces and increased online shopping are feeling the pressure even more. Rethinking the process means digital transformation. What are the key requirements to address these challenges?

Strategy 178

Strategy Performance Logistics Monitoring 178

CSS Wizardry

NOVEMBER 3, 2020

I can see from the screenshot above that TTFB is my most stable metrics—no one page appears to have particularly expensive database queries or API calls on the back-end. The whole point of the exercise that follows is to allow me to move quickly, spotting patterns from afar, and not having to do any slow or meticulous work yet.

Speed 292

Speed Ecommerce Metrics Analytics 292

Percona

AUGUST 8, 2023

Hardware considerations The first thing we have to consider here is the resources that the underlying host provides to the database. Global memory caches are static in size as they are defined solely by the configuration of the database itself. Let’s take a look at each common resource.

Traffic 88

Traffic Cache Monitoring Database 88

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Particular Software

SEPTEMBER 11, 2023

Technically, this is all done over MSMQ where requests are processed and eventually granted or rejected, notifying other services of the outcome. Instead, a more gradual process can be used, moving one endpoint at a time from MSMQ to the cloud, with the bridge transparently taking care of the routing.

Cloud 126

Cloud Systems Azure Airlines 126

Dynatrace

MAY 28, 2020

While Google’s SRE Handbook mostly focuses on the production use case for SLIs/SLOs, Keptn is “Shifting-Left” this approach and using SLIs/SLOs to enforce Quality Gates as part of your progressive delivery process. This will enable deep monitoring of those Java,NET, Node, processes as well as your web servers.

Engineering 192

Engineering Performance Metrics Best Practices 192

The Agile Manager

FEBRUARY 28, 2017

For example, ghost code - code that is not commented out but will conditionally never be executed - is likely to be confused for real code in a reverse-engineering exercise. A clone of something extinct - our lost business knowledge - runs the risk of suffering severe defects. The facts are fantastic to have, but facts are not knowledge.

Strategy 40

Strategy Java Code Systems 40

Dynatrace

APRIL 21, 2022

Figure 1 – Individual Host pages show performance metrics, problem history, event history, and related processes for each host. Right-sizing is an iterative process where you adjust the size of your resource to optimize for cost. To do that, organizations must evolve their DevOps and IT Service Management (ITSM) processes.

Azure 188

Azure Monitoring Virtualization Metrics 188

O'Reilly

JANUARY 17, 2023

You might say that the outcome of this exercise is a performant predictive model. Second, this exercise in model-building was … rather tedious? You need to coordinate with stakeholders and product managers to suss out what kinds of models you need and how to embed them into the company’s processes.

Tuning 130

Tuning Open Source AWS Software 130

O'Reilly

OCTOBER 19, 2021

While there isn’t an authoritative definition for the term, it shares its ethos with its predecessor, the DevOps movement in software engineering: by adopting well-defined processes, modern tooling, and automated workflows, we can streamline the process of moving from development to robust production deployments.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

All Things Distributed

OCTOBER 2, 2017

Today marks the 10 year anniversary of Amazon's Dynamo whitepaper , a milestone that made me reflect on how much innovation has occurred in the area of databases over the last decade and a good reminder on why taking a customer obsessed approach to solving hard problems can have lasting impact beyond your original expectations.

Internet 128

Internet Internet AWS Performance 128

HammerDB

JULY 16, 2021

One of the most important concepts in analysing database performance is that of understanding scalability. Plotting these data points enables us to understand the scalability of the database software being tested on that system. In particular, this means as we add CPU cores and increase the system load, we see higher performance.

Virtualization 57

Virtualization Performance C++ Database 57

Dynatrace

JUNE 1, 2021

However, with today’s highly connected digital world, monitoring use cases expand to the services, processes, hosts, logs, networks, and of course, end-users that access these applications — including a company’s customers and employees. Mobile apps, websites, and business applications are typical use cases for monitoring.

Monitoring 148

Monitoring Mobile Social Media Artificial Intelligence 148

SQL Performance

NOVEMBER 30, 2021

For each database that has pages in the buffer pool, there is a hash list of pages, in page ID order, that’s quickly searchable to determine whether a page is already in memory or whether a physical read has to be performed. And the more pages in memory for a database, the longer the scan would take. The table has 1 million rows.

Efficiency 54

Efficiency Servers Database Cache 54

Percona

JULY 6, 2023

Performance is one of the essential aspects of a database management system. One way to verify a column’s number of distinct values is by querying the pg_stats view in our database. One of the most effective ways to tackle performance improvement is having the proper indexes for the table columns. Next is the table definition.

Best Practices 89

Best Practices Tuning Database Testing 89

The Morning Paper

AUGUST 27, 2019

I am so pleased to see a database systems paper addressing the concerns of the application developer! A example class of application invariants is database integrity constraints. See Coordination avoidance in database systems for more details. ” Automating more of this process is future work. VLDB’19.

Programming 59

Programming Processing Database Systems 59

Adrian Cockcroft

NOVEMBER 11, 2019

There are many possible failure modes, and each exercises a different aspect of resilience. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. A resilient system continues to operate successfully in the presence of failures.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

There are many possible failure modes, and each exercises a different aspect of resilience. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. A resilient system continues to operate successfully in the presence of failures.

Latency 53

Latency Engineering Systems Hardware 53

All Things Distributed

NOVEMBER 21, 2017

Amazon ElastiCache embodies much of what makes fast data a reality for customers looking to process high volume data at incredible rates, faster than traditional databases can manage. Developers love the performance, simplicity, and in-memory capabilities of Redis, making it among the most popular NoSQL key-value stores.

Games 112

Games Retail Latency Education 112

The Morning Paper

NOVEMBER 14, 2019

The deployment of connection-aware routing reduced query-load on backend databases by 17%, compared to a baseline implementation using Social Hash alone. Backend processing latency stays fairly constant during this operation. We looked at this before when we studied Facebook’s Social Hashing algorithm.

Traffic 42

Traffic Internet Internet Latency 42

All Things Distributed

NOVEMBER 15, 2010

From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. Because of its focus on latency, the generic CPU yielded rather inefficient system for graphics processing.

AWS 136

AWS Latency Programming Architecture 136

O'Reilly Software

MARCH 7, 2018

In addition to that, software is increasingly dependent on other software to provide its functionality, be it WebServices, HTTP APIs, databases, or even external devices such as sensors. Sadly, it is very common to write logic that deeply couples the notion of IO with the processing of that IO.

Transportation 72

Transportation Java Programming Architecture 72

The Netflix TechBlog

MARCH 6, 2019

—?Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Encoding is not a one-time process?—?large We have one file?—?the

Media 214

Media Storage Processing Cache 214

Strategic Tech

DECEMBER 12, 2019

In the real world we can be vague about our business rules and processes. Defining Aggregate Boundaries Deciding that specific business operations should succeed or fail together sounds like a simple requirements gathering exercise. They choose this because it is smaller and should be faster to load and save in the database.

Healthcare 10

Healthcare Software Architecture Database Software 10