Dynatrace

AUGUST 21, 2023

Like the tree in the forest, the microservice falling definitely made a sound. Challenges of adopting OpenTelemetry The first challenge is that OpenTelemetry only gathers and processes data—it has no back end, no storage, and no analytics. Or what its falling could mean for all the other services that interact with it.

Open Source 200

Open Source Analytics Lambda Metrics 200

Dynatrace

DECEMBER 18, 2023

But often, we use additional services and solutions within our environment for backups, storage, networking, and more. Kubernetes-based efficient power level exporter (Kepler) is a Prometheus exporter that uses ML models to estimate the energy consumption of Kubernetes pods.

Metrics 182

Metrics Engineering Energy Tuning 182

Percona

SEPTEMBER 27, 2023

DEFAULT ‘on’::text Because we specified ‘2’ for premake in the create_parent function, you can observe that two partitions ahead have been created, as shown in the table definition below. schema.tablename p_control text You should partition the column, either integer or time-based.

Storage 101

Storage Open Source Database Efficiency 101

Percona

JUNE 30, 2023

Users now have full control over Custom Resource Definitions that Operator relies on, which simplifies the deployment and management of the operator. It simplifies the development and brings more contribution friendliness to the code, resulting in better potential for growing the community. In version 1.x, In version 1.x,

Availability 95

Availability Open Source Azure Hardware 95

Percona

JULY 25, 2023

So, given a table_id, how do you get the table schema/definition? After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. 28, xtrabackup –prepare is faster and memory efficient with the dictionary cache.

Cache 86

Cache Benchmarking Servers Design 86

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

DECEMBER 15, 2022

In this blog, we share three log ingestion strategies from the field that demonstrate how building up efficient log collection can be environment-agnostic by using our generic log ingestion application programming interface (API). In the “Storage and Logging” section, select “ awsfirelens ” as the log driver.

Strategy 184

Strategy AWS Open Source Transportation 184

ACM Sigarch

AUGUST 3, 2023

Throughout, we adopt the Greenhouse Gas Protocol scope definition as used in Prof. Several recent studies have noted that trends like dark silicon have exacerbated the disparity between embodied carbon and operational carbon because energy-efficiency optimization has traded gains in the latter for increases in the former.

Energy 98

Energy Architecture Hardware Metrics 98

The Morning Paper

NOVEMBER 30, 2020

use this perspective to create new definitions of isolation levels. And yet, until Crooks all the definitions, including Adya’s , have been based on implementation concerns! But it’s even easier with a state-based definition of snapshot isolation (SI). This matches the intuitive definition of snapshot isolation most people have.

Database 61

Database Storage Systems Strategy 61

Percona

JANUARY 19, 2023

In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. Redundant indexes: It is known that accessing rows by fetching an index is more efficient than through a table scan in most cases. It can help us to save costs on storage and backup times.

Open Source 89

Open Source Storage Database Big Data 89

Percona

JULY 3, 2023

Hash keys are used effectively and efficiently in cases where ranges are not applicable, like employee number, product ID, etc. What if the data is out of range or list? For this purpose, we use default partitions on range and list partitioned tables.

Storage 83

Storage Database Performance Open Source 83

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. Yes, a person in France might not get the same version of Netflix as a person in Canada, but we need to remember that’s fundamentally a different video in terms of actual storage. The result?

Architecture 52

Architecture Performance Internet Internet 52

Percona

AUGUST 30, 2023

An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Common components of DR and HA architectures By definition, there are differences between high availability (HA) and disaster recovery (DR). It’s suitable for databases with moderate change rates.

Database 89

Database Hardware Open Source Strategy 89

Percona

DECEMBER 14, 2022

But while eminently capable of performing OLAP, it’s not quite as efficient. And if the query processes 100 million rows, that’s definitely not trivial! The CITUS columnar extension feature set includes: Highly compressed tables: Reduces storage requirements. Columnar storage. it does well. References tables.

Database 93

Database Analytics Storage Processing 93

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. This temporary storage acts as a buffer, ensuring that even if there are interruptions in data flow (like a dry riverbed), the video keeps playing from the stored memory. The result?

Architecture 52

Architecture Performance Internet Internet 52

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. The key factor is that the whole data structure resides in the same location (node), facilitating the operations.

Traffic 124

Traffic Scalability Database Servers 124

Testsigma

MAY 7, 2020

All data management tasks included moving data from back-end systems to identifying test data, data masking of sensitive data, skipped production defects due to unavailability of correct test data, manipulation of data for different scenarios, storage of test data.”. So the complete process was reviewed and evaluated. Data subset creation.

Testing 60

Testing Storage Database Processing 60

Scalegrid

JANUARY 8, 2019

Simply put, in a MySQL semisynchronous replication configuration, the master commits transactions to the storage engine only after receiving acknowledgement from at least one of the slaves. Another configuration we can use to increase the efficiency of parallel execution on the slaves is to tune binlog_group_commit_sync_delay on the master.

Availability 113

Availability Tuning Speed Network 113

SQL Performance

APRIL 17, 2020

When we ask SQL Server to change some aspect of a column's definition, it needs to check that the existing data is compatible with the new definition. Rewrite some or all of the stored data to match the new definition. A much better, and more explicit table definition would be: CREATE TABLE dbo. Be Careful with Syntax.

Servers 63

Servers Database Testing Efficiency 63

SQL Performance

AUGUST 27, 2021

This special-purpose storage is made up of append-only allocation units and is only used for version store operations. A new allocation unit is created every so often, and this allows regular version store cleanup to be very efficient—as an unneeded allocation unit can simply be dropped.

Database 56

Database Storage Availability Servers 56

Strategic Tech

MAY 24, 2019

Where are the boundaries in language where certain phrases have specific definitions? Alignment Efficiency Varying the shape of a boundary will alter the dynamics of collaboration between teams who need to be aligned, which may be more or less efficient for achieving goals. E.g. seconds, hours, days, months.

Design 45

Design Software Architecture Strategy Technology 45

SQL Performance

NOVEMBER 13, 2019

Here's the definition of the POC that supports our query: CREATE INDEX idx_grp_data_i_id ON dbo. When there is a supporting index in place, you're limiting the storage engine to an index order scan strategy (following the index linked list). Consider the following UDF definition as an example: DROP FUNCTION IF EXISTS dbo.

Servers 104

Servers C++ Storage Performance 104

CSS Wizardry

APRIL 2, 2018

The biggest problem is the DAC circuits used in many devices are just not efficient enough to do justice to the original recording, so a DAC upgrade can be the simplest way to improve your digital music and really get the most from your system. The improvement that the DAC provides is subtle, but definitely noticeable.

Website 108

Website Media Hardware Monitoring 108

Sutter's Mill

MARCH 11, 2024

tl;dr: I don’t want C++ to limit what I can express efficiently. recommend using instead of C++ ( example ), so by definition addressing these four would address the immediate NIST/NSA/CISA/etc. MSLs get CVEs too, though definitely fewer (again, e.g., Log4j ). Efficiency. Then I can still use fully modern C++… just nicer.

C++ 144

C++ Programming Code Java 144

Tasktop

MARCH 16, 2021

Data Architect: Designs the data acquisition, storage and optimization to support. Whatever you build, it better be able to handle capture, storage and processing in the face of changing artifact schema across all tools. The ability to adapt and evolve as the definition of “normal” evolves as normalization can’t be hardcoded.

Metrics 52

Metrics Healthcare Automotive Innovation 52

SQL Performance

AUGUST 23, 2019

In other words, a Bloom filter tells us either "maybe a match" or "definitely not a match". Bloom filters present a space- and time-efficient alternative when a simple bitmap is infeasible due to space requirements. This decompression can be performed efficiently using SIMD instructions, but it is still extra work.

Servers 75

Servers Engineering Efficiency Retail 75

The Agile Manager

NOVEMBER 30, 2015

For example, a few years ago, the logical database storage for a legacy asset was overwhelmed when a new type of transaction was implemented; since then, the infrastructure department requires every new initiative to complete a "long-term storage analysis forecast". Clearly this cannot be so[.] -- Morgan, pages 237-8.

Systems 45

Systems Storage Programming Infrastructure 45

Tasktop

MARCH 16, 2021

Data Architect: Designs the data acquisition, storage and optimization to support. Whatever you build, it better be able to handle capture, storage and processing in the face of changing artifact schema across all tools. The ability to adapt and evolve as the definition of “normal” evolves as normalization can’t be hardcoded.

Metrics 40

Metrics Healthcare Automotive Innovation 40

Alex Russell

SEPTEMBER 20, 2020

The closer one looks, the less a definition of "appiness" can be pinned down to specific technologies. So that's apps: they're whatever the OS says they are, that definition can change at any moment, and both reasonably constrained and superpowered programs can "be apps." It's unclear how this helps Apple's users. ??.

Hardware 64

Hardware Mobile Programming Java 64

The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience. Gaps in the data are filled back with an ETL process.

Traffic 279

Traffic Metrics Systems Strategy 279

Tasktop

DECEMBER 18, 2019

If you are not familiar with the functional programming or data storage concepts that come up, talk to one of your developers who do. By definition, product value streams have to be aligned to a customer. This is another place where the book will be a great tool for your journey.

Software Architecture 45

Software Architecture Architecture Metrics Software 45

Percona

AUGUST 27, 2018

Dangerous , because if you set this to a thread when using connection pooling OR ProxySQL and multiplexing, you may end up assigning a limitation to queries that instead, you wanted to run efficiently. If you ever wondered how much storage performance could be improved by using faster cloud volumes, you’re not alone. References.

Tuning 45

Tuning Virtualization Testing Servers 45

Alex Russell

JULY 14, 2021

I've got a long blog post brewing on this, but jumping to the end, an operable definition is: A browser is an application that can register with an OS to handle http and https navigations by default. "What, then, is a 'browser'?" " you might ask? iOS gained browser support in late 2020 (a dozen years late) via an Entitlement. [4]

Google 121

Google Mobile Engineering Internet 121

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well. See the article for more details. SQL Server 7.0

Servers 40

Servers Cache Media Hardware 40

SQL Performance

JUNE 10, 2020

The relational model and the standard querying language that is based on it are supposed to deal only with the conceptual aspects of the data and leave the physical implementation details like storage, optimization, access and processing of the data to the database platform (the implementation ).

C++ 109

C++ Database Servers Code 109

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. There's a huge short-term and long-term efficiency of services that depends on the successful coordination of cloud services and infrastructure. Does anyone really want to go back to the VM-centric days when we rolled everything ourselves?

Cloud 187

Cloud Hardware Infrastructure Innovation 187

SQL Performance

MAY 8, 2019

If you haven’t figured it out yet, look closely at the definitions of both tables—specifically the column names—and at the column names used in the query. They’re also quite efficient, using a Left Semi Join optimization with a short-circuit. So why are you getting the plan in Figure 1 and not the one in Figure 2?

Best Practices 68

Best Practices C++ Code Servers 68