Dynatrace

OCTOBER 15, 2021

Loosely defined, observability is the ability to understand what’s happening inside a system from the knowledge of the external data it produces, which are usually logs, metrics, and traces. Logs are important because you’ll naturally want an event-based record of any notable anomalies across the system. Watch webinar now!

Open Source 212

Open Source Metrics Cloud Transportation 212

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

JULY 1, 2023

This post was originally published in July 2018 and was updated in July 2023. The RDS automated backup and PITR capabilities protect against data loss and system failures, ensuring high availability and performance while simplifying backup management for developers and DBAs. What are the differences between Aurora and RDS?

AWS 52

AWS Database Serverless Storage 52

Percona

JULY 2, 2023

This blog was originally written in September 2018 and was updated in June 2023. In setting up our demonstration system, we use pg_basebackup and continuous archiving. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. Organizations are taking advantage of having managed backups, lots of built-in security features, an uptime SLA of 99.99%, and an always up-to-date environment where they are no longer responsible for patching SQL Server or the operating system. GB per vCore.

Azure 63

Azure Performance Storage Latency 63

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB.

Best Practices 40

Best Practices Scalability Performance C++ 40

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. faster access to external storage and data locality (I/O, bandwidth). Storage provisioning. But Kubernetes storage is evolving quite quickly. Kubernetes has emerged as go to container orchestration platform for data engineering teams.

Big Data 63

Big Data Storage Benchmarking Hardware 63

All Things Distributed

DECEMBER 18, 2017

In January 2018, customers will be able to connect via Equinix Paris in January and later in the year via Interxion Paris. These teams are helping customers and partners of all sizes, including systems integrators and ISVs, to move to the cloud. Today, customers can connect to the AWS EU (Paris) Region via Telehouse Voltaire.

AWS 112

AWS Artificial Intelligence Education Energy 112

Testsigma

FEBRUARY 12, 2021

The Internet of Things is generally referred to as IoT which encompasses computers, cars, houses or some other technological system related. Gartner stated that Artificial Intelligence computing resources are to expand by 5 times between 2018 and 2023. IoT Test Automation. Better and quicker services are urgently needed today.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

CSS Wizardry

APRIL 2, 2018

— Harry Roberts (@csswizardry) 18 March, 2018. pic.twitter.com/2Pm6Gt7NXq — Harry Roberts (@csswizardry) March 20, 2018. — Harry Roberts (@csswizardry) March 21, 2018. Know anywhere I can get hold of a ‘dubious’ copy of this track? I’ll donate £25 to a charity of your choosing (DMs are open). Combine Libraries.

Website 108

Website Media Hardware Monitoring 108

Percona

MAY 1, 2023

This blog was originally published in August 2018 and was updated in May 2023. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Out of the box, the default PostgreSQL configuration is not tuned for any particular workload.

Tuning 52

Tuning Efficiency Database Performance 52

HammerDB

MAY 5, 2019

Also it is interesting to note that the impact of this change was not observed in other databases or other MySQL storage engines such as MyRocks the only noticeable impact with HammerDB workloads occurred in MySQL with InnoDB where in the source code ut0ut.cc So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

HammerDB

NOVEMBER 5, 2018

SQL> alter system flush buffer_cache; System altered. However what if in a test environment you cannot upgrade the log I/O but want to move beyond the log bottleneck to be able to test other system components more fully. SQL> alter system set commit_wait='NOWAIT' scope=spfile; System altered. commit_wait.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JANUARY 14, 2019

2018-05-31 ? In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. toDate(min(created_utc))???toDate(max(created_utc))??????count()?? toDate(max(created_utc))??????count()?? count()?? ? 2006-01-01 ?

Database 40

Database Analytics Blockchain Healthcare 40

The Morning Paper

DECEMBER 3, 2019

Another data point from Miller’s presentation: in 2018 57-70% of the average software project comprises open source components, and that fraction is rising fast. Each instance is a full stack service in its own right, with front-end GUI components, a back-end server and data storage, and all the code necessary to coordinate them.

Open Source 52

Open Source Programming Speed Software 52

Percona

AUGUST 10, 2018

In fact, you should not set it to OFF in a production system unless you are 100% sure about what you are doing and its implications. sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15

Tuning 44

Tuning Cache Database Storage 44

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Where Chrome Has Lagged. Pointer Lock.

Media 145

Media Games Education Engineering 145

Smashing Magazine

FEBRUARY 8, 2022

So, in 2018, I wanted to revive Webpack Runtime Analyzer, using my newly accumulated experience. It might not be completely efficient if we use modules in raw form, as they are in the file system: there might be some doubles, some modules could be combined, and others are only partially used. Then, Webpack optimizes this graph.

Storage 81

Storage Code Metrics C++ 81

Smashing Magazine

NOVEMBER 8, 2018

2018-11-08T12:30:30+01:00. In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Sharing Data Among Multiple Servers Through AWS S3.

AWS 45

AWS Servers Storage Cloud 45

High Scalability

DECEMBER 21, 2018

odrotbohm : I’ve seen microservice based systems more deranged after 2 years than any 1,5 decades old monolith could ever have been. Jeremy Daly : Compared to building and maintaining your own systems, cloud computing is ridiculously inexpensive, especially when you’re starting out and haven’t achieved significant scale.

Internet 137

Internet Internet Scalability Serverless 137

Smashing Magazine

AUGUST 23, 2019

In a CMS system, it should be possible to save this number as an attribute on an image and take it into account when outputting it in the img tag. The preview image often destroys the storage advantages of the WebP, which does not support progressive mode. Furthermore, no preview images need to be created.

Network 104

Network Servers Programming Code 104

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” tef : You can use a message broker to glue systems together, but never use one to cut systems apart. CompSciFact : 'Fancy algorithms are slow when n is small, and n is usually small.' -- Rob Pike. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

JUNE 15, 2018

1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble? Dave Snowden ~ A key principle of complex design is shift a system to an adjacent possible. They'll love you even more.

Internet 113

Internet Internet Scalability Blockchain 113

Smashing Magazine

JANUARY 15, 2019

The Mozilla Internet Health Report 2018 states that — especially as the Internet expands into new territory — “sustainability should be a bigger priority.” An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. These include data transfer (i.e.

Website Performance 74

Website Performance Website Energy Performance 74

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. In contrast, Alluxio a middleware for data access - think Alluxio storage layer as fast cache.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Alex Russell

OCTOBER 22, 2017

Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. Given the conflicted data we see across our other systems, this seems about right as a baseline. Think back: your framework of choice might be 40K, but what about that data system?

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. India became a 4G-centric market sometime in 2018. The Moto G4 , for example. 2] Getting accurate global information that isn't artificially reduced to averages remains an ongoing challenge.

Performance 124

Performance Network Cache Metrics 124

High Scalability

SEPTEMBER 14, 2018

editingemily : "In peacetime, a ticketing system is great. Because of that big servers and other memory systems need to have another kind of memory in the hierarchy. The new memory hierarchy is SRAM, DRAM, SCM (storage class memory), SSD, HDD. noahsussman : Complex systems are intrinsically hazardous systems.

Internet 30

Internet Internet Scalability Education 30

Abhishek Tiwari

JANUARY 6, 2018

Kube-ops-view provides read-only system dashboard. The backup files are stored in an object storage service (e.g. Ark server performs the actual backup, validates it and loads backup files in cloud object storage. Sysdig is container troubleshooting tool which captures system calls and events from the Linux kernel.

Open Source 111

Open Source DevOps Storage Engineering 111

All Things Distributed

DECEMBER 13, 2016

By 2018, CARASSO is expected to process data collected by a fleet of 100,000 vehicles traveling more than eight billion kilometers. BMW built its new car-as-a-sensor (CARASSO) service in only six months leveraging several AWS services. Fraud.net is a good example of this.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

Smashing Magazine

JANUARY 7, 2019

You could go as far as evaluating a framework (or any JavaScript library) on Sacha Greif’s 12-point scale scoring system by exploring features, accessibility, stability, performance, package ecosystem, community, learning curve, documentation, tooling, track record, team, compatibility, security for example. AV1 has compression similar to H.265

Performance 104

Performance Cache Metrics Network 104

All Things Distributed

DECEMBER 12, 2018

In 2018, we launched the first Pop-Up Loft in Stockholm, offering a co-working space and access to technology and business experts to support the growth of Nordic organizations. We help Supercell to quickly develop, deploy, and scale their games to cope with varying numbers of gamers accessing the system throughout the course of the day.

AWS 124

AWS Cloud Games Serverless 124

Smashing Magazine

JANUARY 6, 2020

Globally in 2018–2019, according to the IDC, 87% of all shipped mobile phones are Android devices. Per se, GraphQL is a query language for your API, and a server-side runtime for executing queries by using a type system you define for your data. In exchange, your team gains maintainability and developer efficiency, of course.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

The journey to fast production asset builds with Webpack is Etsy’s case study on how the team switched from using a RequireJS-based JavaScript build system to using Webpack and how they optimized theird builds, managing over 13,200 assets in 4 mins on average. GraphQL provides a performant solution to these issues.

Performance 145

Performance Cache Media Metrics 145

O'Reilly

MAY 19, 2020

Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). Interestingly, multi-cloud, or the use of multiple cloud computing and storage services in a single homogeneous network architecture, had the fewest users (24% of the respondents). It’s all cloud-like, irrespective of context.”.

Cloud 141

Cloud Serverless AWS Architecture 141