High Scalability

JUNE 15, 2018

They'll love you even more. 1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble?

Internet 113

Internet Internet Scalability Blockchain 113

High Scalability

JUNE 22, 2018

using them to respond to storage events on s3 or database events or auth events is super easy and powerful. Three major roadmap updates in 29 days with serious spec changes, and it got worse from there. Xtracerx : for me the biggest value to serverless functions is how nicely they tie in to the ecosystem of a cloud provider.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

The Symphonia

JUNE 19, 2018

Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage? We’ll get to all of those later on, but first I’m going to start the news this time with a roundup of an interesting day last week… News from the Serverless World Keynote Stage at Velocity 2018 Last week I was at O’Reilly’s Velocity conference in San Jose.

Serverless 40

Serverless AWS DevOps Open Source 40

High Scalability

FEBRUARY 1, 2019

Glacier is cheap because it isn't "always ready" storage. . $10.9B : Apple's Q1 services revenue; 5 million : homes on Airbnb; 2.5-5% They are trying to publish, to get jobs and promotions, to secure grants and so forth, but advancing science is a secondary concern. da_667 : The moral of the story here is that the cloud is NOT revolutionary.

Internet 146

Internet Internet Scalability Games 146

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

High Scalability

SEPTEMBER 14, 2018

NSF : When the HL-LHC reaches full capability in 2026, it is expected to produce more than 1 billion particle collisions every second, marking a 10-fold increase that will require a similar 10-fold increase in data processing and storage, including tools to collect, analyze, and record the most relevant events.

Internet 30

Internet Internet Scalability Education 30

Dynatrace

OCTOBER 17, 2019

BOSH loves YAML (so it’s in good company with Kubernetes) and follows a declarative approach for defining the desired state of Cloud Foundry’s various components as well as the underlying virtual machines, networks, and storage devices.

Cloud 102

Cloud Virtualization Internet Internet 102

Percona

JULY 1, 2023

This post was originally published in July 2018 and was updated in July 2023. It also supports auto-scaling of compute and storage resources, dynamically adjusting capacity based on chosen utilization thresholds to optimize performance and costs. What are the differences between Aurora and RDS? How do I choose which one to use?

AWS 52

AWS Database Serverless Storage 52

Percona Community

JUNE 28, 2018

was released GA on 2018-05-25). temporal data processing, Oracle compatibility features, and purpose-built storage engines. MariaDB 10.3 is now generally available (10.3.7 The article What’s New in MariaDB Server 10.3 by the MariaDB Corporation lists three key improvements in 10.3:

Storage 52

Storage Database Servers Engineering 52

n0derunner

DECEMBER 17, 2018

During.Next 2018 in London, Nutanix announced performance improvements in the core-datapath said to give up to 2X performance improvements. bssplit=64k/20:128k/20:256k/20:512k/20:1m/20 Normally storage benchmarks using large IO sizes are performed serially, because it’s easier on the storage back-end.

Performance 64

Performance Benchmarking Storage Network 64

Scalegrid

JULY 13, 2020

Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. pg_repack – reorganizes tables online to reclaim storage. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. General Purpose provides up to 8 TB of high-performance Azure Blob storage, while Business Critical provides up to 4 TB of super-fast local SSD storage. How many GBs or TBs are needed for the SQL Server instance and how fast does the storage need to be?

Azure 63

Azure Performance Storage Latency 63

Dynatrace

OCTOBER 15, 2021

The data is incredibly plentiful and difficult to store over long periods due to capacity limitations — a reason why private and public cloud storage services have been a boon to DevOps teams. Then, Google made the OpenCensus project open source in 2018. Monitoring begins here.

Open Source 216

Open Source Metrics Cloud Transportation 216

Percona

JULY 2, 2023

This blog was originally written in September 2018 and was updated in June 2023. Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters.

Strategy 52

Strategy Database Storage Open Source 52

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . HammerDB difference from Sysbench. c_ytd_payment: 10.00 7 rows in set (0.00 7 rows in set (0.00

Best Practices 40

Best Practices Scalability Performance C++ 40

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. faster access to external storage and data locality (I/O, bandwidth). Storage provisioning. But Kubernetes storage is evolving quite quickly. Kubernetes has emerged as go to container orchestration platform for data engineering teams.

Big Data 63

Big Data Storage Benchmarking Hardware 63

All Things Distributed

DECEMBER 18, 2017

In January 2018, customers will be able to connect via Equinix Paris in January and later in the year via Interxion Paris. To give customers the best experience when connecting to the new Region, today we are also announcing the availability of AWS Direct Connect. Our AWS EU (Paris) Region is open for business now.

AWS 112

AWS Artificial Intelligence Education Energy 112

CSS Wizardry

APRIL 2, 2018

— Harry Roberts (@csswizardry) 18 March, 2018. pic.twitter.com/2Pm6Gt7NXq — Harry Roberts (@csswizardry) March 20, 2018. — Harry Roberts (@csswizardry) March 21, 2018. Know anywhere I can get hold of a ‘dubious’ copy of this track? I’ll donate £25 to a charity of your choosing (DMs are open). Combine Libraries.

Website 108

Website Media Hardware Monitoring 108

SQL Server According to Bob

DECEMBER 18, 2018

Device level flushing may have an impact on your I/O caching, read ahead or other behaviors of the storage system. Neal, Matt, and others from Windows Storage, Windows Azure Storage, Windows Hyper-V, … validating Windows behaviors. · Any storage device that can survive a power outage. Starting with the Linux 4.18

Servers 90

Servers Media Cache Storage 90

Abhishek Tiwari

JANUARY 6, 2018

The backup files are stored in an object storage service (e.g. Ark server performs the actual backup, validates it and loads backup files in cloud object storage. — Abhishek Tiwari (@abhishektiwari) January 6, 2018. Amazon S3). Cross-cloud-provider migration of Kubernetes API objects.

Open Source 111

Open Source DevOps Storage Engineering 111

Testsigma

FEBRUARY 12, 2021

By 2021, a distributed cloud would help companies physically put all services closely together, thereby addressing low-latency challenges, minimising the expense of storage and ensuring that data standards are consistent with the laws in a given geographical region. Automation to Enhance AI Security Defence. The most recent 2021 trend.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

HammerDB

MAY 5, 2019

Also it is interesting to note that the impact of this change was not observed in other databases or other MySQL storage engines such as MyRocks the only noticeable impact with HammerDB workloads occurred in MySQL with InnoDB where in the source code ut0ut.cc So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

The Morning Paper

DECEMBER 3, 2019

Another data point from Miller’s presentation: in 2018 57-70% of the average software project comprises open source components, and that fraction is rising fast. Each instance is a full stack service in its own right, with front-end GUI components, a back-end server and data storage, and all the code necessary to coordinate them.

Open Source 52

Open Source Programming Speed Software 52

Percona

JANUARY 14, 2019

2018-05-31 ? In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. toDate(min(created_utc))???toDate(max(created_utc))??????count()?? toDate(max(created_utc))??????count()?? count()?? ? 2006-01-01 ?

Database 40

Database Analytics Blockchain Healthcare 40

HammerDB

NOVEMBER 5, 2018

2018-11-02T15:38:27.662098+00:00 Thread 1 advanced to log sequence 1402 (LGWR switch) Current log# 1 seq# 1402 mem# 0: /home/oracle/app/oracle/oradata/VULCDB1/onlinelog/o1_mf_1_fjj87ghr_.log log 2018-11-02T15:39:25.628040+00:00 Thread 1 cannot allocate new log, sequence 1403. Checkpoint not complete. Checkpoint not complete.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Tim Kadlec

JANUARY 9, 2019

I recently profiled a page on a Pixel 2 (released in 2017), and an Alcatel 1x (released in 2018). Ballooning bandwidth and storage have fostered complacency that we can do without. The web’s growth is being pushed forward primarily by low-cost, underpowered Android devices that frequently struggle with today’s web.

Performance 111

Performance Energy Internet Internet 111

Percona

MAY 1, 2023

This blog was originally published in August 2018 and was updated in May 2023. Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Out of the box, the default PostgreSQL configuration is not tuned for any particular workload.

Tuning 52

Tuning Efficiency Database Performance 52

Percona

AUGUST 10, 2018

sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15

Tuning 44

Tuning Cache Database Storage 44

Smashing Magazine

FEBRUARY 8, 2022

So, in 2018, I wanted to revive Webpack Runtime Analyzer, using my newly accumulated experience. We can import information from our metric storage into data. For example, we can record the daily average bundle build time, send it to storage with the metrics and then embed it into the custom report.

Storage 79

Storage Code Metrics C++ 79

The Morning Paper

OCTOBER 22, 2019

This 2018 paper reports on the findings from interviews with 30 professional data analysts to see what they get up to in practice. are tied for most commonly used data storage and manipulation solutions. Futzing and moseying: interviews with professional data analysts on exploration practices Alspaugh et al., VAST’18.

Programming 40

Programming Software Engineering Database Analytics 40

Smashing Magazine

NOVEMBER 8, 2018

2018-11-08T12:30:30+01:00. In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Sharing Data Among Multiple Servers Through AWS S3.

AWS 44

AWS Servers Storage Cloud 44

Smashing Magazine

AUGUST 23, 2019

The preview image often destroys the storage advantages of the WebP, which does not support progressive mode. As Robin Osborne already made clear in a blog post in 2018 , it doesn’t make much sense to show placeholders that don’t give you an idea of the final image.

Network 103

Network Servers Programming Code 103

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. After years of standards discussion and the first delivered to other platforms in 2018, iOS 14.5 April 2018 , but not usable until several releases later). Where Chrome Has Lagged. finally shipped Audio Worklets this week. Pointer Lock. Media Recorder.

Media 145

Media Games Education Engineering 145

Percona

JANUARY 17, 2019

now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). Aurora PQ works by doing a full table scan (parallel reads are done on the storage level). SSD) we can’t utilize the full potential of IOPS with just one thread. Documentation: [link].

Cache 46

Cache C++ AWS Airlines 46

Smashing Magazine

JANUARY 15, 2019

The Mozilla Internet Health Report 2018 states that — especially as the Internet expands into new territory — “sustainability should be a bigger priority.” An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73