Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. The two-day conference offered two tracks: One dedicated to the business value of OpenTelemetry observability, where we got an insight into use cases from Skyscanner, HBE Digital, and Logz.io, to name a few.

AWS 147

AWS Strategy Storage Metrics 147

Dynatrace

JANUARY 23, 2024

These are the goals of AI observability and data observability, a key theme at Dynatrace Perform 2024 , the observability provider’s annual conference, which takes place in Las Vegas from January 29 to February 1, 2024. And how can they take advantage of AI without incurring skyrocketing costs to store, manage, and query data?

Performance 191

Performance DevOps Innovation Artificial Intelligence 191

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. We found the answers at the Postgres Conference in March where we surveyed PostgreSQL users, contributors, and SQL and NoSQL database administrators alike.

Database 177

Database Cloud Open Source Systems 177

Brendan Gregg

APRIL 14, 2022

I'm also grateful for the support for my work by other companies, technical communities, social communities (Twitter, HackerNews), conference organizers, and all who have liked my work, developed it further, and shared it with others. Thank you. I'll still be posting here in my next job. More on that soon.

Java 145

Java Cloud Cache AWS 145

Percona

NOVEMBER 1, 2023

The key question related to RTO is, “How quickly must the data on this system be restored?” Snapshot Backups: Some file system implementations enable “snapshots” to be taken. These provide logical copies of the file system at a given point in time, without requiring a physical copy of the entire file system.

Best Practices 78

Best Practices Storage Strategy Database 78

The Netflix TechBlog

NOVEMBER 3, 2022

As the number of Titus users increased over the years, the load and pressure on the system increased substantially. cell): Titus Job Coordinator is a leader elected process managing the active state of the system. When a new leader is elected it loads all data from external storage.

Cache 224

Cache Latency Traffic Systems 224

The Morning Paper

NOVEMBER 8, 2020

USENIX is a nonprofit organisation committed to making content and research freely available – both conference proceedings and the recorded presentations of their events. Without in-person conferences this year, income is down and events are under threat. What Facebook needed, literally, was a plan to throw one away.

Virtualization 126

Virtualization Latency Storage Systems 126

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Or even on a plane. It was a great privilege.

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 117

Database Design Cloud Storage 117

Percona

DECEMBER 27, 2023

In our conversations with developers and engineers during the conference, we confirmed the CNCF GItOps Microsurvey data – 91% are already using GitOps. Creating repositories for memory-safe patterns in cloud systems to improve overall security. You mentioned ‘More Simple Kubernetes’?

Cloud 78

Cloud Open Source Strategy Best Practices 78

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM.

Hardware 56

Hardware Programming Media Storage 56

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. I am pretty sure some if not all of these papers deserved to be elected to the hall of fame of best papers in distributed systems. Comments ().

Operating System 144

Operating System Cache AWS Scalability 144

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Over the past years The Next Web Conference has become a premier conference on internet life and its technologies. I have been to the conference almost every year and it is getting better every time. Driving Storage Costs Down for AWS Customers.

AWS 93

AWS Internet Internet Storage 93

All Things Distributed

AUGUST 24, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 The Five-Minute Rule Ten Years Later, and Other Computer Storage Rules of Thumb , Jim Gray and Goetz Graefe, ACM SIGMOD Record 26 (4): 63â??

Storage 108

Storage Hardware AWS Data Engineering 108

The Morning Paper

NOVEMBER 30, 2020

Our approach is premised on a single observation: applications view storage systems as black-boxes that transition through a series of states, a subset of which are observed by applications. Is this system safe (will the application invariants be broken) under snapshot isolation? A motivating example.

Database 61

Database Storage Systems Strategy 61

Brendan Gregg

APRIL 30, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. Another exciting change for 2018: LISA is now a 3-day event, rather than 6 days; check out the Announcement of Changes to Future LISA Conferences for more details. Join us for 3 days in Nashville at LISA'18. Photo by Perry Kivolowitz.

DevOps 43

DevOps Network Best Practices Programming 43

Brendan Gregg

APRIL 14, 2022

I'm also grateful for the support for my work by other companies, technical communities, social communities (Twitter, HackerNews), conference organizers, and all who have liked my work, developed it further, and shared it with others. Thank you.

Java 52

Java Cache Cloud AWS 52

Brendan Gregg

APRIL 29, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. Another exciting change for 2018: LISA is now a 3-day event, rather than 6 days; check out the Announcement of Changes to Future LISA Conferences for more details. Join us for 3 days in Nashville at LISA'18. Photo by Perry Kivolowitz.

DevOps 40

DevOps Network Best Practices Programming 40

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. What would the world look like if all of our storage was in the cloud, and access to that storage was so fast we didn’t care? Upcoming events.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. All Things Distributed. Register for AWS re: Invent. By Werner Vogels on 16 July 2012 09:00 AM. Comments ().

AWS 83

AWS Big Data Media Storage 83

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). And this all has to work for whole-system executions, not just the C-language portion of user processes. The MIPS rows show the test suite results on a standard mips64 system.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else. as a result there were product and messaging changes.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Morning Paper

SEPTEMBER 19, 2019

There were so many interesting papers at the conference this year though that I haven’t been able to cover nearly as many as I would like. Autoscaling tiered cloud storage in Anna. ” Crusher is a Google system for automatically discovering email templates (e.g. Research papers. (In In random order!). Do we want that?

Blockchain 46

Blockchain Hardware Google Analytics 46

The Morning Paper

SEPTEMBER 5, 2019

The ability to compute quantiles over aggregated metrics has been recognized to be an essential feature of any monitoring system… Given how expensive calculating exact quantiles can be for both storage and network bandwidth, most monitoring system will compress the data into sketches and compute approximate quantiles.

Latency 52

Latency Metrics Open Source Java 52

All Things Distributed

OCTOBER 2, 2007

In two weeks we’ll present a paper on the Dynamo technology at SOSP, the prestigious biannual Operating Systems conference. Dynamo is internal technology developed at Amazon to address the need for an incrementally scalable, highly-available key-value storage system.

Operating System 80

Operating System Storage Scalability Technology 80

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. USENIX ATC is a top-tier venue with a broad range of systems research papers from both industry and academia.

Architecture 12

Architecture Hardware Cache Storage 12

ACM Sigarch

NOVEMBER 4, 2019

In particular, she highlighted her transformative MIT’78 VLSI System Design Course she designed and taught as a Visiting Professor of EECS at MIT. Students, mostly seniors and graduate students, learned the basics of VLSI system design in the first half of the semester and then built and taped out real designs during the rest of the semester.

Hardware 18

Hardware Architecture Programming Innovation 18

ScaleOut Software

JUNE 29, 2018

Attending technical conferences creates the opportunity to step away from focusing on day-to-day concerns and reflect more deeply about the key principles that guide our work. By Dr. William L. See the diagram below.) In fact, the software architecture of digital twins is so simple that it might be overlooked or trivialized.

Software Architecture 40

Software Architecture Architecture Software Software 40

ScaleOut Software

JUNE 29, 2018

Attending technical conferences creates the opportunity to step away from focusing on day-to-day concerns and reflect more deeply about the key principles that guide our work. By Dr. William L. See the diagram below.) In fact, the software architecture of digital twins is so simple that it might be overlooked or trivialized.

Software Architecture 40

Software Architecture Architecture Software Software 40

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. On this tour I will also speak at a number of conferences: BITKOM Internationale Cloud Computing Konferenz in Köln, Germany on October 6. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments ().

AWS 75

AWS Storage Cloud Best Practices 75

Smashing Magazine

JANUARY 15, 2019

For the last three years, the SustainableUX conference has seen experts in web sustainability sharing their knowledge across an array of web-based disciplines. An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 53

Latency Engineering Systems Hardware 53

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76