High Scalability

AUGUST 22, 2018

Decentralized systems will continue to lose to centralized systems until there's a driver requiring decentralization to deliver a clearly superior consumer experience. Unfortunately, that may not happen for quite some time. I say unfortunately because ten years ago, even five years ago, I still believed decentralization would win. Why? For all the idealistic technical reasons I laid out long ago in Building Super Scalable Systems: Blade Runner Meets Autonomic Computing In The Ambient Cloud.

Internet 220

Internet Internet Google Scalability 220

Percona Community

AUGUST 23, 2018

I was recently asked a question by mail about MySQL Lossless Semi-Synchronous Replication. As I think the answer could benefit many people, I am answering it in a blog post. The answer brings us to the internals of transaction committing, of semi-synchronous replication, of MySQL (server) crash recovery, and of storage engine (InnoDB) crash recovery.

Storage 52

Storage Servers Engineering 52

Professor Beekums

AUGUST 19, 2018

Who writes code? The obvious answer is that developers write code. Who makes sure the code works? The answer to this question also seems obvious. It should also be developers… right? Fairly often, that is not actually the case. Many companies have separate QA departments that are responsible for making sure code works. Developers write code, then they throw it over a wall for someone else to test for them.

Code 45

Code Testing Development 45

ScaleOut Software

AUGUST 18, 2018

In previous blogs , we have explored the power of the digital twin model for stateful stream-processing. Digital twins are software abstractions that track the behavior of individual devices in IoT applications. They combine an event handling function with state information about each device. This state information is used to track evolving device status and help analyze incoming events, and it enables deeper introspection on the evolving status of the device than would be possible by just exami

IoT 45

IoT Ecommerce Analytics Latency 45

High Scalability

AUGUST 21, 2018

Who's Hiring? NationBuilder — if you’re a systems engineer, SRE or DevOps focused developer and have been looking for a place where you can help other people while still working in tech? We can give that opportunity. Please apply here. Twitch's commerce team in San Francisco is looking to hire senior developers to keep up with rapidly increasing demand for our Subscriptions and Payment platform.

Ecommerce 105

Ecommerce DevOps Java Metrics 105

Adrian Cockcroft

AUGUST 23, 2018

Allez pictured at the rim of Crater Lake, Oregon I wanted a Citroen SM when I was a teenager in the 1970s, I bought one in 1999. This is the story of me and my car, and I will update it as I gather pictures and details of the car online, and decide on it’s eventual destination. After 19 years with Allez, I’m not driving it often enough, and feel that it’s a good time for someone else to enjoy the car.

Speed 40

Speed Engineering Automotive Systems 40

The Polyglot Developer

AUGUST 20, 2018

A popular subject on the blog has always been around the conversion of one data format to another data format. For example we’ve already seen how to convert XML data to JSON data with JavaScript , but what if we wanted to work with comma separated value (CSV) data instead? We’re going to see how to take a CSV file, parse it into JSON, make some changes, and then convert it back into a CSV file using Node.js and a few readily available packages.

Availability 40

Availability Development 40

High Scalability

AUGUST 24, 2018

Hey, it's HighScalability time: Images from a far flung galaxy? Nope. It's the mind blowing swirling beauty of ink in motion. Do you like this sort of Stuff? Please lend me your support on Patreon. It would mean a great deal to me. And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10.

Internet 102

Internet Internet Scalability Best Practices 102

O'Reilly Software

AUGUST 23, 2018

Lessons from hundreds of development practice assessments across the industry. For more than 15 years, my colleagues and I at the Software Improvement Group (SIG) have been in the business of evaluating the quality of code, architecture, and development practices for our customers. Recently, we dove into our assessment data to discover—and quantify —trends in software development, each time comparing 2016 to 2017.

Software 73

Software Software Development Code 73

Randon ASCII

AUGUST 23, 2018

In my last post I promised to give more details about some rabbit holes that I went down during the investigation, including page tables, locks, WMI, and a vmmap bug. Those details are here, along with updated code samples. But first, a really quick summary of the original issue: In the last post I talked about how every time a CFG-enabled process allocates executable memory some Control Flow Guard (CFG) memory is allocated as well.

Operating System 58

Operating System Code Processing Systems 58

ACM Sigarch

AUGUST 20, 2018

In this post, I argue that software and data interoperability, a hallmark of the modern computer ecosystem, is at the core of several widespread security problems. An alternate approach is to tie data and potentially software to specific physical instances of a digital system. While such an approach would eliminate the ease with which we can share software and data, it could eliminate incidents where data is lost to attackers or where systems are attacked by malware.

Hardware 47

Hardware Operating System Architecture Software 47