Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed.

Serverless 98

Serverless Hardware AWS Architecture 98

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

ACM Sigarch

APRIL 26, 2018

GPU: Graphics Processing Unit (GPU) , which achieves high data parallelism with its SIMD architecture, has played a great role in the current AI market, from training to inference. The new DGX-2, which achieves 2 petaFLOPS in the system, combines 16 fully interconnected GPUS with 10x the deep learning performance. TFLOPS FP-64, 14.8

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little.

Cloud 167

Cloud Traffic Best Practices Strategy 167

Percona

DECEMBER 27, 2023

Another significant issue within security concerns is the escalating complexity of modern systems, especially in platforms like Kubernetes, which highlights the need for unified threat models and scanning tools to address vulnerabilities. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 79

Cloud Open Source Strategy Best Practices 79

Adrian Cockcroft

JUNE 2, 2023

There was a good talk on How to Build Responsible Systems While Leveraging Generative AI Capabilities by Sriram Subramanian of Microsoft, and I had several interesting conversations with him. Some of the talks at GlueCon were about techniques for adding domain knowledge via re-training, prompting or plug-ins to maintain quality output.

Social Media 98

Social Media Innovation Open Source Entertainment 98

The Morning Paper

FEBRUARY 18, 2020

ML learning systems combine the characteristics of software, e.g. the need for CI/CD pipelines, and of data, e.g. the need to track lineage. Compared to web-scale platform use of ML, enterprise applications tend to be built by smaller teams with deeper domain expertise, but less deep algorithmic or systems expertise.

Government 95

Government Software Engineering Storage Database 95

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Managed here means that the system automates resource provisioning for models to match a set of SLO constraints (cf. autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

Brendan Gregg

MAY 1, 2022

My dream is to turn computer performance analysis into a science, one where we can completely understand the performance of everything: of applications, libraries, kernels, hypervisors, firmware, and hardware. I now have an opportunity at Intel to grow further in my career, and to help grow other people.

Wireless 52

Wireless Hardware Open Source Cloud 52

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. When available, it can use hardware level performance counters.

Big Data 45

Big Data Cloud Performance Hardware 45

Tasktop

MAY 28, 2020

The first geodetic SECOR satellite surveying system to offer coast-to-coast measurement of the country. And first to invent the “Top Gun” Air Combat Training System back in the early ‘70s. . Accelerating with a Software/Hardware Hybrid. The first electronic stadium scoreboard in the U.S.

Speed 52

Speed Metrics Transportation Hardware 52

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else.

Tuning 52

Tuning Benchmarking Engineering C++ 52

O'Reilly

JANUARY 16, 2024

I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance. software” rather than “hardware” in our brains). Alternatively, cars are now starting to directly embed AI into entertainment systems (e.g., Thank you very much for reading.

Entertainment 73

Entertainment Internet Internet Design 73

All Things Distributed

SEPTEMBER 4, 2017

And thirdly, an "algorithmic revolution" has taken place, meaning it is now possible to train trillions of algorithms simultaneously, making the whole machine learning process much faster. But ultimately, there is something to be found for everyone who wants to define models, train them, and then scale.

Artificial Intelligence 149

Artificial Intelligence Transportation Education Airlines 149

All Things Distributed

MARCH 11, 2015

In the past analytics within an organization was the pinnacle of old style IT: a centralized data warehouse running on specialized hardware. With the new BI system the company is able to run analytics across 140 stories per day, in real time, and increase their agility for completing analytics tasks from months to days.

Analytics 136

Analytics Cloud Healthcare Retail 136

CSS Wizardry

APRIL 2, 2018

When I’m on a flight (as I am right now) or a train, this extra bulk doesn’t bother me too much—I get settled in anyway, so I don’t mind the extra room it takes. If I go down this path, I’ll need to start considering many other things such as storage, backups, compatible media players, and maybe even dedicated hardware.

Website 108

Website Media Hardware Monitoring 108

O'Reilly

NOVEMBER 28, 2023

Training models and developing complex applications on top of those models is becoming easier. Many of the new open source models are much smaller and not as resource intensive but still deliver good results (especially when trained for a specific application). report that the difficulty of training a model is a problem.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

Dynatrace

FEBRUARY 23, 2022

IaC, or software intelligence as code , codifies and manages IT infrastructure in software, rather than in hardware. With MLOps, data needs to be trained to understand normal behavior and what is anomalous. Unlike MLOps, AIOps doesn’t require training of data. Increased adoption of Infrastructure as code (IaC).

Serverless 267

Serverless Infrastructure Innovation DevOps 267

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Operating system Linux is the most common operating system for high-performance MySQL servers. have been released since then with some major changes.

Performance 125

Performance Hardware Tuning Storage 125

O'Reilly

SEPTEMBER 19, 2023

A company then needed to train up their ops team to manage the cluster, and their analysts to express their ideas in MapReduce. Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. The mess is far from over.

Hardware 99

Hardware Storage Big Data Blockchain 99

The Morning Paper

SEPTEMBER 26, 2019

Wireless attacks on aircraft instrument landing systems Sathaye et al., Today’s paper is a good reminder of just how important it is becoming to consider cyber threat models in what are primary physical systems, especially if you happen to be flying on an aeroplane – which I am right now as I write this! A quick primer on ILS.

Wireless 91

Wireless Systems Airlines Hardware 91

Percona

OCTOBER 18, 2023

Parallel run : Operating both the existing and new database system simultaneously during the transition, allowing for a seamless fallback in case of any issues. Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you.

Open Source 92

Open Source Database Hardware Strategy 92

The Morning Paper

JUNE 27, 2019

Machine learning systems are stuck in a rut Barham & Isard, HotOS’19. In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. Take a simple example: it would be really nice if we could have named dimensions instead of always having to work with indices.

Systems 87

Systems Tuning Programming Innovation 87

O'Reilly

AUGUST 4, 2022

The 604 tasks Gato was trained on vary from playing Atari video games to chat, from navigating simulated 3D environments to following instructions, from captioning images to real-time, real-world robotics. Learning how to ace Space Invaders does not interfere with or displace the ability to carry out a chat conversation.

Games 104

Games Social Media Hardware Architecture 104

High Scalability

OCTOBER 24, 2022

There is no structural separation as there is with a train service. Each cloud-native evolution is about using the hardware more efficiently. Anyone can rent a rack in a colo and stand up a system. Nitro is a revolutionary combination of purpose-built hardware and software designed to provide performance and security.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

MARCH 19, 2018

For example, training on more data means more accurate models. Last re:Invent, to make the problem of authoring, training, and hosting ML models easier, faster, and more reliable, we launched Amazon SageMaker. Machine learning models are usually trained tens or hundreds of times. In machine learning, more is usually more.

Scalability 160

Scalability Hardware AWS Tuning 160

The Netflix TechBlog

DECEMBER 23, 2020

By Fabio Kung , Sargun Dhillon , Andrew Spyker , Kyle , Rob Gulewich, Nabil Schear , Andrew Leung , Daniel Muino, and Manas Alekar As previously discussed on the Netflix Tech Blog, Titus is the Netflix container orchestration system. everything from the frontend API for netflix.com, to machine learning training workloads, to video encoders.

Media 286

Media Metrics Systems Processing 286

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. The MPP system leverages a shared-nothing architecture to handle multiple operations in parallel. Typically an MPP system has one leader node and one or many compute nodes.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites.

Open Source 279

Open Source Network Infrastructure Big Data 279

The Morning Paper

FEBRUARY 27, 2020

Modern software systems at scale are incredibly complex ever changing environments. memory leaks that take hours to build up into an issue); and there can be problems that only exhibit themselves with certain user, hardware, or software configurations. Gandalf system design. NSDI’20.

Analytics 68

Analytics Infrastructure Cloud Hardware 68

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. They still will win for mission-critical or real-time systems, which need performance over these parameters. These include Python, PHP, Perl, and Ruby.

Java 207

Java C++ Benchmarking Programming 207

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 107

Availability Database Open Source Hardware 107

Testsigma

MAY 3, 2021

From operating systems to versions to hardware specs, mobile devices stand unique even after being billions in number. As a result, we can relate the test automation to a machine that needs servicing regularly with regular checks and regular updates into the system. Training and Selecting Right Tool Stack.

Mobile 77

Mobile Testing Operating System Hardware 77

O'Reilly

OCTOBER 11, 2022

meme originated in IT’s transformation from manual system administration to automated configuration management and software deployment. We could see it as an example of 1980s-style “ expert systems ,” based on deterministic business rules. Developers who are automating business systems have to determine where humans belong in the loop.

Games 116

Games Healthcare Processing Retail 116

The Morning Paper

JUNE 11, 2019

The goal here is to reduce the training times of DNNs by finding efficient parallel execution strategies, and even including its search time, FlexFlow is able to increase training throughput by up to 3.3x FlexFlow is also given a device topology graph describing all the available hardware devices and their interconnections.

Network 81

Network Strategy Hardware Benchmarking 81

High Scalability

JULY 26, 2018

Ops: "Sorry, 3-5 month lead time on DC hardware and our switches are near capacity" - coming soon to an on-prem "serverless" project near you. THANKS Rust team for refining modern concepts into such a practical, elegant system. Aaron Frank : In the world of real estate, as Brad Inman puts it, “the company has gone viral.

Internet 124

Internet Internet Scalability Serverless 124

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Media Session API. Background Sync.

Media 145

Media Games Education Engineering 145