Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little.

Cloud 165

Cloud Traffic Best Practices Strategy 165

The Morning Paper

FEBRUARY 18, 2020

ML learning systems combine the characteristics of software, e.g. the need for CI/CD pipelines, and of data, e.g. the need to track lineage. Compared to web-scale platform use of ML, enterprise applications tend to be built by smaller teams with deeper domain expertise, but less deep algorithmic or systems expertise.

Government 95

Government Software Engineering Storage Database 95

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Managed here means that the system automates resource provisioning for models to match a set of SLO constraints (cf. autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. When available, it can use hardware level performance counters.

Big Data 45

Big Data Cloud Performance Hardware 45

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

SEPTEMBER 4, 2017

And thirdly, an "algorithmic revolution" has taken place, meaning it is now possible to train trillions of algorithms simultaneously, making the whole machine learning process much faster. But ultimately, there is something to be found for everyone who wants to define models, train them, and then scale.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

Dynatrace

FEBRUARY 23, 2022

IaC, or software intelligence as code , codifies and manages IT infrastructure in software, rather than in hardware. With MLOps, data needs to be trained to understand normal behavior and what is anomalous. Unlike MLOps, AIOps doesn’t require training of data. Serverless architecture expands. AIOps capabilities.

Serverless 265

Serverless Infrastructure Innovation DevOps 265

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

O'Reilly

AUGUST 4, 2022

At best, this is a false summit on the right path; at worst, it’s a local maximum far from AGI, which lies along a very different route in a different range of architectures and thinking. When we look at other systems and scales, it’s easy to be drawn to superficial similarities in the small and project them into the large.

Games 104

Games Social Media Hardware Architecture 104

The Netflix TechBlog

DECEMBER 23, 2020

By Fabio Kung , Sargun Dhillon , Andrew Spyker , Kyle , Rob Gulewich, Nabil Schear , Andrew Leung , Daniel Muino, and Manas Alekar As previously discussed on the Netflix Tech Blog, Titus is the Netflix container orchestration system. everything from the frontend API for netflix.com, to machine learning training workloads, to video encoders.

Media 286

Media Metrics Systems Processing 286

High Scalability

OCTOBER 24, 2022

There is no structural separation as there is with a train service. Each cloud-native evolution is about using the hardware more efficiently. You can even go old school and use non cloud-native architectures. Anyone can rent a rack in a colo and stand up a system. You can switch between clouds with effort.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 107

Availability Database Open Source Hardware 107

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. This begins not only in designing the algorithm or coming out with efficient and robust architecture but right onto the choice of programming language.

Java 207

Java C++ Benchmarking Programming 207

The Morning Paper

FEBRUARY 27, 2020

Modern software systems at scale are incredibly complex ever changing environments. memory leaks that take hours to build up into an issue); and there can be problems that only exhibit themselves with certain user, hardware, or software configurations. Gandalf system design. NSDI’20.

Analytics 68

Analytics Infrastructure Cloud Hardware 68

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. An end-to-end architecture.

Energy 52

Energy Hardware Efficiency Architecture 52

Sutter's Mill

FEBRUARY 13, 2017

.” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. Note that the class size is limited to about 100, so that I’ll be able to interact with most attendees directly.

Latency 51

Latency C++ Hardware Performance 51

O'Reilly

JULY 15, 2020

Almost one-third (29%) of respondents say their employers are migrating or implementing a majority of their systems (over 50%) using microservices. If you combine the different architectural roles—i.e., software and systems architects, technical leads—architects represent almost 28% of the sample. Figure 1: Respondent roles.

Database 135

Database Architecture Education Systems 135

The Netflix TechBlog

FEBRUARY 13, 2020

Choosing 420 subsampling, over the original 444 format, halves the number of samples (counting across all 3 color planes) that need to be encoded while relying on the fact that the human visual system is more sensitive to luma than chroma. There is a potential benefit in reusing the hardware in place for video compression/decompression.

Code 212

Code Metrics Efficiency Open Source 212

The Morning Paper

JULY 18, 2019

The overall Neural Bloom Filter architecture looks like this: A controller network encodes the input (which might be a row in a table, but could equally be e.g. an image) into an embedding. To go ahead and introduce Neural Bloom Filters into your system you’ve got to really want those space savings. cient data-structures.

Network 86

Network Java Database Hardware 86

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Meanwhile, budget segment devices have finally started to see improvement ( as this series predicted ), thanks to hand-me-down architecture and process node improvements.

Performance 90

Performance Network Mobile Speed 90

ACM Sigarch

APRIL 8, 2019

Computer architecture is an important and exciting field of computer science, which enables many other fields (eg. For those of us who pursued computer architecture as a career, this is well understood. In most curriculums, undergrad students do not have much exposure to computer architecture. Why is that? Lack of Exposure.

Architecture 74

Architecture Open Source Hardware Software Engineering 74

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. In general, Egnyte connect architecture shards and caches data at different levels based on: Amount of data.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

OCTOBER 11, 2022

For example, changing our database architecture to be more efficient could save on server costs. On design systems, UX, web performance and CSS/JS. Hardware And E-Waste. But there are plenty of actions we can take that reduce our environmental impact and reduce costs (or increase revenue) at the same time. Get Organized.

Strategy 124

Strategy Development Energy Website 124