O'Reilly

JANUARY 16, 2024

I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance. software” rather than “hardware” in our brains). Alternatively, cars are now starting to directly embed AI into entertainment systems (e.g.,

Entertainment 73

Entertainment Internet Internet Design 73

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. Training models and developing complex applications on top of those models is becoming easier. of nonusers, 5.4%

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

O'Reilly

SEPTEMBER 19, 2023

A company then needed to train up their ops team to manage the cluster, and their analysts to express their ideas in MapReduce. Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. The mess is far from over.

Hardware 99

Hardware Storage Big Data Blockchain 99

All Things Distributed

MARCH 19, 2018

For example, training on more data means more accurate models. Last re:Invent, to make the problem of authoring, training, and hosting ML models easier, faster, and more reliable, we launched Amazon SageMaker. Machine learning models are usually trained tens or hundreds of times. In machine learning, more is usually more.

Scalability 159

Scalability Hardware AWS Tuning 159

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites.

Open Source 279

Open Source Network Infrastructure Big Data 279

O'Reilly

OCTOBER 11, 2022

meme originated in IT’s transformation from manual system administration to automated configuration management and software deployment. We could see it as an example of 1980s-style “ expert systems ,” based on deterministic business rules. Developers who are automating business systems have to determine where humans belong in the loop.

Games 116

Games Healthcare Processing Retail 116

Smashing Magazine

AUGUST 22, 2021

However, TCP is typically implemented in the operating system’s (OS’) kernel, a secure and more restricted environment, which for most OSes isn’t even open source. As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. We can also expect QUIC-specific hardware to become available.

Performance 106

Performance Network Latency Servers 106

All Things Distributed

NOVEMBER 30, 2016

Effectively applying AI involves extensive manual effort to develop and tune many different types of machine learning and deep learning algorithms (e.g. automatic speech recognition, natural language understanding, image classification), collect and clean the training data, and train and tune the machine learning models.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Java used to power core file system code. What is the name of your system and where can we find out more about it?

Architecture 52

Architecture Cache Azure Storage 52