The Morning Paper

FEBRUARY 18, 2020

The key insight this led to is that ML models are software , derived from data. ML learning systems combine the characteristics of software, e.g. the need for CI/CD pipelines, and of data, e.g. the need to track lineage. Many of the software engineering discipline and controls need to be brought over into an ML context.

Government 95

Government Software Engineering Storage Database 95

O'Reilly Software

JANUARY 12, 2018

2018 marks the fourth year of O’Reilly’s Software Architecture Conference , a software engineering event focused on providing hands-on training experiences for technologists at all levels of an organization—from experienced developers up through CTOs. Building evolutionary software architecture.

Technology 75

Technology Technology Engineering Software Architecture 75

O'Reilly

FEBRUARY 2, 2020

First, the behavior of an AI application depends on a model , which is built from source code and training data. You need a repository for models and for the training data. And that’s essential: if you need to understand how your model behaves, and you don’t have the training data, you’re sunk.

Software Architecture 68

Software Architecture Monitoring Software Engineering Architecture 68

Adrian Cockcroft

FEBRUARY 13, 2023

Provides comparison of inference workload on P4dn GPU instances vs. AWS Trainium saving 92% energy and 90% cost, and training workload on P4dn vs. AWS Inferentia 2.6x shorter training time, saving 54% energy and 75% cost. SUS302 Optimizing architectures for sustainability — Katja Philipp AWS SA and Szymon Kochanski AWS SA.

AWS 64

AWS Energy Architecture Programming 64

Strategic Tech

JANUARY 22, 2024

Architecture modernization initiatives are strategic efforts involving many teams, usually for many months or years. An AMET is an architecture Enabling Team that helps to coordinate and upskill all teams and stakeholders involved in a modernization initiative. They need a more loosely coupled architecture and empowered teams.

Architecture 98

Architecture Metrics Logistics Strategy 98

All Things Distributed

SEPTEMBER 4, 2017

And thirdly, an "algorithmic revolution" has taken place, meaning it is now possible to train trillions of algorithms simultaneously, making the whole machine learning process much faster. For the past 20 years, thousands of software engineers at Amazon have been working on ML. Machine Leaning at Amazon.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

Brendan Gregg

APRIL 30, 2018

Today's LISA attracts attendees working on all sizes of production systems, and its attendees include sysadmins, systems engineers, SREs, DevOps engineers, software engineers, IT managers, security engineers, network administrators, researchers, students, and more. Hope to see you in Nashville!

DevOps 43

DevOps Network Best Practices Programming 43

Brendan Gregg

APRIL 29, 2018

Today's LISA attracts attendees working on all sizes of production systems, and its attendees include sysadmins, systems engineers, SREs, DevOps engineers, software engineers, IT managers, security engineers, network administrators, researchers, students, and more. Hope to see you in Nashville!

DevOps 40

DevOps Network Best Practices Programming 40

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. All ML projects are software projects.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. Most of us, as we spend years in our jobs — tend to be proficient in at least one of these.

Java 207

Java C++ Benchmarking Programming 207

Dynatrace

JUNE 15, 2021

Software reliability and resiliency don’t just happen by simply moving your software to a modern stack, or by moving your workloads to the cloud. The fact is, Reliability and Resiliency must be rooted in the architecture of a distributed system. Fact #4: Multi-node, multi-availability zone deployment architecture.

AWS 186

AWS Traffic Architecture Azure 186

O'Reilly

NOVEMBER 12, 2019

For the inaugural O’Reilly survey on serverless architecture adoption, we were pleasantly surprised at the high level of response: more than 1,500 respondents from a wide range of locations, companies, and industries participated. The high response rate tells us that serverless is garnering significant mindshare in the community.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. The steps can be arbitrary Python code.

Open Source 232

Open Source AWS Infrastructure Energy 232

The Netflix TechBlog

OCTOBER 18, 2022

These include ETL pipelines, ML model training workflows, batch jobs, etc. Meson was based on a single leader architecture with high availability. Similarly, ML model training workflows usually consist of tens of thousands of training jobs within a single workflow. Figure 1 shows the high-level architecture.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

APRIL 26, 2022

We built Axion primarily to remove any training-serving skew and make offline experimentation faster. Figure 1: Netflix ML Architecture Fact: A fact is data about our members or videos. We make sure there is no training/serving skew by using the same data and the code for online and offline feature generation.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. The steps can be arbitrary Python code.

Open Source 134

Open Source AWS Infrastructure Energy 134

Abhishek Tiwari

JULY 20, 2019

Warehouse engineering squad - managing software services related inventory, stocktake, dispatch, allocation, transfer, robotics, etc. Customer experience engineering squad - focus on end-to-end customer life-cycle, marketing, targeting, personalisation, loyalty, etc. You want to move fast. How is that even possible?

Engineering 61

Engineering Retail Airlines Healthcare 61

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. This post is a high level overview of the design and architecture of Gutenberg. for example to train machine-learned models.

Cache 187

Cache Architecture Metrics Java 187

O'Reilly

MAY 19, 2020

Live online training, videos, books, certification prep, and more, from O’Reilly and our partner publishers. Software engineers represent the largest cohort, comprising almost 20% of all respondents (see Figure 1 ). Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%).

Cloud 141

Cloud Serverless AWS Architecture 141

The Netflix TechBlog

NOVEMBER 20, 2023

Whether in analyzing A/B tests, optimizing studio production, training algorithms, investing in content acquisition, detecting security breaches, or optimizing payments, well structured and accurate data is foundational. IPS enables users to continue to use the data processing patterns with minimal changes.

Processing 210

Processing Big Data Efficiency Engineering 210

O'Reilly

JULY 15, 2020

Success with microservices means owning the software lifecycle. Most (74%) respondents say their teams own the build-test-deploy-maintain phases of the software lifecycle. Software engineers comprise the survey audience’s single largest cluster, over one quarter (27%) of respondents (Figure 1). Success with containers.

Database 135

Database Architecture Education Systems 135

ACM Sigarch

APRIL 8, 2019

Computer architecture is an important and exciting field of computer science, which enables many other fields (eg. For those of us who pursued computer architecture as a career, this is well understood. In most curriculums, undergrad students do not have much exposure to computer architecture. Why is that? Lack of Exposure.

Architecture 74

Architecture Open Source Hardware Software Engineering 74