The Morning Paper

FEBRUARY 16, 2020

Migrating a privacy-safe information extraction system to a software 2.0 This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ we spend the majority of our effort on writing code, expressing how the system achieves its goals.

Systems 84

Systems Design Software Software 84

Dynatrace

OCTOBER 14, 2022

As more organizations are moving from monolithic architectures to cloud architectures, the complexity continues to increase. These systems are generating more data than ever, and teams simply can’t keep up with a manual approach. Supervised learning uses already-labeled data to train algorithms for specific outputs.

Artificial Intelligence 170

Artificial Intelligence DevOps Analytics Cloud 170

O'Reilly Software

OCTOBER 23, 2018

I should start by saying this section does not offer a treatise on how to do architecture. Technology systems are difficult to wrangle. Our systems grow in accidental complexity and complication over time. Vitruvius and the principles of architecture. Architecture begins when someone has a nontrivial problem to be solved.

Strategy 100

Strategy Architecture Technology Technology 100

Dynatrace

JUNE 8, 2021

In software we use the concept of Service Level Objectives (SLOs) to enable us to keep track of our system versus our goals, often shown in a dashboard – like below –, to help us to reach an objective or provide an excellent service for users. The training program to proactively improve your services. Are you ready to kick some bugs?

Metrics 162

Metrics Tuning Programming Systems 162

Dynatrace

SEPTEMBER 5, 2023

Organizations have clearly experienced growth, agility, and innovation as they move to cloud computing architecture. As a result, many IT teams have turned to cloud observability platforms to reduce blind spots in their cloud architecture, to resolve problems rapidly, and to deliver better customer experience.

Cloud 216

Cloud Artificial Intelligence Innovation Azure 216

The Netflix TechBlog

AUGUST 24, 2022

Working within the time budget introduces an extra resource constraint for the recommender system. It is important to point out that the user’s time budget, like their preferences, may not be directly observable and the recommender system may have to learn that in addition to the user’s latent preferences.

Metrics 178

Metrics Systems Architecture Processing 178

The Netflix TechBlog

MARCH 4, 2024

Given the extensive scope and intricate complexity inherent to such a distributed, large-scale system, even if the failed jobs account for a tiny portion of the total workload, diagnosing and remediating job failures can cause considerable operational burdens. The labels are: a) did retry fail, b) retry cost.

Tuning 210

Tuning Efficiency Big Data Engineering 210

Adrian Cockcroft

JANUARY 17, 2022

photo taken by Adrian Cockcroft A year ago I did a talk at re:Invent called Architecture Trends and Topics for 2021 , so I thought it was worth seeing how they played out and updating them for the coming year. I did a few talks on this subject early in the year, and linked this to the sustainability advantages of serverless architectures.

Serverless 98

Serverless Hardware AWS Architecture 98

Particular Software

APRIL 27, 2020

In-person training and conferences have been postponed, cancelled, or transitioned to the virtual world. We’ve certainly been affected by this shift at Particular with the cancellation of our popular Advanced Distributed Systems Design (ADSD) course this year. It also worked very well as a video course.

Transportation 52

Transportation Systems Education Software Architecture 52

Dynatrace

FEBRUARY 10, 2022

Organizations are accelerating movement to the cloud, resulting in complex combinations of hybrid, multicloud [architecture],” said Rick McConnell, Dynatrace chief executive officer at the annual Perform conference in Las Vegas this week. For these vast environments, traditional, manual methods no longer suffice. For our complete? Learn more!

Artificial Intelligence 180

Artificial Intelligence Performance Innovation Speed 180

The Netflix TechBlog

MAY 21, 2019

We thought that reinforcement learning would be a promising approach that could provide great flexibility in the training process. Likewise it has very low requirements on the initial amount of training data. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

Scalegrid

JANUARY 5, 2024

If you’re considering a database management system, understanding these benefits is crucial. Understanding Database Management Systems (DBMS) A Database Management System (DBMS) assists users in creating and managing databases. In a DBMS, data serves as the material which the system stores, structures, and controls.

Efficiency 147

Efficiency Storage Database Scalability 147

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

Strategic Tech

MARCH 16, 2021

I believe that attitude towards the design of code and architecture is one of them. In my experience, the culture is better and the results are better in orgs where engineers and architects obsess over the design of code and architecture. Simon Brown taught me how to review architecture diagrams 10 years ago.

Software Engineering 80

Software Engineering Design Engineering Software 80

Dynatrace

JULY 6, 2022

As organizations continue to adopt multicloud strategies, the complexity of these environments grows, increasing the need to automate cloud engineering operations to ensure organizations can enforce their policies and architecture principles. AI that is based on machine learning needs to be trained. Monitoring automation is ongoing.

Artificial Intelligence 182

Artificial Intelligence Tuning Strategy Big Data 182

High Scalability

JANUARY 11, 2022

Architecture. The streaming data store makes the system extensible to support other use-cases (e.g. System Components. The system will comprise of several micro-services each performing a separate task. Sending and receiving messages from other users. High Level Design. Whose photos the user always like?

Design 334

Design Media Storage Logistics 334

Dynatrace

NOVEMBER 22, 2021

Serverless architecture enables organizations to deliver applications more efficiently without the overhead of on-premises infrastructure, which has revolutionized software development. These tools simply can’t provide the observability needed to keep pace with the growing complexity and dynamism of hybrid and multicloud architecture.

AWS 223

AWS Lambda Artificial Intelligence Serverless 223

Scalegrid

JANUARY 11, 2024

Key Takeaways Cloud security monitoring is a comprehensive approach involving both manual and automated processes to oversee servers, applications, platforms, and websites, using tools that are customized to fit unique cloud architectures. This includes servers, applications, software platforms, and websites.

Best Practices 130

Best Practices Cloud Monitoring Strategy 130

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

Percona

DECEMBER 27, 2023

Another significant issue within security concerns is the escalating complexity of modern systems, especially in platforms like Kubernetes, which highlights the need for unified threat models and scanning tools to address vulnerabilities. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 77

Cloud Open Source Strategy Best Practices 77

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. TFLOPS FP-64, 14.8

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Dynatrace

AUGUST 7, 2023

They can also use generative AI for cybersecurity, write prototype code, and implement complex software systems. Because generative AI is probabilistic in nature, its value depends on the quality of data that trains its algorithms and prompts. Developers use generative AI to find errors in code and automatically document their code.

DevOps 179

DevOps Analytics Best Practices Java 179

Percona

SEPTEMBER 22, 2023

Before open source was available, there was little to no interoperability between computer systems. If your one vendor of hardware, software, training, and all tangential things discontinued your sole-sourced system in favor of a newer, better-margined system of their manufacture, then all your investment was suddenly worth next to nothing.

Open Source 110

Open Source Software Software Hardware 110

High Scalability

APRIL 14, 2020

has hours of system design content. They also do live system design discussions every week. Learn to balance architecture trade-offs and design scalable enterprise-level software. Check out Educative.io's bestselling new 4-course learning track: Scalability and System Design for Developers. Who's Hiring? InterviewCamp.io

Education 105

Education Software Engineering Scalability Engineering 105

High Scalability

MAY 12, 2020

has hours of system design content. They also do live system design discussions every week. Learn to balance architecture trade-offs and design scalable enterprise-level software. Check out Educative.io's bestselling new 4-course learning track: Scalability and System Design for Developers. Who's Hiring? InterviewCamp.io

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

APRIL 28, 2020

has hours of system design content. They also do live system design discussions every week. Learn to balance architecture trade-offs and design scalable enterprise-level software. Check out Educative.io's bestselling new 4-course learning track: Scalability and System Design for Developers. Who's Hiring? InterviewCamp.io

Education 102

Education Software Engineering Scalability Engineering 102

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

The Morning Paper

FEBRUARY 18, 2020

ML learning systems combine the characteristics of software, e.g. the need for CI/CD pipelines, and of data, e.g. the need to track lineage. Compared to web-scale platform use of ML, enterprise applications tend to be built by smaller teams with deeper domain expertise, but less deep algorithmic or systems expertise.

Government 95

Government Software Engineering Storage Database 95

The Morning Paper

OCTOBER 18, 2020

But what about systems software? What really blew me away, is that this result includes the time taken to train the model used! The main innovation the authors introduce here is the use of linear spline fitting for training (as opposed to e.g. linear regression with an MSE loss function). The big idea. Evaluation.

Cache 137

Cache C++ Java Tuning 137

High Scalability

MAY 26, 2020

has hours of system design content. They also do live system design discussions every week. Learn to balance architecture trade-offs and design scalable enterprise-level software. Check out Educative.io 's bestselling new 4-course learning track: Scalability and System Design for Developers. Who's Hiring?

Education 100

Education AWS Software Engineering Scalability 100

Dynatrace

DECEMBER 2, 2021

As organizations adopt microservices-based architecture , service-level objectives (SLOs) have become a vital way for teams to set specific, measurable targets that ensure users are receiving agreed-upon service levels. This trains your teams to be proactive in maintaining software quality and saves you money by avoiding downtime.

Metrics 184

Metrics Best Practices DevOps Infrastructure 184

Adrian Cockcroft

FEBRUARY 13, 2023

Discussion of the water positive goal and optimizations that let AWS return water directly for irrigation rather than to the sewage system. Provides comparison of inference workload on P4dn GPU instances vs. AWS Trainium saving 92% energy and 90% cost, and training workload on P4dn vs. AWS Inferentia 2.6x

AWS 64

AWS Energy Architecture Programming 64

Percona

DECEMBER 4, 2023

Release highlights include: Docker images are now available for x86_64 architectures. The percona-postgis33 and percona-pgaudit packages on YUM-based operating systems are renamed percona-postgis33_15 and percona-pgaudit15 respectively Download Percona Distribution for PostgreSQL 15.5 Percona XtraBackup 8.0.35-30

Open Source 78

Open Source Azure Servers Programming 78

O'Reilly

FEBRUARY 2, 2020

First, the behavior of an AI application depends on a model , which is built from source code and training data. You need a repository for models and for the training data. And that’s essential: if you need to understand how your model behaves, and you don’t have the training data, you’re sunk.

Software Architecture 70

Software Architecture Monitoring Software Engineering Architecture 70

Strategic Tech

JANUARY 22, 2024

Architecture modernization initiatives are strategic efforts involving many teams, usually for many months or years. An AMET is an architecture Enabling Team that helps to coordinate and upskill all teams and stakeholders involved in a modernization initiative. They need a more loosely coupled architecture and empowered teams.

Architecture 98

Architecture Metrics Logistics Strategy 98

Percona

JULY 10, 2023

This release migrates our base operating system on which we build our PMM image from CentOS 7 to Oracle Linux 9. As security is paramount to us, a highlight in this release is that PMM 2.38.0 adds a solid and modernized enterprise-grade foundation to PMM. Thus, starting with PMM 2.38.0, PMM is publicly available on Oracle Linux 9.

Monitoring 77

Monitoring Open Source Scalability Database 77

Official Blog - World Web Technology

DECEMBER 4, 2023

SDLC aims to minimize project risks by promoting a forward-planning system. You can plan, create, deploy, test and maintain software apps and information systems. With SDLC’s framework, you can cleanly plan, structure and control information system development. They use STCL to create integration and system test plans.

Processing 64

Processing Software Software Development 64