The Morning Paper

NOVEMBER 10, 2019

Snap: a microkernel approach to host networking Marty et al., This paper describes the networking stack, Snap , that has been running in production at Google for the last three years+. Upgrades are also rolled out progressively across the cluster of course. SOSP’19. Enter Google! It reminds me of ZeroMQ.

Network 92

Network Transportation Latency Entertainment 92

Dynatrace

NOVEMBER 11, 2022

Therefore, they need an environment that offers scalable computing, storage, and networking. Hyperconverged infrastructure (HCI) is an IT architecture that combines servers, storage, and networking functions into a unified, software-centric platform to streamline resource management. What is hyperconverged infrastructure?

Infrastructure 210

Infrastructure Storage Virtualization Network 210

Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. Early courses covered only the DTrace language, and expected students to figure out what to do with it.

Systems 111

Systems Performance Education Technology 111

Dynatrace

AUGUST 25, 2023

IT modernization improves public health services at state human services agencies For many organizations, the pandemic was a crash course in IT modernization as agencies scrambled to meet the community’s needs as details unfolded. The costs and challenges of technical debt Retaining older systems brings both direct and indirect costs.

Government 213

Government Infrastructure Programming Cloud 213

Particular Software

AUGUST 19, 2019

In one such organization I've heard of, there existed two separate networks. To get data from a different network, you needed to browse in a separate room, as workstations did not have access to the Internet. Design secure systems: See what Udi has to say in Day 1 of his Advanced Distributed Systems Design video course.

Network 40

Network Best Practices Database Internet 40

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. DNS query time indicates the average response times of DNS requests across the system.

Metrics 179

Metrics Monitoring Database Network 179

The Morning Paper

JUNE 6, 2019

Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system contains a number of privacy-enhancing building blocks, but the privacy guarantees of any end-to-end system will always depend on how they are used.

Systems 71

Systems Design Google Servers 71

Scalegrid

JANUARY 11, 2024

Of course, this is only true if the native solutions are used within the corresponding environment. There is a wide selection of advanced solutions available for cloud monitoring, including various choices for ensuring top-notch security in your organization’s systems.

Best Practices 130

Best Practices Cloud Monitoring Strategy 130

The Morning Paper

JUNE 27, 2019

Machine learning systems are stuck in a rut Barham & Isard, HotOS’19. In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. But that won’t solve the ordering issue of course. Challenges compiling non-standard kernels. GPU and TPU).

Systems 87

Systems Tuning Programming Innovation 87

Dynatrace

OCTOBER 17, 2022

Anomalous behavior in a newly deployed application can easily escape human detection, but AIOps systems complement SecOps engineers by identifying and reporting on potentially exploitable vulnerabilities. It may have third-party calls, such as content delivery networks, or more complex requests to a back end or microservice-based application.

DevOps 205

DevOps Artificial Intelligence Healthcare Innovation 205

The Morning Paper

SEPTEMBER 14, 2020

Aligning superhuman AI with human behavior: chess as a model system , McIlroy-Young et al., Neither Stockfish nor Leela were designed to match human moves of course, they were just built to play the strongest chess possible. This could be an important factor for many systems. KDD’20. How human-like is superhuman AI?

Systems 85

Systems Games Engineering Open Source 85

Particular Software

MARCH 1, 2021

Of course, there are upfront and ongoing costs associated with any computer network. The servers themselves, cabling, network switches, racks, load balancers, firewalls, power equipment, air handling, security, rent/mortgage, not to mention experienced staff to keep it all running smoothly, all come with a cost.

Transportation 98

Transportation Network Cloud Design 98

Dynatrace

FEBRUARY 10, 2022

WAFs protect the network perimeter and monitor, filter, or block HTTP traffic. Compared to intrusion detection systems (IDS/IPS), WAFs are focused on the application traffic. For most enterprises, using a RASP solution would mean running multiple agents on their production systems, potentially creating risk due to incompatibilities.

Traffic 239

Traffic Benchmarking Innovation Java 239

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Systems built with lots of microservices have different operational characteristics to those built from a small number of monoliths, we’d like to study and better understand those differences.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

SEPTEMBER 24, 2019

50 ways to leak your data: an exploration of apps’ circumvention of the Android permissions system Reardon et al., Side-channels are typically an unintentional consequence of a complicated system. This, of course, positions privacy as a luxury good… Finding apps that leak data. USENIX Security Symposium 2019. most apps).

Systems 74

Systems Traffic Network Google 74

Dynatrace

MARCH 17, 2021

Complex IT systems make it possible to buy your favorite pair of jeans online, pay your bills, or help you navigate. These systems produce an unimaginably huge amount of data. By introducing declarative extensions for network devices with SNMP or your Windows hosts with WMI, we’re taking the first steps towards codeless 2.0

Metrics 177

Metrics Monitoring Network Technology 177

The Morning Paper

APRIL 16, 2019

Teaching rigorous distributed systems with efficient model checking Michael et al., It describes the labs environment, DSLabs , developed at the University of Washington to accompany a course in distributed systems. 175 undergraduates a year currently go through this course. EuroSys’19.

Systems 43

Systems Efficiency Testing Strategy 43

The Netflix TechBlog

FEBRUARY 25, 2021

In all these cases, prior to being delivered through our content delivery network Open Connect , our award-winning TV shows, movies and documentaries like The Crown need to be packaged to enable crucial features for our members. As an example, Netflix led the specification for the carriage of AOM’s AV1 video streams in ISOBMFF. We’re hiring!

Technology 181

Technology Technology Open Source Media 181

The Morning Paper

SEPTEMBER 22, 2019

The secret sharer: evaluating and testing unintended memorization in neural networks Carlini et al., Take a system trained to make predictions on a language (word or character) model – an example you’re probably familiar with is Google Smart Compose. USENIX Security Symposium 2019. The exposure of a secret is then determined as.

Network 55

Network Testing Strategy Google 55

Dynatrace

NOVEMBER 11, 2021

“Because of the uncertainty of the times and the likely realities of the ‘new normal,’ more and more organizations are now charting the course for their journeys toward cloud computing and digital transformation,” wrote Gaurav Aggarwal in a Forbes article the impact of COVID-19 on cloud adoption.

AWS 222

AWS Cloud Lambda Azure 222

Dynatrace

MAY 13, 2020

OneAgent gives you all the operational and business performance metrics you need, from the front end to the back end and everything in between—cloud instances, hosts, network health, processes, and services. GPU-based machine learning system crashes, and you don’t know why? Example 1: Gain visibility into your NVIDIA GPUs.

Infrastructure 136

Infrastructure Metrics Monitoring Software Engineering 136

Dynatrace

SEPTEMBER 30, 2021

AWS Certified SysOps Administrator – Associate: Do you already deploy, manage, and operate AWS system resources and want to learn how to perform those duties even more effectively? Then this one’s for you. However, AWS recommends getting the AWS Certified Cloud Practitioner certificate or an equivalent Associate-level cert beforehand.

AWS 218

AWS Best Practices Analytics Cloud 218

Alex Podelko

AUGUST 18, 2019

First, I’d like to elaborate on “It may be less need for simple load testing due to increased scale and sophistication of systems” I meant that the traditional way – testing the system before deploying in production using production-type workload – is not the only way anymore.

Performance Testing 243

Performance Testing Testing Performance Testing Tools 243

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. Early courses covered only the DTrace language, and expected students to figure out what to do with it.

Systems 40

Systems Performance Education Technology 40

O'Reilly

SEPTEMBER 12, 2023

OS X, which used to trumpet “It just works,” has evolved to “it used to just work”; the most user-centric Unix-like system ever built now staggers under the load of new and poorly thought-out features. One advantage of computers, of course, is that they don’t care about complexity. (Could Git’s complexity be managed better?

Software 120

Software Software Development Programming 120

Dynatrace

MAY 17, 2023

By *instrumenting* a system (for example, an application), you enhance its capabilities to be able to send the desired telemetry data. That is, of course, if that service has also been instrumented and configured for the same back end as yours. For that, we first import the OpenTelemetry API into our application.

Transportation 195

Transportation Metrics Best Practices Code 195

Dynatrace

JULY 21, 2020

There are certain situations when an agent based approach isn’t possible, such as with network or storage devices, or a very old OS. You could of course create a custom device in Dynatrace and send data to it using our API or an ActiveGate extension.

Infrastructure 155

Infrastructure Monitoring Open Source Traffic 155

Percona

AUGUST 30, 2023

Without data backup mechanisms, there can be data loss or system downtime. Even worse, entire operating systems can crash, also resulting in data loss. Choosing the right backup frequency: The appropriate frequency, of course, will vary from one organization to another. Similarly, accidental deletion is a culprit.

Database 88

Database Hardware Open Source Strategy 88

Dynatrace

JUNE 1, 2020

However, with today’s highly connected digital world, monitoring use cases expand to the services, processes, hosts, logs, networks, and of course, end-users that access these applications – including your customers and employees. Websites, mobile apps, and business applications are typical use cases for monitoring.

Artificial Intelligence 185

Artificial Intelligence Social Media Monitoring IoT 185

Dynatrace

JUNE 18, 2020

The basic premise of AIOps is: Automatically monitor and analyze large sets of data across applications, logs, hosts, services, networks, meta, and processes through to end users and outcomes. Minimize alert noise from disparate systems. Of course, which leads me to the Dynatrace solution.

Monitoring 169

Monitoring Cloud DevOps Software 169

Dynatrace

MAY 1, 2020

Other distributions like Debian and Fedora are available as well, in addition to other software like VMware, NGINX, Docker, and, of course, Java. Our mission is to provide automatic answers, including root cause analysis, for performance degradation across all these systems and environments, regardless of the underlying hardware architecture.

Java 134

Java Hardware Tuning Metrics 134

Percona

APRIL 24, 2023

The urge to create more and more indexes is found to be causing severe damage in many systems. Many times, removing indexes is what we should be doing first before considering any new indexes for the benefit of the entire system. This post is about PostgreSQL, but most of the problems also apply to other database systems.

Tuning 126

Tuning Cache Storage Database 126

High Scalability

JULY 18, 2022

Wynter is looking for system administrators, engineers, and developers to join its research panel. If you have experience in hosting and with the WordPress stack, have worked with Ubuntu or Debian-based systems, and cutting-edge technologies, such Ansible and LXC, you should definitely check us out and apply here ! InterviewCamp.io

Education 100

Education DevOps Infrastructure Scalability 100

Dynatrace

MARCH 25, 2020

Are the systems we rely on every day as reliable via the home internet connection? Example #1 Order System: No change in user or buyers’ behavior. Both types of users mentioned access the same system, the only difference is that employees access it via the internal network and externals through a public exposed URL.

DevOps 181

DevOps Traffic Monitoring Engineering 181

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". At some point, the e-mail I send over WiFi will hit a wire, of course". We achieve 5.5 matthewstoller : I just looked at Netflix’s 10K.

Internet 134

Internet Internet Scalability Wireless 134

High Scalability

JUNE 10, 2022

Wynter is looking for system administrators, engineers, and developers to join its research panel. If you have experience in hosting and with the WordPress stack, have worked with Ubuntu or Debian-based systems, and cutting-edge technologies, such Ansible and LXC, you should definitely check us out and apply here ! InterviewCamp.io

Education 100

Education DevOps Infrastructure Scalability 100

Dynatrace

OCTOBER 30, 2020

In the example below, you can see that the fully automated OneAgent troubleshooting workflow has detected that this OneAgent was mounted on a network file system (NFS), which isn’t supported. Of course, you can delete the collected diagnostic data at any time. Instructions for resolving the issue are included.

Monitoring 235

Monitoring AWS Database Processing 235