Expert insights. Personalized for you.
Benchmarking spreadsheet systems Rahman et al., They often freeze during computation, and are unable to import datasets well below the size limits posed by current spreadsheet systems. The other systems avoid this recomputation, but are slower than Excel for value-only datasets. MORE
We’re continuously working to support the most popular operating systems with high quality OneAgent deployment options. Of course, it’s possible to run a legacy 32-bit application on a 64-bit operating system. Dynatrace news. MORE
File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. ” Ten years of building on local file systems. MORE
Traditionally we use unit tests and integration tests that guarantee a system is production-ready. To better identify system vulnerabilities and improve resilience, Netflix invented Chaos Monkey , which injects various types of faults into the infrastructure and business systems. MORE
Wireless attacks on aircraft instrument landing systems Sathaye et al., The first fully operational Instrument Landing System (ILS) for planes was deployed in 1932. Due to the low decision height, attacks on CAT IIII systems can have severe consequences. MORE
In the past I've shared similar methodologies applied to other operating systems, and finished porting them to BSD for this talk. For my first trip to Paris I gave the closing keynote at [EuroBSDcon 2017] on performance methodologies, using FreeBSD 11.1 as an analysis target. MORE
Performance monitoring is a must to do the task for a DBA. You should ensure that the database performance is optimal all the time without any impact on the databases. Performance issues act like an open stage, and you need to look at every aspect such as CPU, RAM, server performance, database performance, indexes, blocking, […]. Deadlocks MORE
May 2020, Applitools had the pleasure of hosting Tyler Krupicka from Intuit for an hour-long webinar discussing design systems and testability. At Intuit, Tyler works on the "Player/Design Systems" team, where he focuses on design systems. MORE
For small deployments, it isn’t a problem however when scaling up to hundred or even thousands of systems things can become complicated. Even when all the systems are mapped correctly by Dynatrace, identifying these systems is a real challenge. S _ for the system. MORE
Let’s assume for a moment that your data survives its many passes through a system’s DRAM and emerges intact. That data must then be safely transported over a network to the storage system where it is written to disk. Random bit flips are far more common than most people, even IT professionals, think. Surprisingly, the problem isn’t widely discussed, even though it is silently causing data corruption that can directly impact our jobs, our businesses, and our security. MORE
In this alert, xMatters includes all the important incident information from Dynatrace, so there’s no need for you to visit additional system dashboards. Depending on the type of the issue, xMatters launches workflows across your systems to start the automated self-healing process. MORE
This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. In this post, we will consider the use of mathematics/cryptography as an approach to improving systems security. MORE
Gitlab had a very public outage last month. Most companies provide some kind of explanation when their services are interrupted. Those are usually sanitized (or seem sanitized) to make things seem better than they actually are. MORE
This week, the developers of Amazon Aurora have won the 2019 Association for Computing Machinery's (ACM) Special Interest Group on Management of Data (SIGMOD) Systems Award. MORE
I have previously tested and blogged about the NTFS, sparse, file system limitation error 665: [link] when running DBCC or using Snapshot databases with SQL Server. Recently a customer asked me if they would encounter the same limitation if they moved to Linux. The answer is not the same limitation and for EXT and XFS my testing and research confirm that a sparse file on Linux may be able to accommodate more fragments than on NTFS. MORE
Computer systems, from the Internet-of-Things devices to datacenters, are complex and optimizing them can enhance capability and save money. Developing simulators, however, is time-consuming and requires a great deal of infrastructure development regarding a prospective system. MORE
By October 2020, Daimler/Mercedes-Benz AG will replace its supplier defect and test management tool for its internal E/E system. Three Significant Changes Between the Two Systems. Backend system is completely different. MORE
Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year. Based on our findings, SQL still holds 60% with rising demand for systems such as PostgreSQL: SQL Database Use: 60.48%. MORE
In reality, in any non-trivial installation, there are multiple tools collecting, storing and displaying overlapping sets of metrics from many types of systems and different levels of abstraction. What if your monitoring systems fail? “Quis custodiet ipsos custodes?”?—?Juvenal MORE
PyTorch-BigGraph: a large-scale graph embedding system Lerer et al., SysML’19. We looked at graph neural networks earlier this year, which operate directly over a graph structure. MORE
The M/M/1 queue also assumes that the arrival rate is not affected by the unbounded number of tasks in the queue (called an “open system”). With two blog posts, we argue for more use of simple models beyond Amdahl’s Law. MORE
Professionally, I label myself as a developer, although I don’t like labels very much, and I prefer to say that the reason for my work is: to create quality software. But what is quality software ? I like to define it as follows: Quality software is that which meets the user's needs. MORE
Teaching rigorous distributed systems with efficient model checking Michael et al., It describes the labs environment, DSLabs , developed at the University of Washington to accompany a course in distributed systems. A visual debugger/system explorer. MORE
Machine learning systems are stuck in a rut Barham & Isard, HotOS’19. In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. MORE
50 ways to leak your data: an exploration of apps’ circumvention of the Android permissions system Reardon et al., Side-channels are typically an unintentional consequence of a complicated system. MORE
Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system overall comprises a set of devices (e.g., SysML 2019. MORE
Watching you watch: the tracking ecosystem of over-the-top TV streaming devices , Moghaddam et al., CCS’19. The results from this paper are all too predictable: channels on Over-The-Top (OTT) streaming devices are insecure and riddled with privacy leaks. MORE
The reason is in How Complex Systems Fail. How Complex Systems Fail The Westworld season finale made an interesting claim: humans are so simple and predictable they can be encoded by a 10,247-line algorithm. Small enough to fit in the pages of a thin virtual book. MORE
This is where Alluxio comes in and interfaces with applications like Hive as a distributed virtual file system to create tables with multiple partitionings in a different storage system. In this regard, data will always reside in the under-storage system as the source of truth and can be residing temporarily in the Alluxio file system. MORE
When a software program or an application does not work the way it is created or designed to perform, it is called a software bug. In most cases, these errors are caused by developers or designers. MORE
Understanding, detecting and localizing partial failures in large system software , Lou et al., Partial failures ( gray failures ) occur when some but not all of the functionalities of a system are broken. overhead in terms of system throughput. MORE
In this three-part blog series, we’ll share the following three common problem scenarios that you can easily solve by building an automated self-healing system with Dynatrace and xMatters Flow Designer: Process crash. Depending on the type of Dynatrace issue, xMatters prompts on-call resources with response option buttons that launch workflows across your systems to start the automated self-healing process—and to keep stakeholders and customers updated. Dynatrace news. MORE
This analysis powers our services and enables the delivery of more seamless and reliable user … The post Scaling Uber’s Apache Hadoop Distributed File System for Growth appeared first on Uber Engineering Blog. Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis. MORE
Fine-grained, secure and efficient data provenance on blockchain systems Ruan et al., That’s hard to do in today’s blockchain systems for two reasons: Provenance can only be determined by querying and replaying all on-chain transactions, which is inefficient and an offline activity. MORE
Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. I've also been working on Systems Performance 2nd Edition, now that the [BPF book] is done. MORE
An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., In this paper we explore the implications microservices have across the cloud system stack. Operating system and network implications. MORE
BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them. MORE
Google added another book into their excellent SRE series: Building Secure and Reliable Systems. Copy/pasting a few paragraphs: "In this book we talk generally about systems, which is a conceptual way of thinking about the groups of components that cooperate to perform some function. MORE
Yet, for all the importance that testing has in the SDLC, there is a misconception among many about the difference between a testing tool and a testing system. performance test tools test systemTesting is a mission-critical aspect of the software development lifecycle (SDLC). MORE
The interfaces to our digital system have been dictated by the capabilities of our computer systems—keyboards, mice, graphical interfaces, remotes, and touch screens. As a result, they fail to deliver a truly seamless and customer-centric experience that integrates our digital systems into our analog lives. All of these benefits make voice a game changer for interacting with all kinds of digital systems. MORE
As we scaled up to our present level of support for 14 million trips per day, the car in that … The post Migrating Functionality Between Large-scale Production Systems Seamlessly appeared first on Uber Engineering Blog. MORE
Migrating a privacy-safe information extraction system to a software 2.0 This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ system. MORE
Scaling symbolic evaluation for automated verification of systems code with Serval Nelson et al., Serval is a framework for developing automated verifiers of systems software. Serval can also be used to prove partial specifications for existing systems. MORE
performance mysql memory operating system bug memory management memory allocatorsWhen users experience memory usage issues with any software, including MySQL, their first response is to think that it’s a symptom of a memory leak. As this story will show, this is not always the case. This story is about a bug. MORE
Systems Related Topics DZone
JUNE 18, 2020
May 2020, Applitools had the pleasure of hosting Tyler Krupicka from Intuit for an hour-long webinar discussing design systems and testability. At Intuit, Tyler works on the "Player/Design Systems" team, where he focuses on design systems.
Dynatrace
JUNE 12, 2020
We’re continuously working to support the most popular operating systems with high quality OneAgent deployment options. Of course, it’s possible to run a legacy 32-bit application on a 64-bit operating system. Dynatrace news.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
DZone
JUNE 15, 2020
Yet, for all the importance that testing has in the SDLC, there is a misconception among many about the difference between a testing tool and a testing system. performance test tools test systemTesting is a mission-critical aspect of the software development lifecycle (SDLC).
DZone
APRIL 22, 2020
Traditionally we use unit tests and integration tests that guarantee a system is production-ready. To better identify system vulnerabilities and improve resilience, Netflix invented Chaos Monkey , which injects various types of faults into the infrastructure and business systems.
Brendan Gregg
MARCH 8, 2020
Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. I've also been working on Systems Performance 2nd Edition, now that the [BPF book] is done.
DZone
JULY 9, 2020
Professionally, I label myself as a developer, although I don’t like labels very much, and I prefer to say that the reason for my work is: to create quality software. But what is quality software ? I like to define it as follows: Quality software is that which meets the user's needs.
High Scalability
APRIL 9, 2020
Google added another book into their excellent SRE series: Building Secure and Reliable Systems. Copy/pasting a few paragraphs: "In this book we talk generally about systems, which is a conceptual way of thinking about the groups of components that cooperate to perform some function.
The Morning Paper
DECEMBER 5, 2019
Benchmarking spreadsheet systems Rahman et al., They often freeze during computation, and are unable to import datasets well below the size limits posed by current spreadsheet systems. The other systems avoid this recomputation, but are slower than Excel for value-only datasets.
The Morning Paper
MARCH 15, 2020
Understanding, detecting and localizing partial failures in large system software , Lou et al., Partial failures ( gray failures ) occur when some but not all of the functionalities of a system are broken. overhead in terms of system throughput.
Dynatrace
APRIL 24, 2019
For small deployments, it isn’t a problem however when scaling up to hundred or even thousands of systems things can become complicated. Even when all the systems are mapped correctly by Dynatrace, identifying these systems is a real challenge. S _ for the system.
The Morning Paper
SEPTEMBER 26, 2019
Wireless attacks on aircraft instrument landing systems Sathaye et al., The first fully operational Instrument Landing System (ILS) for planes was deployed in 1932. Due to the low decision height, attacks on CAT IIII systems can have severe consequences.
DZone
MAY 7, 2019
performance mysql memory operating system bug memory management memory allocatorsWhen users experience memory usage issues with any software, including MySQL, their first response is to think that it’s a symptom of a memory leak. As this story will show, this is not always the case. This story is about a bug.
The Morning Paper
APRIL 16, 2019
Teaching rigorous distributed systems with efficient model checking Michael et al., It describes the labs environment, DSLabs , developed at the University of Washington to accompany a course in distributed systems. A visual debugger/system explorer.
The Morning Paper
JUNE 6, 2019
Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system overall comprises a set of devices (e.g., SysML 2019.
Dynatrace
AUGUST 27, 2019
In this alert, xMatters includes all the important incident information from Dynatrace, so there’s no need for you to visit additional system dashboards. Depending on the type of the issue, xMatters launches workflows across your systems to start the automated self-healing process.
The Morning Paper
MAY 12, 2019
An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., In this paper we explore the implications microservices have across the cloud system stack. Operating system and network implications.
The Morning Paper
JUNE 27, 2019
Machine learning systems are stuck in a rut Barham & Isard, HotOS’19. In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability.
Professor Beekums
MARCH 5, 2017
Gitlab had a very public outage last month. Most companies provide some kind of explanation when their services are interrupted. Those are usually sanitized (or seem sanitized) to make things seem better than they actually are.
DZone
JUNE 25, 2019
Let’s assume for a moment that your data survives its many passes through a system’s DRAM and emerges intact. That data must then be safely transported over a network to the storage system where it is written to disk. Random bit flips are far more common than most people, even IT professionals, think. Surprisingly, the problem isn’t widely discussed, even though it is silently causing data corruption that can directly impact our jobs, our businesses, and our security.
Dynatrace
JULY 25, 2019
In this three-part blog series, we’ll share the following three common problem scenarios that you can easily solve by building an automated self-healing system with Dynatrace and xMatters Flow Designer: Process crash. Depending on the type of Dynatrace issue, xMatters prompts on-call resources with response option buttons that launch workflows across your systems to start the automated self-healing process—and to keep stakeholders and customers updated. Dynatrace news.
Brendan Gregg
JULY 15, 2019
BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.
All Things Distributed
MARCH 12, 2018
The interfaces to our digital system have been dictated by the capabilities of our computer systems—keyboards, mice, graphical interfaces, remotes, and touch screens. As a result, they fail to deliver a truly seamless and customer-centric experience that integrates our digital systems into our analog lives. All of these benefits make voice a game changer for interacting with all kinds of digital systems.
Uber Engineering
APRIL 5, 2018
This analysis powers our services and enables the delivery of more seamless and reliable user … The post Scaling Uber’s Apache Hadoop Distributed File System for Growth appeared first on Uber Engineering Blog. Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis.
The Morning Paper
FEBRUARY 16, 2020
Migrating a privacy-safe information extraction system to a software 2.0 This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ system.
The Morning Paper
FEBRUARY 9, 2020
Watching you watch: the tracking ecosystem of over-the-top TV streaming devices , Moghaddam et al., CCS’19. The results from this paper are all too predictable: channels on Over-The-Top (OTT) streaming devices are insecure and riddled with privacy leaks.
High Scalability
JULY 2, 2018
The reason is in How Complex Systems Fail. How Complex Systems Fail The Westworld season finale made an interesting claim: humans are so simple and predictable they can be encoded by a 10,247-line algorithm. Small enough to fit in the pages of a thin virtual book.
ACM Sigarch
MARCH 18, 2019
Computer systems, from the Internet-of-Things devices to datacenters, are complex and optimizing them can enhance capability and save money. Developing simulators, however, is time-consuming and requires a great deal of infrastructure development regarding a prospective system.
DZone
MAY 22, 2019
This is where Alluxio comes in and interfaces with applications like Hive as a distributed virtual file system to create tables with multiple partitionings in a different storage system. In this regard, data will always reside in the under-storage system as the source of truth and can be residing temporarily in the Alluxio file system.
The Morning Paper
NOVEMBER 5, 2019
File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. ” Ten years of building on local file systems.
All Things Distributed
JULY 4, 2019
This week, the developers of Amazon Aurora have won the 2019 Association for Computing Machinery's (ACM) Special Interest Group on Management of Data (SIGMOD) Systems Award.
The Morning Paper
SEPTEMBER 24, 2019
50 ways to leak your data: an exploration of apps’ circumvention of the Android permissions system Reardon et al., Side-channels are typically an unintentional consequence of a complicated system.
The Morning Paper
SEPTEMBER 15, 2019
Fine-grained, secure and efficient data provenance on blockchain systems Ruan et al., That’s hard to do in today’s blockchain systems for two reasons: Provenance can only be determined by querying and replaying all on-chain transactions, which is inefficient and an offline activity.
Tasktop
MAY 12, 2020
By October 2020, Daimler/Mercedes-Benz AG will replace its supplier defect and test management tool for its internal E/E system. Three Significant Changes Between the Two Systems. Backend system is completely different.
Adrian Cockcroft
APRIL 18, 2018
In reality, in any non-trivial installation, there are multiple tools collecting, storing and displaying overlapping sets of metrics from many types of systems and different levels of abstraction. What if your monitoring systems fail? “Quis custodiet ipsos custodes?”?—?Juvenal
The Morning Paper
JUNE 9, 2019
PyTorch-BigGraph: a large-scale graph embedding system Lerer et al., SysML’19. We looked at graph neural networks earlier this year, which operate directly over a graph structure.
The Morning Paper
NOVEMBER 12, 2019
Scaling symbolic evaluation for automated verification of systems code with Serval Nelson et al., Serval is a framework for developing automated verifiers of systems software. Serval can also be used to prove partial specifications for existing systems.
ACM Sigarch
MARCH 25, 2019
The M/M/1 queue also assumes that the arrival rate is not affected by the unbounded number of tasks in the queue (called an “open system”). With two blog posts, we argue for more use of simple models beyond Amdahl’s Law.
ACM Sigarch
OCTOBER 4, 2018
This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. In this post, we will consider the use of mathematics/cryptography as an approach to improving systems security.
Scalegrid
MARCH 4, 2019
Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year. Based on our findings, SQL still holds 60% with rising demand for systems such as PostgreSQL: SQL Database Use: 60.48%.
Brendan Gregg
OCTOBER 28, 2017
In the past I've shared similar methodologies applied to other operating systems, and finished porting them to BSD for this talk. For my first trip to Paris I gave the closing keynote at [EuroBSDcon 2017] on performance methodologies, using FreeBSD 11.1 as an analysis target.
Uber Engineering
AUGUST 7, 2019
As we scaled up to our present level of support for 14 million trips per day, the car in that … The post Migrating Functionality Between Large-scale Production Systems Seamlessly appeared first on Uber Engineering Blog.
SQL Shack
AUGUST 12, 2019
Performance monitoring is a must to do the task for a DBA. You should ensure that the database performance is optimal all the time without any impact on the databases. Performance issues act like an open stage, and you need to look at every aspect such as CPU, RAM, server performance, database performance, indexes, blocking, […]. Deadlocks
SQL Server According to Bob
DECEMBER 3, 2019
I have previously tested and blogged about the NTFS, sparse, file system limitation error 665: [link] when running DBCC or using Snapshot databases with SQL Server. Recently a customer asked me if they would encounter the same limitation if they moved to Linux. The answer is not the same limitation and for EXT and XFS my testing and research confirm that a sparse file on Linux may be able to accommodate more fragments than on NTFS.
73 
Let's personalize your content