Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

APRIL 29, 2019

Content is placed on the network of servers in the Open Connect CDN as close to the end user as possible, improving the streaming experience for our customers and reducing costs for both Netflix and our Internet Service Provider (ISP) partners. Our Infrastructure Security team leverages Python to help with IAM permission tuning using Repokid.

Open Source 279

Open Source Network Infrastructure Big Data 279

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Database downtime can hurt or doom any company with anything to do with the internet.

Availability 104

Availability Database Open Source Hardware 104

Dotcom-Montior

NOVEMBER 24, 2021

Within an organization, the responsibility of monitoring these large distributed systems typically falls on site reliability engineering (SRE) teams. For example, you can think of a cell phone network as a type of distributed system, consisting of a network of internet-connected devices that share resources workload. Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. So is speedy resolution and agreement.

Media 145

Media Games Education Engineering 145

Adrian Cockcroft

JUNE 2, 2023

Working from home is another tipping point, enabled by widespread deployment of laptops, home internet with capacity to run video (thanks in part to Netflix and other streaming services), and distributed productivity tools, then kicked over the line by the COVID-19 lockdown. Russell Kaplan of Scale AI talked about prompt engineering.

Social Media 98

Social Media Innovation Open Source Entertainment 98

Dotcom-Montior

JUNE 15, 2020

The entire country of China’s internet connectivity is shielded by the Great Firewall (GFW). There are three state-owned ISP providers, China Unicom, China Telecom, and China Mobile , that control internet in China. The most recent technology automatically shuts internet off whenever blacklisted URLs are accessed.

Monitoring 52

Monitoring Performance Artificial Intelligence Internet 52

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using [Linux performance tools]. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

MARCH 11, 2015

For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it. In the past analytics within an organization was the pinnacle of old style IT: a centralized data warehouse running on specialized hardware.

Analytics 135

Analytics Cloud Healthcare Retail 135

KeyCDN

JULY 2, 2020

These standards allow the web to be free and accessible to anyone that has an internet connection, essentially evening the playing field for those surfing the web. The Internet before standards Before the World Wide Web, the internet existed almost exclusively to provide pages of full text information. Basically, it was boring.

Internet 56

Internet Internet Best Practices Website 56

Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Adrian Cockcroft

JUNE 21, 2022

So in 1988 I joined the Sun sales force and became a Systems Engineer (nowadays we would say Solutions Architect). I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Alex Russell

SEPTEMBER 20, 2020

Pre-publication gates were valuable when better answers weren't available, but commentators should update their priors to account for hardware and software progress of the past 13 years. Fast forward a decade, and both the software and hardware situations have changed dramatically. Don't like the consequences?

Hardware 64

Hardware Mobile Programming Java 64

Smashing Magazine

AUGUST 3, 2021

Fortunately, we as engineers can avoid, or at least mitigate the impact of breakages in the web apps we build. Intermittent micro-services, unstable internet connections, or eventual consistency are all reasons to try again. Engineers need visibility on the root cause behind a degraded experience. Observability. Large preview ).

Network 145

Network Engineering Availability Monitoring 145

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Many critiques are possible, both of the target (five seconds for first load), the sample population (worldwide internet users), and of the methodology (informed reckons).

Performance 90

Performance Network Mobile Speed 90

Alex Russell

JULY 14, 2021

The 85% global-share OS (Android) has historically facilitated browser choice and diversity in browser engines. Engine diversity is essential, as it is the mechanism that causes competition to deliver better performance, capability, privacy, security, and user controls. If so, it's a browser regardless of the underlying engine.

Google 121

Google Mobile Engineering Internet 121

The Morning Paper

JANUARY 30, 2020

physics engine that simulates 3D cubes falling from the air. Since we’re talking about mobile applications, we have to assume a changing environment over time, including the possibility of losing internet connectivity altogether. due to total loss of internet connectivity) then the worker needs to be restarted.

Mobile 104

Mobile Cloud Latency Games 104

Testsigma

JANUARY 30, 2021

With the rapidly increasing use of smartphones and ease of access to the internet across the globe, testing has spread across vast platforms. For example, if you are using internet banking via a Mobile Web application, it will not allow you to save cards or mark any transaction as favourite. What are Mobile Web Applications?

Mobile 52

Mobile Testing Website Internet 52

Brendan Gregg

FEBRUARY 28, 2023

link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC: I followed that practice when writing some earlier books, and it has since struck me as unfair that some references had author names and some didn't.

Performance 110

Performance Latency Cache Virtualization 110

Testsigma

FEBRUARY 12, 2021

The way we now look at software engineering has revolutionized test automation, with QA teams adapting automation to expand test scope, increase efficiency and do more testing in less time. Companies worldwide require quicker releases and better applications to deal with the rapidly evolving dynamic business scenario. Easier bug reporting.

Testing 54

Testing Testing Tools Software Engineering Efficiency 54

Percona

NOVEMBER 1, 2023

MySQL backups play a pivotal role in safeguarding the integrity of your data, providing defense against various unforeseen calamities, hardware malfunctions, data loss, corruption, and inadvertent deletions. DataCenter Failure : power outage or internet provider issues. Why Do MySQL Backups Matter?

Best Practices 77

Best Practices Storage Strategy Database 77

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using Linux performance tools. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 52

Speed Java AWS Virtualization 52

ACM Sigarch

AUGUST 20, 2018

Looking at current hardware and software security research, however, we are seeing a number of technologies that are being developed that limit this type of broad interoperability. For example, the Internet is designed to allow any system to communicate with any other system in the networks.

Hardware 47

Hardware Operating System Architecture Software 47

Smashing Magazine

JANUARY 15, 2019

You may not think about it often, but the Internet uses a colossal amount of electricity. This, in turn, means that the Internet’s carbon footprint has grown to the point where it may have eclipsed global air travel , and this makes the Internet the largest coal-fired machine on Earth. These include data transfer (i.e.

Website Performance 74

Website Performance Website Energy Performance 74

Brendan Gregg

FEBRUARY 28, 2023

link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al., I followed that practice when writing some earlier books, and it has since struck me as unfair that some references had author names and some didn't.

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using [Linux performance tools]. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 40

Speed Java AWS Virtualization 40

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time. Modularity and flexibility.

Big Data 154

Big Data Processing Lambda Database 154

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Cluster Computer Instances are similar to other Amazon EC2 instances but have been specifically engineered to provide high performance compute and networking.

Cloud 118

Cloud AWS Automotive Latency 118

Brendan Gregg

SEPTEMBER 5, 2017

This includes many great engineers who I'm sure will excel in whatever they choose to work on next. Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters).

Virtualization 76

Virtualization AWS Engineering Hardware 76

The Agile Manager

APRIL 30, 2020

In the years leading up to 2000, there was aggressive spend on technology: insulation against fears of the Y2K bug (legacy software and hardware with time functions that wouldn't properly roll over to 01/01/2000) as well as development of new business and consumer technology to exploit what was then nascent internet technology.

Social Media 52

Social Media Innovation Internet Internet 52

Scalegrid

JUNE 11, 2019

This comes as no surprise, as MySQL has held this position consistently for many years according to DB-Engines. This again could be expected based on the DB-Engines Trend Popularity Ranking, but we saw MongoDB in 2nd place at 24.6% Public cloud is a cloud computing model where IT services are delivered across the internet.

Open Source 55

Open Source Database Cloud Infrastructure 55

SQL Server According to Bob

JULY 13, 2016

desktop machine (I won’t tell you the hardware details. In those days, what you got was the core SQL Server engine and tools. The installer provides a quick and easy ‘Basic’ install experience, downloading and installing the SQL Server Engine in just 3 clicks. So I proceeded to install SQL Server 4.20

Servers 40

Servers Media Engineering Virtualization 40

Tim Kadlec

JULY 31, 2013

One of the ones that stands out is Nate Koechley’s “Professional Frontend Engineering” presentation ( transcript and video ). and was preaching about the importance of progressive enhancement, graded browser support, and the massive scope of knowledge a professional front-end engineer needed to know. Here at Yahoo!,

Google 40

Google Website Hardware Games 40

All Things Distributed

APRIL 4, 2017

After finding it cost prohibitive to use colocation centers in local markets where their users are based, iZettle decided to give up hardware. Scania, a world leading manufacturer of commercial vehicles, is using AWS to bring advanced technologies to their trucks, buses, coaches, and diesel engines.

AWS 116

AWS Airlines Latency Games 116

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. These models are typically smaller (7 to 14 billion parameters) and easier to fine-tune, and they can run on very limited hardware; many can run on laptops, cell phones, or nanocomputers such as the Raspberry Pi.

Open Source 112

Open Source Artificial Intelligence Google Infrastructure 112

Smashing Magazine

JANUARY 7, 2019

Deviation metrics As noted by Wikipedia engineers , data of how much variance exists in your results could inform you how reliable your instruments are, and how much attention you should pay to deviations and outlers. Parsing and executing times vary significantly depending on the hardware of a device.

Performance 104

Performance Cache Metrics Network 104

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database.

Database 167

Database Lambda AWS IoT 167