ACM Sigarch

FEBRUARY 23, 2018

In his book “ Misbehaving: The Making of Behavioral Economics ”, he cites example after example of how human behavior does not follow economic expectations based on rational behavior, resulting in flawed economic models . I had a professor in grad school who used to joke that all architecture is reinvented every 5 years.

Architecture 47

Architecture Cache Hardware Virtualization 47

Dynatrace

JANUARY 23, 2024

AI data analysis can help development teams release software faster and at higher quality. Another key theme at Dynatrace Perform 2024 is organizations’ growing adoption of platform engineering , which helps accelerate the delivery of software applications.

Performance 186

Performance DevOps Innovation Artificial Intelligence 186

The Morning Paper

FEBRUARY 16, 2020

Migrating a privacy-safe information extraction system to a software 2.0 This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ A really interesting thing happens when you go from developing a Software 1.0 (i.e., In Software 1.0

Systems 84

Systems Design Software Software 84

cdemi

DECEMBER 16, 2017

Because of software error, the spacecraft encountered Mars at a lower than anticipated altitude and disintegrated due to atmospheric stresses. In this example, we can clearly see the huge impact of developing software without good specifications, requirement and guidelines can have. Tests are fundamental.

Software 73

Software Software Programming Software Engineering 73

The Netflix TechBlog

JUNE 1, 2021

Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Samuel Setegne is a Senior Software Engineer on the Core Data Science and Engineering team.

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

Adrian Cockcroft

FEBRUARY 13, 2023

This is the AWS Professional Services built tooling that customers can use to track the carbon footprint of their operations and processes, along with a customer example. Good example, well presented interesting new material. SUS302 Optimizing architectures for sustainability — Katja Philipp AWS SA and Szymon Kochanski AWS SA.

AWS 64

AWS Energy Architecture Programming 64

Strategic Tech

JANUARY 22, 2024

Architecture modernization initiatives are strategic efforts involving many teams, usually for many months or years. An AMET is an architecture Enabling Team that helps to coordinate and upskill all teams and stakeholders involved in a modernization initiative. They need a more loosely coupled architecture and empowered teams.

Architecture 98

Architecture Metrics Logistics Strategy 98

Strategic Tech

JANUARY 19, 2020

How we spend our time and apply our resources when developing software systems is possibly the most fundamental and difficult challenge. A natural tendency for software engineers is to gravitate towards the most technically interesting challenges. An example of a commoditised core is a search engine.

Open Source 87

Open Source Games Innovation Strategy 87

O'Reilly

FEBRUARY 2, 2020

And conversely, if you need software with that kind of accuracy (for example, a billing application), you shouldn’t be using AI. How do we test software whose behavior is fundamentally probabilistic? We hope you’ll join us at our upcoming events: O’Reilly Software Architecture Conference , New York, February 23-26.

Software Architecture 68

Software Architecture Monitoring Software Engineering Architecture 68

Testsigma

FEBRUARY 12, 2021

Just a manual testing approach would not suffice for today’s wired devices and dynamic architectural applications of Industry 4.0. The way we now look at software engineering has revolutionized test automation, with QA teams adapting automation to expand test scope, increase efficiency and do more testing in less time.

Testing 54

Testing Testing Tools Software Engineering Efficiency 54

All Things Distributed

SEPTEMBER 4, 2017

This has allowed for more research, which has resulted in reaching the "critical mass" in knowledge that is needed to kick off an exponential growth in the development of new algorithms and architectures. For the past 20 years, thousands of software engineers at Amazon have been working on ML. New division of labor.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

SQL Server According to Bob

MARCH 18, 2018

For example, we are always reviewing the Linux package files in order to reduce the size of the package. The calculation was based on architecture only Default-Worker-Count = (starting count x86=256 : x64=512) + (## of workers per CPU on the system [x86=8 : x64=16]). Bob Dorr – Principal Software Engineer SQL Server.

Servers 40

Servers Best Practices Software Engineering Operating System 40

Dynatrace

MARCH 6, 2024

Platform engineering creates and manages a shared infrastructure and set of tools, such as internal developer platforms (IDPs) , to enable software developers to build, deploy, and operate applications more efficiently. Dynatrace has made the reference IDP architecture available on GitHub for anyone to use.

Engineering 241

Engineering Development DevOps Infrastructure 241

Dynatrace

APRIL 20, 2023

At Dynatrace Perform 2023 , Maciej Pawlowski, senior director of product management for infrastructure monitoring at Dynatrace, and a senior software engineer at a U.K.-based Indeed, according to Dynatrace data, 71% of CIOs say the explosion of data from cloud-native architectures is beyond human ability to manage.

Analytics 187

Analytics Infrastructure Storage Efficiency 187

O'Reilly Software

SEPTEMBER 7, 2018

From chaos architecture to event streaming to leading teams, the O'Reilly Software Architecture Conference offers a unique depth and breadth of content. We received more than 200 abstracts for talks for the 2018 O'Reilly Software Architecture Conference in London—on both expected and surprising topics.

Software Architecture 64

Software Architecture Architecture Software Software 64

Strategic Tech

FEBRUARY 19, 2020

I’ve been disappointed for a long time with the way in which companies organise software development teams. I remember as a young, naive software developer, I assumed there would be structured processes and patterns similar to those used for designing a software architecture. A clear warning sign.

Architecture 64

Architecture Strategy Design Software Architecture 64

Dynatrace

DECEMBER 5, 2022

By helping teams release new software more frequently, DevOps practices are an essential component of digital transformation. DevOps is a widely practiced set of procedures and tools for streamlining the development, release, and updating of software. DevOps orchestration in practice. Get started with DevOps orchestration.

DevOps 210

DevOps Virtualization Innovation Best Practices 210

Dynatrace

FEBRUARY 12, 2024

The various presenters in this session aligned platform engineering use cases with the software development lifecycle. Check out the following use cases to learn how to drive innovation from development to production efficiently and securely with platform engineering observability. Real-time detection for fast remediation.

Engineering 182

Engineering Development Infrastructure Cloud 182

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. All ML projects are software projects.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

The Netflix TechBlog

FEBRUARY 9, 2021

Plus, the architecture of the Edge tier was evolving to a PaaS (platform as a service) model, and we had some tough decisions to make about how, and where, to handle identity token handling. Multiple Protocols & Tokens The example above shows one flow, dealing with one protocol (HTTP/S) and one type of token (Cookies).

Architecture 221

Architecture Latency Servers Website 221

The Netflix TechBlog

SEPTEMBER 13, 2021

The first was that there were too many security things that each software team needed to think about?—?things Supporting developers through those checklists for edge cases, and then validating that each team’s choices resulted in an architecture with all the desired security properties, was similarly not scalable for our security engineers.

Internet 220

Internet Internet Cloud Traffic 220

The Netflix TechBlog

OCTOBER 18, 2022

Meson was based on a single leader architecture with high availability. For example, a lot of our workflows are run around midnight UTC. For example, a workflow to backfill hourly data for the past five years can lead to 43800 jobs (24 * 365 * 5), each of which processes data for an hour. But sometimes, it is not efficient.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

FEBRUARY 9, 2021

In particular, we’ll define plans and offers, review the legacy architecture and some of its shortcomings, and dig into our new architecture and some of its advantages. Let’s take a deeper look at the architecture, protocols, and systems involved. A plan is essentially a set of features with a price.

Engineering 142

Engineering Scalability Architecture Innovation 142

Dynatrace

JANUARY 19, 2021

Serverless architectures help developers innovate more efficiently and effectively by removing the burden of managing underlying infrastructure. For example, Amazon Alexa extensions are implemented as AWS Lambda functions. For example, Amazon Alexa extensions are implemented as AWS Lambda functions. for example,?how

Lambda 209

Lambda Serverless AWS Mobile 209

Strategic Tech

NOVEMBER 1, 2021

The 2010s were a turning-point in the history of software engineering. While MVPs have been mainstream for a long time, the concept of Value Streams and Value Stream Architecture is still in the early adopter phase in the DevOps world. High levels of WIP in a team are an indication that cognitive load is too high?

Software Architecture 98

Software Architecture Architecture DevOps Software 98

The Netflix TechBlog

MAY 30, 2019

Our very first mobile app is called Prodicle and was built for Android & iOS using the same reactive architecture in both platforms, which allowed us to build 2 apps from scratch in 3 months with 4 software engineers. Overall Architecture Fragments & Activities — Fragment is not your view.

Architecture 155

Architecture Mobile Code Testing 155

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. In this model, we scan system logs and metadata generated by various compute engines to collect corresponding lineage data.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

O'Reilly

MAY 19, 2020

Software engineers represent the largest cohort, comprising almost 20% of all respondents (see Figure 1 ). Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). Almost one-quarter (23%) of respondents work in the software industry ( Figure 3 ). Respondent Demographics.

Cloud 141

Cloud Serverless AWS Architecture 141

Abhishek Tiwari

JULY 20, 2019

Let's take an example of retail as a domain of interest. One way to create a Spotify model inspired engineering organisation is to organise long-lived squads by retail business process hubs - i.e. specialisation around business process. In this model, software architecture and code ownership is a reflection of the organisational model.

Engineering 61

Engineering Retail Airlines Healthcare 61

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. The steps can be arbitrary Python code.

Open Source 232

Open Source AWS Infrastructure Energy 232

The Netflix TechBlog

NOVEMBER 20, 2023

For example, a job would reprocess aggregates for the past 3 days because it assumes that there would be late arriving data, but data prior to 3 days isn’t worth the cost of reprocessing. For example, a row in an aggregation target table needs all the rows from the source table associated with the aggregation row.

Processing 210

Processing Big Data Efficiency Engineering 210

The Netflix TechBlog

NOVEMBER 3, 2022

The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees.

Cache 224

Cache Latency Traffic Systems 224

O'Reilly

JULY 15, 2020

Success with microservices means owning the software lifecycle. Most (74%) respondents say their teams own the build-test-deploy-maintain phases of the software lifecycle. Software engineers comprise the survey audience’s single largest cluster, over one quarter (27%) of respondents (Figure 1). Success with containers.

Database 135

Database Architecture Education Systems 135

Strategic Tech

AUGUST 14, 2021

Our project was to build software to track and support this whole process. A major example was the creeping understanding that the shares in a Facility were only a guideline… After implementing the common use cases, they were now uncovering complexity that broke their mental models of the domain. fixing somebody else’s mess.

Design 52

Design Software Engineering Innovation Engineering 52

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. The steps can be arbitrary Python code.

Open Source 134

Open Source AWS Infrastructure Energy 134

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. One example displaying the need for dataset propagation: at any given time Netflix runs a very large number of A/B tests.

Cache 187

Cache Architecture Metrics Java 187

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. But wow, I didn’t think we’d be at the point yet where we’d be abandoning TCP/IP!

Network 92

Network Transportation Latency Entertainment 92