Dynatrace

MAY 31, 2023

This shift is leading more organizations to hire site reliability engineers to guarantee the reliability and resiliency of their services. How site reliability engineering affects organizations’ bottom line SRE applies the disciplines of software engineering to infrastructure management, both on-premises and in the cloud.

Best Practices 216

Best Practices DevOps Latency Metrics 216

The Netflix TechBlog

JUNE 1, 2021

Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Samuel Setegne is a Senior Software Engineer on the Core Data Science and Engineering team.

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

Strategic Tech

JANUARY 22, 2024

Architecture modernization initiatives are strategic efforts involving many teams, usually for many months or years. An AMET is an architecture Enabling Team that helps to coordinate and upskill all teams and stakeholders involved in a modernization initiative. They need a more loosely coupled architecture and empowered teams.

Architecture 98

Architecture Metrics Logistics Strategy 98

Adrian Cockcroft

FEBRUARY 13, 2023

This is the AWS Professional Services built tooling that customers can use to track the carbon footprint of their operations and processes, along with a customer example. Good example, well presented interesting new material. SUS302 Optimizing architectures for sustainability — Katja Philipp AWS SA and Szymon Kochanski AWS SA.

AWS 64

AWS Energy Architecture Programming 64

Dynatrace

JANUARY 23, 2024

For example, high-quality data and predictive AI enable causal AI to provide precise, continuous, and actionable insights in real time. While app-centric serverless approaches abstract some of the complexities of cloud-native architecture, as the analyst firm Forrester notes , the next frontier for serverless adoption is at the edge.

Performance 179

Performance DevOps Innovation Artificial Intelligence 179

Strategic Tech

JANUARY 19, 2020

How we spend our time and apply our resources when developing software systems is possibly the most fundamental and difficult challenge. A natural tendency for software engineers is to gravitate towards the most technically interesting challenges. An example of a commoditised core is a search engine.

Open Source 87

Open Source Games Innovation Strategy 87

O'Reilly

FEBRUARY 2, 2020

And conversely, if you need software with that kind of accuracy (for example, a billing application), you shouldn’t be using AI. We hope you’ll join us at our upcoming events: O’Reilly Software Architecture Conference , New York, February 23-26. Now, it looks like that’s just a start.

Software Architecture 68

Software Architecture Monitoring Software Engineering Architecture 68

SQL Server According to Bob

MARCH 18, 2018

For example, we are always reviewing the Linux package files in order to reduce the size of the package. The calculation was based on architecture only Default-Worker-Count = (starting count x86=256 : x64=512) + (## of workers per CPU on the system [x86=8 : x64=16]). Bob Dorr – Principal Software Engineer SQL Server.

Servers 40

Servers Best Practices Software Engineering Operating System 40

All Things Distributed

SEPTEMBER 4, 2017

This has allowed for more research, which has resulted in reaching the "critical mass" in knowledge that is needed to kick off an exponential growth in the development of new algorithms and architectures. For the past 20 years, thousands of software engineers at Amazon have been working on ML. New division of labor.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

Testsigma

FEBRUARY 12, 2021

Just a manual testing approach would not suffice for today’s wired devices and dynamic architectural applications of Industry 4.0. The way we now look at software engineering has revolutionized test automation, with QA teams adapting automation to expand test scope, increase efficiency and do more testing in less time.

Testing 54

Testing Testing Tools Software Engineering Efficiency 54

cdemi

DECEMBER 16, 2017

According to this report, the primary cause of this failure was that one piece of ground software supplied by Lockheed Martin produced results in a United States customary unit, while a second system, supplied by NASA, expected those results to be in SI units. An erroneous trajectory was computed using this incorrect data.

Software 73

Software Software Programming Software Engineering 73

Dynatrace

MARCH 6, 2024

” Because of their versatility, teams can use IDPs for all types of software engineering projects, not just those in cloud-native scenarios. Grabner gave the example of one Dynatrace banking customer who built an IDP that enables developers to provision new Azure machines or Chef policies without administrative help.

Engineering 234

Engineering Development DevOps Infrastructure 234

The Morning Paper

FEBRUARY 16, 2020

But in Software 2.0 the majority of our effort goes into curating training data, i.e., specification-by-example of what the system should do. The existing system was based on a rule-based architecture with hand-crafted rules and had been in production since 2013. " Switching to a Software 2.0

Systems 84

Systems Design Software Software 84

Strategic Tech

FEBRUARY 19, 2020

I’ve been disappointed for a long time with the way in which companies organise software development teams. I remember as a young, naive software developer, I assumed there would be structured processes and patterns similar to those used for designing a software architecture. A clear warning sign.

Architecture 64

Architecture Strategy Design Software Architecture 64

Dynatrace

APRIL 20, 2023

Causal AI—which brings AI-enabled actionable insights to IT operations—and a data lakehouse, such as Dynatrace Grail , can help break down silos among ITOps, DevSecOps, site reliability engineering, and business analytics teams. Logs are automatically produced and time-stamped documentation of events relevant to cloud architectures.

Analytics 181

Analytics Infrastructure Storage Efficiency 181

The Netflix TechBlog

FEBRUARY 9, 2021

Plus, the architecture of the Edge tier was evolving to a PaaS (platform as a service) model, and we had some tough decisions to make about how, and where, to handle identity token handling. Multiple Protocols & Tokens The example above shows one flow, dealing with one protocol (HTTP/S) and one type of token (Cookies).

Architecture 221

Architecture Latency Servers Website 221

O'Reilly Software

SEPTEMBER 7, 2018

From chaos architecture to event streaming to leading teams, the O'Reilly Software Architecture Conference offers a unique depth and breadth of content. We received more than 200 abstracts for talks for the 2018 O'Reilly Software Architecture Conference in London—on both expected and surprising topics.

Software Architecture 64

Software Architecture Architecture Software Software 64

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. Along the way, we’ll provide illustrative examples.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

Dynatrace

DECEMBER 5, 2022

Monitoring and logging tools that once worked well with earlier IT architectures no longer provide sufficient context and integration to understand the state of complex systems or diagnose and correct security issues. Manually managing and securing multi-cloud environments is no longer practical. Get started with DevOps orchestration.

DevOps 203

DevOps Virtualization Innovation Best Practices 203

The Netflix TechBlog

OCTOBER 18, 2022

Meson was based on a single leader architecture with high availability. For example, a lot of our workflows are run around midnight UTC. For example, a workflow to backfill hourly data for the past five years can lead to 43800 jobs (24 * 365 * 5), each of which processes data for an hour. But sometimes, it is not efficient.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

FEBRUARY 9, 2021

In particular, we’ll define plans and offers, review the legacy architecture and some of its shortcomings, and dig into our new architecture and some of its advantages. Let’s take a deeper look at the architecture, protocols, and systems involved. A plan is essentially a set of features with a price.

Engineering 142

Engineering Scalability Architecture Innovation 142

Dynatrace

FEBRUARY 12, 2024

Check out the following use cases to learn how to drive innovation from development to production efficiently and securely with platform engineering observability. Using Dynatrace, teams can directly access their synthetic monitors and drill down into locations where, for example, execution failed because of local or global outages.

Engineering 176

Engineering Development Infrastructure Cloud 176

The Netflix TechBlog

SEPTEMBER 13, 2021

Supporting developers through those checklists for edge cases, and then validating that each team’s choices resulted in an architecture with all the desired security properties, was similarly not scalable for our security engineers. With these lofty goals in mind, we turned to our central engineering teams to help get us there.

Internet 220

Internet Internet Cloud Traffic 220

Dynatrace

JANUARY 19, 2021

Serverless architectures help developers innovate more efficiently and effectively by removing the burden of managing underlying infrastructure. For example, Amazon Alexa extensions are implemented as AWS Lambda functions. For example, Amazon Alexa extensions are implemented as AWS Lambda functions. for example,?how

Lambda 202

Lambda Serverless AWS Mobile 202

The Netflix TechBlog

MAY 30, 2019

Our very first mobile app is called Prodicle and was built for Android & iOS using the same reactive architecture in both platforms, which allowed us to build 2 apps from scratch in 3 months with 4 software engineers. Overall Architecture Fragments & Activities — Fragment is not your view.

Architecture 155

Architecture Mobile Code Testing 155

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. In this model, we scan system logs and metadata generated by various compute engines to collect corresponding lineage data.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

The Netflix TechBlog

NOVEMBER 3, 2022

The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees.

Cache 224

Cache Latency Traffic Systems 224

Strategic Tech

NOVEMBER 1, 2021

The 2010s were a turning-point in the history of software engineering. While MVPs have been mainstream for a long time, the concept of Value Streams and Value Stream Architecture is still in the early adopter phase in the DevOps world. I believe it originated in Lean Manufacturing in the 70s or 80s.

Software Architecture 98

Software Architecture Architecture DevOps Software 98

Abhishek Tiwari

JULY 20, 2019

Let's take an example of retail as a domain of interest. One way to create a Spotify model inspired engineering organisation is to organise long-lived squads by retail business process hubs - i.e. specialisation around business process. In this model, software architecture and code ownership is a reflection of the organisational model.

Engineering 61

Engineering Retail Airlines Healthcare 61

O'Reilly

MAY 19, 2020

. • More than one-third have adopted site reliability engineering (SRE); slightly less have developed production AI services. Software engineers represent the largest cohort, comprising almost 20% of all respondents (see Figure 1 ). For this audience, SRE’s future is brighter than AI’s, however. Respondent Demographics.

Cloud 141

Cloud Serverless AWS Architecture 141

The Netflix TechBlog

NOVEMBER 20, 2023

For example, a job would reprocess aggregates for the past 3 days because it assumes that there would be late arriving data, but data prior to 3 days isn’t worth the cost of reprocessing. For example, a row in an aggregation target table needs all the rows from the source table associated with the aggregation row.

Processing 210

Processing Big Data Efficiency Engineering 210

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. The steps can be arbitrary Python code.

Open Source 232

Open Source AWS Infrastructure Energy 232

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. One example displaying the need for dataset propagation: at any given time Netflix runs a very large number of A/B tests.

Cache 187

Cache Architecture Metrics Java 187

The Netflix TechBlog

JULY 12, 2019

Old Gatekeeper Architecture This model had several problems associated with it: This process was completely I/O bound and put a lot of load on upstream systems. New Gatekeeper Architecture With this model, liveness evaluation is conceptually separated from the data retrieval from upstream systems.

Cache 183

Cache Architecture Latency Engineering 183

Strategic Tech

AUGUST 14, 2021

A major example was the creeping understanding that the shares in a Facility were only a guideline… After implementing the common use cases, they were now uncovering complexity that broke their mental models of the domain. Software engineers are not typists who translate requirements into software.

Design 52

Design Software Engineering Innovation Software 52

O'Reilly

JULY 15, 2020

Software engineers comprise the survey audience’s single largest cluster, over one quarter (27%) of respondents (Figure 1). If you combine the different architectural roles—i.e., software and systems architects, technical leads—architects represent almost 28% of the sample. Respondent Demographics.

Database 136

Database Architecture Education Systems 136

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. The steps can be arbitrary Python code.

Open Source 134

Open Source AWS Infrastructure Energy 134