Uber Engineering

JANUARY 15, 2020

Uber leverages real-time analytics on aggregate data to improve the user experience across our products, from fighting fraudulent behavior on Uber Eats to forecasting demand on our platform. .

Engineering 115

Engineering Analytics Big Data Database 115

Dynatrace

FEBRUARY 8, 2021

Also, these modern, cloud-native architectures produce an immense volume, velocity, and variety of data. To connect these siloes, and to make sense out of it requires massive manual efforts including code changes and maintenance, heavy integrations, or working with multiple analytics tools.

Cloud 256

Cloud Azure Analytics AWS 256

Dynatrace

APRIL 21, 2022

With a growing number of cloud-native applications built on containers and microservices-based architectures, the number and variety of databases become complex and difficult to manage at scale. In addition, they must often use disjointed database-specific tools to collaborate with engineers, database administrators, or application owners.

Database 237

Database DevOps Analytics Servers 237

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. Figure 1: Sample RAG architecture While this approach significantly improves the response quality of GenAI applications, it also introduces new challenges.

Cache 199

Cache Azure Infrastructure Monitoring 199

The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. This blog will explore these two systems and how they perform auto-diagnosis and remediation across our Big Data Platform and Real-time infrastructure.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Uber Engineering

OCTOBER 9, 2017

These insights range from in-the-moment traffic conditions that provide guidance on trip routes to the Estimated Time of Delivery (ETD) of an UberEATS … The post Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform appeared first on Uber Engineering Blog.

Open Source 85

Open Source Analytics Traffic Engineering 85

The Netflix TechBlog

JANUARY 25, 2023

All data should be also available for offline analytics in Hive/Iceberg. Marken architecture Above picture represents the block diagram of the architecture for our service. Our architecture makes it possible to easily onboard and ingest data from Media algorithms. zookeeper service, internationalization service etc.

Scalability 283

Scalability Latency Media Architecture 283

Uber Engineering

JULY 22, 2021

As Uber’s business grew, we scaled our Apache Hadoop (referred to as ‘Hadoop’ in this article) deployment to 21000+ hosts in 5 years, to support the various analytical and machine learning use cases. We built a team with varied … The post Containerizing Apache Hadoop Infrastructure at Uber appeared first on Uber Engineering Blog.

Infrastructure 145

Infrastructure Analytics Engineering Architecture 145

Dynatrace

NOVEMBER 22, 2021

Serverless architecture enables organizations to deliver applications more efficiently without the overhead of on-premises infrastructure, which has revolutionized software development. These tools simply can’t provide the observability needed to keep pace with the growing complexity and dynamism of hybrid and multicloud architecture.

AWS 222

AWS Lambda Artificial Intelligence Serverless 222

The Netflix TechBlog

MARCH 5, 2019

Netflix’s engineering culture is predicated on Freedom & Responsibility, the idea that everyone (and every team) at Netflix is entrusted with a core responsibility and they are free to operate with freedom to satisfy their mission. All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Dynatrace

DECEMBER 15, 2022

In this blog, we share three log ingestion strategies from the field that demonstrate how building up efficient log collection can be environment-agnostic by using our generic log ingestion application programming interface (API). Yet observability into syslog data on Dynatrace would help you monitor and troubleshoot infrastructure.

Strategy 174

Strategy AWS Open Source Transportation 174

Dynatrace

JULY 6, 2022

As organizations continue to adopt multicloud strategies, the complexity of these environments grows, increasing the need to automate cloud engineering operations to ensure organizations can enforce their policies and architecture principles. appeared first on Dynatrace blog. Big data automation tools. Read eBook now!

Artificial Intelligence 182

Artificial Intelligence Tuning Strategy Big Data 182

Dynatrace

MAY 7, 2019

They fail to understand the deployment architecture and dependencies and aren’t able to deal with the ephemeral nature of containers. Native integration of Kubernetes/OpenShift node events with the Davis AI causation engine. Universal container-level metrics for resource contention analytics. appeared first on Dynatrace blog.

Monitoring 199

Monitoring Architecture Metrics Analytics 199

Dynatrace

SEPTEMBER 18, 2020

Cloud-based application architectures commonly leverage microservices. By leveraging the Dynatrace Davis AI causation engine to watch for unforeseen changes in underlying API responsiveness, Dynatrace automatically identifies slowdowns in the performance of your API manager and points you to their root cause.

Infrastructure 190

Infrastructure Latency Metrics Analytics 190

Dynatrace

SEPTEMBER 17, 2019

Cluster and container Log Analytics. Robert allowed me to take a couple of screenshots from their Dynatrace environment and with that, in this blog I try to explain how Dynatrace gives them MaaSS for Developers, Operators, DevOps as well as Business. MaaSS for Cloud Architects: Deployment and Architecture Validations.

AWS 127

AWS Monitoring Ecommerce Lambda 127

Dynatrace

JANUARY 28, 2021

Such additional telemetry data includes user-behavior analytics, code-level visibility, and metadata (including open-source data). OneAgent takes care of auto-instrumentation and creation of the Smartscape model, which enables the Davis AI causation engine.

Traffic 161

Traffic Open Source Servers Cloud 161

Dynatrace

SEPTEMBER 13, 2023

Because Google offers its own Google Cloud Architecture Framework and Microsoft its Azure Well-Architected Framework , organizations that use a combination of these platforms triple the challenge of integrating their performance frameworks into a cohesive strategy. One of the powerful workflows to leverage is continuous release validation.

AWS 240

AWS Efficiency Azure Cloud 240

Dynatrace

DECEMBER 2, 2021

As organizations adopt microservices-based architecture , service-level objectives (SLOs) have become a vital way for teams to set specific, measurable targets that ensure users are receiving agreed-upon service levels. If engineers cannot deliver on the SLO targets, the organization risks failure to comply with its SLAs to customers.

Metrics 184

Metrics Best Practices DevOps Infrastructure 184

Adrian Cockcroft

FEBRUARY 13, 2023

Sustainability at AWS re:Invent 2022 -All the talks and videos I could find… Las Vegas MSG Sphere under construction next door to the Venetian Sands Expo Center — Photo by Adrian This blog post is long overdue — I spent too long trying to find time to watch all the videos, and finally gave up and listed a few below that I haven’t seen.

AWS 64

AWS Energy Architecture Programming 64

Dynatrace

JULY 6, 2020

All this comes with the Dynatrace zero-configuration approach, automatic service detection, continuous data capture in context, and answers, not just data, from the Dynatrace Davis AI engine, making you ready for large-scale Azure deployments. Gain enhanced visibility into your Azure environment.

Azure 145

Azure Cloud Big Data Virtualization 145

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. The Netflix Media Database (NMDB) is one such example.

Lambda 189

Lambda Media Open Source Metrics 189

Dynatrace

OCTOBER 4, 2022

Log management and analytics is an essential part of any organization’s infrastructure, and it’s no secret the industry has suffered from a shortage of innovation for several years. Modern IT environments — whether multicloud, on-premises, or hybrid-cloud architectures — generate exponentially increasing data volumes.

Analytics 227

Analytics Artificial Intelligence Storage Serverless 227

Dynatrace

JANUARY 12, 2022

In serverless and microservices architectures, messaging systems are often used to build asynchronous service-to-service communication. We’ve introduced brand-new analytics capabilities by building on top of existing features for messaging systems. – DevOps Engineer, large healthcare company. This is great!

Analytics 180

Analytics Systems DevOps Healthcare 180

Uber Engineering

DECEMBER 17, 2019

Uber’s busy 2019 included our billionth delivery of an Uber Eats order, 24 million miles covered by bike and scooter riders on our platform, and trips to top destinations such as the Empire State Building, the Eiffel Tower, and the … The post Uber’s Data Platform in 2019: Transforming Information to Intelligence appeared first on Uber Engineering (..)

Engineering 126

Engineering Big Data Infrastructure Analytics 126

Dynatrace

JANUARY 31, 2022

Key takeaways from this article on modern observability for serverless architecture: As digital transformation accelerates, organizations need to innovate faster and continually deliver value to customers. Companies often turn to serverless architecture to accelerate modernization efforts while simplifying IT management.

Serverless 171

Serverless Architecture Open Source Innovation 171

ScaleOut Software

AUGUST 20, 2020

This blog post explains how a new software construct called a real-time digital twin running in a cloud-hosted service can create a breakthrough for streaming analytics. For example, a PLM digital twin of a truck engine might describe the properties of the engine, such as its temperature and oil pressure.

Cloud 52

Cloud Development Analytics Azure 52

ScaleOut Software

AUGUST 20, 2020

This blog post explains how a new software construct called a real-time digital twin running in a cloud-hosted service can create a breakthrough for streaming analytics. For example, a PLM digital twin of a truck engine might describe the properties of the engine, such as its temperature and oil pressure.

Cloud 52

Cloud Development Analytics Azure 52

Dynatrace

DECEMBER 18, 2020

App architecture. First, let’s explore the architecture of these apps: BizOpsConfigurator. Now we have performance and errors all covered: Business Analytics. Digital Business Analytics can help answer those questions. Sales Engineers) usage. Agentless RUM, OpenKit, and Metric ingest to the rescue!

Analytics 135

Analytics Metrics IoT Monitoring 135

Dynatrace

OCTOBER 4, 2022

Grail needs to support security data as well as business analytics data and use cases. With that in mind, Grail needs to achieve three main goals with minimal impact to cost: Cope with and manage an enormous amount of data —both on ingest and analytics. Grail architectural basics. Work with different and independent data types.

Artificial Intelligence 261

Artificial Intelligence Analytics Storage Architecture 261

Rigor

JANUARY 13, 2020

When it comes to web content, you can easily find what you need through many different paths, from search engines and social media to playlists and blogs, jumping from one source to another with just a tap of a finger. Information Architecture. Web Performance Daybook-Volume-2. Professional Website Performance. Still good.

Performance 75

Performance Social Media Website Website Performance 75

Dynatrace

APRIL 19, 2024

In this blog post, we explore real-life scenarios shared by our customers, partners, and internal users at Dynatrace, offering inspiration to kickstart your own journey with custom solutions powered by AppEngine. With Automation Engine, they were able to call the cloud provider’s API to trigger the desired resizing action.

AWS 213

AWS Analytics Cloud Monitoring 213

Uber Engineering

APRIL 5, 2018

Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis.

Systems 109

Systems Big Data Storage Infrastructure 109

Jos

JUNE 2, 2018

Steve Souders was one of the first in reverse-engineering how browsers requested and waited for resources. UI/UX : There is usually a designer and/or UX person that sets the look & feel and information architecture. How would you architecture a non-trivial size web project (client, server, databases, caching layer)?

Performance 237

Performance Speed Google Media 237

Tasktop

APRIL 8, 2021

Bottlenecks from internal processes and a dated software architecture severely affected morale. Jason Babcoke will also join our board and brings tremendous experience at the intersection of entrepreneurship and engineering. The VSM Porfolio Insights in Tasktop Viz are a new set of analytics for technology leaders.

Innovation 52

Innovation DevOps Analytics Scalability 52

All Things Distributed

NOVEMBER 19, 2010

There were blog posts by Jeff Barr The Cluster GPU Instance and James Hamilton HPC in the Cloud with GPGPUs , as well as my background posting: Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances. Science & Engineering. an engineering adventure to break the 1,000 mph barrier in a car.

AWS 67

AWS Cloud Benchmarking Storage 67

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum Advantages.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

NOVEMBER 17, 2020

The rapidly evolving digital landscape is one important factor in the acceleration of such transformations – microservices architectures, service mesh, Kubernetes, Functions as a Service (FaaS), and other technologies now enable teams to innovate much faster. New cloud-native technologies make observability more important than ever….

Analytics 152

Analytics Technology Technology Cloud 152