Uber Engineering

AUGUST 3, 2018

From driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data.

Big Data 110

Big Data Transportation Engineering Storage 110

Dynatrace

FEBRUARY 16, 2023

How do you get more value from petabytes of exponentially exploding, increasingly heterogeneous data? The short answer: The three pillars of observability—logs, metrics, and traces—converging on a data lakehouse. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 195

Analytics Innovation Metrics Database 195

Dynatrace

JUNE 26, 2023

Software analytics offers the ability to gain and share insights from data emitted by software systems and related operational processes to develop higher-quality software faster while operating it efficiently and securely. This involves big data analytics and applying advanced AI and machine learning techniques, such as causal AI.

Software 196

Software Software Analytics Big Data 196

DZone

AUGUST 23, 2023

In the era of big data, efficient data management and query performance are critical for organizations that want to get the best operational performance from their data investments.

Big Data 130

Big Data Analytics Innovation Efficiency 130

Dynatrace

AUGUST 10, 2021

This year’s conference agenda was packed full of choices, including: Keynotes : Topics included accelerating digital transformation, with Dynatrace CIO Mike Maciag, and Spatial Collapse: The Great Acceleration of Turning Data Into an Asset, with Tricia Wang from Sudden Compass. We’ve all heard it: data is one of your biggest assets.

DevOps 246

DevOps Innovation Big Data Cloud 246

Dynatrace

JANUARY 11, 2023

With more organizations taking the multicloud plunge, monitoring cloud infrastructure is critical to ensure all components of the cloud computing stack are available, high-performing, and secure. Cloud monitoring is a set of solutions and practices used to observe, measure, analyze, and manage the health of cloud-based IT infrastructure.

Cloud 231

Cloud Monitoring Best Practices Infrastructure 231

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Kubernetes infrastructure models differ between cloud and on-premises. Kubernetes moved to the cloud in 2022.

Open Source 349

Open Source Java Operating System Programming 349

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

OCTOBER 25, 2022

DevOps requires infrastructure experts and software experts to work hand in hand. Thus, NoOps became a loosely defined concept that initially proposed only leveraging cloud-based PaaS and IaaS solutions that freed up operations from provisioning infrastructure and deploying applications. Introduction of AIOps.

DevOps 225

DevOps Big Data Cloud Innovation 225

Scalegrid

MARCH 14, 2024

Key Takeaways A hybrid cloud platform combines private and public cloud providers with on-premises infrastructure to create a flexible, secure, cost-effective IT environment that supports scalability, innovation, and rapid market response. The architecture usually integrates several private, public, and on-premises infrastructures.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Dynatrace

OCTOBER 4, 2022

Log management and analytics is an essential part of any organization’s infrastructure, and it’s no secret the industry has suffered from a shortage of innovation for several years. Several pain points have made it difficult for organizations to manage their data efficiently and create actual value.

Analytics 243

Analytics Artificial Intelligence Storage Serverless 243

Dynatrace

JULY 6, 2022

Scripts and procedures usually focus on a particular task, such as deploying a new microservice to a Kubernetes cluster, implementing data retention policies on archived files in the cloud, or running a vulnerability scanner over code before it’s deployed. The range of use cases for automating IT is as broad as IT itself.

Artificial Intelligence 198

Artificial Intelligence Tuning Strategy Big Data 198

Dynatrace

DECEMBER 15, 2022

Complex cloud computing environments are increasingly replacing traditional data centers. In fact, Gartner estimates that 80% of enterprises will shut down their on-premises data centers by 2025. ITOps teams are responsible for establishing, maintaining, and growing a reliable, high-performing, and secure IT infrastructure.

Artificial Intelligence 211

Artificial Intelligence DevOps Hardware Virtualization 211

Dynatrace

MARCH 24, 2023

Containers enable developers to package microservices or applications with the libraries, configuration files, and dependencies needed to run on any infrastructure, regardless of the target system environment. And organizations use Kubernetes to run on an increasing array of workloads.

Infrastructure 195

Infrastructure Open Source Operating System Cloud 195

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

JUNE 7, 2021

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices.

Network 325

Network Transportation AWS Cloud 325

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., When a QoS violation is predicted to occur and a culprit microservice located, Seer uses a lower level tracing infrastructure with hardware monitoring primitives to identify the reason behind the QoS violation.

Big Data 45

Big Data Cloud Performance Hardware 45

Dynatrace

APRIL 19, 2023

At Dynatrace Perform 2023 , Ben Rushlo, Business Insights leader at Dynatrace, and Navid Mehdiabadi, BCLC’s APM expert, discuss how the right business insights are crucial to making data-driven decisions and improving business outcomes. “It’s a journey in Dynatrace,” Rushlo said. “Our players just see the frontend.

Entertainment 163

Entertainment Analytics Healthcare Games 163

Dynatrace

APRIL 11, 2023

Log4Shell required many organizations to take devices and applications offline to prevent malicious attackers from gaining access to IT systems and sensitive data. As a result, organizations need to be vigilant in identifying and addressing vulnerabilities to protect their systems and data.

Cloud 195

Cloud DevOps Open Source Retail 195

Dynatrace

JULY 5, 2022

AIOps combines big data and machine learning to automate key IT operations processes, including anomaly detection and identification, event correlation, and root-cause analysis. To achieve these AIOps benefits, comprehensive AIOps tools incorporate four key stages of data processing: Collection. Aggregation.

Artificial Intelligence 295

Artificial Intelligence Cloud Innovation Strategy 295

Uber Engineering

APRIL 5, 2018

Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis.

Systems 109

Systems Big Data Storage Infrastructure 109

ScaleOut Software

JULY 19, 2021

We are increasingly surrounded by intelligent IoT devices, which have become an essential part of our lives and an integral component of business and industrial infrastructures. To address these challenges and countless others like them, we need autonomous, deep introspection on incoming data as it arrives and immediate responses.

IoT 78

IoT Analytics Big Data Architecture 78

All Things Distributed

DECEMBER 20, 2017

How companies can use ideas from mass production to create business with data. In this way, designers are part of an ecosystem in which the functionalities of simulations, data and people come together, enabling them to develop better products faster. Value creation through data. Strategically, IT doesn't matter.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Uber Engineering

DECEMBER 17, 2019

Uber’s busy 2019 included our billionth delivery of an Uber Eats order, 24 million miles covered by bike and scooter riders on our platform, and trips to top destinations such as the Empire State Building, the Eiffel Tower, and the … The post Uber’s Data Platform in 2019: Transforming Information to Intelligence appeared first on Uber Engineering (..)

Engineering 126

Engineering Big Data Infrastructure Analytics 126

Dynatrace

MARCH 14, 2022

Over the past decade, the industry moved from paper-based to electronic health records (EHRs)—digitizing the backbone of patient data. They need automated approaches based on real-time, contextualized data. But the push toward digital experiences was thriving long before the advent of the pandemic. Emerging security threats.

Healthcare 234

Healthcare Artificial Intelligence Innovation Strategy 234

Dynatrace

JUNE 1, 2020

There are many different types of monitoring from APM to Infrastructure Monitoring, Network Monitoring, Database Monitoring, Log Monitoring, Container Monitoring, Cloud Monitoring, Synthetic Monitoring, and End User monitoring. From APM to full-stack monitoring. This is something Dynatrace offers users to make sure monitoring is made easy.

Artificial Intelligence 185

Artificial Intelligence Social Media Monitoring IoT 185

Dynatrace

JUNE 1, 2020

There are many different types of monitoring from APM to Infrastructure Monitoring, Network Monitoring, Database Monitoring, Log Monitoring, Container Monitoring, Cloud Monitoring, Synthetic Monitoring and End User monitoring. From APM to full-stack monitoring. This is something Dynatrace offers users, to make sure monitoring is made easy.

Monitoring 132

Monitoring Performance Social Media Artificial Intelligence 132

Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog.

Efficiency 99

Efficiency Engineering Design Storage 99

Dynatrace

MARCH 11, 2021

In the fourth part of the series, I’ll show you how I used Dynatrace’s raw problem and event data to find the best fit for optimized anomaly detection settings. I took a big-data-analysis approach, which started with another problem visualization. Statistically analyzing Dynatrace’s event and problem data.

Tuning 265

Tuning Architecture Monitoring Big Data 265

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

The Netflix TechBlog

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. With the latest Data Mesh Platform, data movement in Netflix Studio reaches a new stage.

Big Data 253

Big Data Government Analytics Processing 253

The Netflix TechBlog

MARCH 2, 2021

Stephanie Lane , Wenjing Zheng , Mihir Tendulkar Source credit: Netflix Within the rapid expansion of data-related roles in the last decade, the title Data Scientist has emerged as an umbrella term for myriad skills and areas of business focus. Learning through data is in Netflix’s DNA. It can be hard to know from the outside.

Analytics 207

Analytics C++ Innovation Engineering 207

Dynatrace

OCTOBER 14, 2021

Gartner defines AIOps as the combination of “big data and machine learning to automate IT operations processes, including event correlation, anomaly detection, and causality determination.” training data) that the algorithm can then learn from. Traditional AIOps solutions are built for vendor-agnostic data ingestion.

Artificial Intelligence 221

Artificial Intelligence DevOps Innovation Metrics 221

All Things Distributed

NOVEMBER 5, 2015

This region will provide even lower latency and strong data sovereignty to local users. We are committed to meeting our customers’ increasing needs for capacity and for powerful AWS services that eliminate the heavy lifting of the underlying IT infrastructure -- allowing them to focus more of their precious resources on their core business.

AWS 167

AWS Retail Entertainment IoT 167

High Scalability

APRIL 14, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Scalability Engineering 105

High Scalability

MAY 12, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

MARCH 24, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Engineering Big Data 105