Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog.

Efficiency 103

Efficiency Engineering Design Storage 103

All Things Distributed

AUGUST 18, 2011

Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud. However, this cannot be done without efficient, scalable data analytics.

Big Data 111

Big Data Analytics AWS Cloud 111

Uber Engineering

JANUARY 15, 2020

Uber leverages real-time analytics on aggregate data to improve the user experience across our products, from fighting fraudulent behavior on Uber Eats to forecasting demand on our platform. .

Engineering 119

Engineering Analytics Big Data Database 119

Dynatrace

OCTOBER 25, 2022

Mike Gualtieri of Forrester Research, who coined the term NoOps , once said in his blog post, “NoOps means that application developers will never have to speak with an operations professional again.”. Traditional AIOps uses machine-learning models to deliver data to dashboards using aggregation and correlation.

DevOps 217

DevOps Big Data Cloud Innovation 217

Uber Engineering

DECEMBER 17, 2019

Uber’s busy 2019 included our billionth delivery of an Uber Eats order, 24 million miles covered by bike and scooter riders on our platform, and trips to top destinations such as the Empire State Building, the Eiffel Tower, and the … The post Uber’s Data Platform in 2019: Transforming Information to Intelligence appeared first on Uber Engineering (..)

Engineering 130

Engineering Big Data Infrastructure Analytics 130

Dynatrace

JULY 6, 2022

Scripts and procedures usually focus on a particular task, such as deploying a new microservice to a Kubernetes cluster, implementing data retention policies on archived files in the cloud, or running a vulnerability scanner over code before it’s deployed. The range of use cases for automating IT is as broad as IT itself.

Artificial Intelligence 188

Artificial Intelligence Tuning Strategy Big Data 188

Dynatrace

OCTOBER 4, 2022

Several pain points have made it difficult for organizations to manage their data efficiently and create actual value. Limited data availability constrains value creation. Modern IT environments — whether multicloud, on-premises, or hybrid-cloud architectures — generate exponentially increasing data volumes.

Analytics 235

Analytics Artificial Intelligence Storage Serverless 235

KeyCDN

OCTOBER 2, 2018

Reading and following the right web development blogs makes it much easier to get a solid education. That’s why in this post, we’ve compiled a list of the top web development blogs that will help you find your footing and acquire essential skills in modern web dev. Visit website 3. Visit website 5. Visit website 9.

Development 75

Development Website Design Code 75

Uber Engineering

DECEMBER 10, 2019

Michelangelo , Uber’s machine learning (ML) platform, powers machine learning model training across various use cases at Uber, such as forecasting rider demand , fraud detection , food discovery and recommendation for Uber Eats , and improving the accuracy of … The post Productionizing Distributed XGBoost to Train Deep Tree Models with Large (..)

Engineering 108

Engineering Big Data Architecture 108

Dynatrace

APRIL 21, 2021

The Business Insights team at Dynatrace has been working with our largest Digital Experience Monitoring customers to help them turn the Core Web Vitals data they’re collecting with Dynatrace into actionable insights they can use to optimize pages ahead of this June 2021 change in Google’s search ranking algorithm. 28-day lookbacks.

Traffic 263

Traffic Metrics Mobile Analytics 263

Uber Engineering

APRIL 5, 2018

Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis.

Systems 109

Systems Big Data Storage Infrastructure 109

Highly Scalable

MARCH 1, 2012

At the same time, NoSQL data modeling is not so well studied and lacks the systematic theory found in relational databases. In this article I provide a short comparison of NoSQL system families from the data modeling point of view and digest several common modeling techniques.

Database 279

Database Ecommerce Efficiency Engineering 279

Testsigma

MAY 26, 2021

In today’s world where ‘data is the new oil’ ( as said by Clive Humby), not giving proper attention to data-driven testing is not justified. If you have an application that needs data input in some form then it will require data-driven testing. The data repository could be a CSV file, excel sheet, DB table, etc.

Testing 70

Testing Healthcare Performance Testing Website 70

Dynatrace

SEPTEMBER 15, 2020

Without automation, Performance engineers and developers can no longer ensure that applications perform as planned, and costs are minimized.”. After every experiment run Akamas changes application, runtime, database or cloud configuration based on monitoring data it captured during the previous experiment run.

Performance 186

Performance Java Metrics Cloud 186

Dynatrace

JULY 6, 2020

Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. See the health of your big data resources at a glance. Azure HDInsight supports a broad range of use cases including data warehousing, machine learning, and IoT analytics.

Azure 147

Azure Cloud Big Data Virtualization 147

Dynatrace

JUNE 29, 2022

Hybrid cloud architecture is a computing environment that shares data and applications on a combination of public clouds and on-premises private clouds. A hybrid cloud, however, combines public infrastructure and services with on-premises resources or a private data center to create a flexible, interconnected IT environment.

Infrastructure 182

Infrastructure Cloud Azure AWS 182

Dynatrace

JUNE 1, 2020

With our AI engine, Davis, at the core Dynatrace provides precise answers in real-time. Trying to manually keep up, configure, script and source data is beyond human capabilities and today everything must be automated and continuous. Some customers even say, having Davis is like having a whole team of engineers on their side.

Artificial Intelligence 183

Artificial Intelligence Social Media Monitoring IoT 183

Testsigma

JULY 14, 2020

According to Wikipedia, Data-Driven Testing(DDT) is a software testing methodology that is used in the testing of computer software to describe testing done using a table of conditions directly as test inputs and verifiable outputs as well as the process where test environment settings and control are not hard-coded. Database tables.

Testing 63

Testing Artificial Intelligence DevOps Big Data 63

Percona

JANUARY 19, 2023

16 years ago, our founder Peter Zaitsev covered this topic and some of the points described there are still valid, and we will cover more on this blog. With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance.

Open Source 91

Open Source Storage Database Big Data 91

Dynatrace

MARCH 14, 2022

Over the past decade, the industry moved from paper-based to electronic health records (EHRs)—digitizing the backbone of patient data. They need automated approaches based on real-time, contextualized data. The post AIOps observability adoption ascends in healthcare appeared first on Dynatrace blog. Emerging security threats.

Healthcare 227

Healthcare Artificial Intelligence Innovation Strategy 227

All Things Distributed

SEPTEMBER 5, 2013

Over the past few years, two important trends that have been disrupting the database industry are mobile applications and big data. The explosive growth in mobile devices and mobile apps is generating a huge amount of data, which has fueled the demand for big data services and for high scale databases.

Big Data 98

Big Data Mobile Latency Database 98

Dynatrace

OCTOBER 14, 2021

Gartner defines AIOps as the combination of “big data and machine learning to automate IT operations processes, including event correlation, anomaly detection, and causality determination.” But what is AIOps, exactly? And how can it support your organization? What is AIOps?

Artificial Intelligence 212

Artificial Intelligence DevOps Innovation Metrics 212

Dynatrace

JUNE 1, 2020

With our AI engine, Davis, at the core Dynatrace provides precise answers in real-time. Trying to manually keep up, configure, script and source data is beyond human capabilities and today everything must be automated and continuous. Some customers even say, having Davis is like having a whole team of engineers on their side.

Monitoring 132

Monitoring Performance Social Media Artificial Intelligence 132

All Things Distributed

OCTOBER 7, 2015

We live in a world where massive volumes of data are generated from websites, connected devices and mobile apps. In such a data intensive environment, making key business decisions such as running marketing and sales campaigns, logistic planning, financial analysis and ad targeting require deriving insights from these data.

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

NOVEMBER 15, 2016

Previously, I wrote about Amazon QuickSight , a new service targeted at business users that aims to simplify the process of deriving insights from a wide variety of data sources quickly, easily, and at a low cost. Put simply, data is not always readily available and accessible to organizational end users. Enter Amazon QuickSight.

Analytics 152

Analytics Availability Media Social Media 152

DZone

AUGUST 4, 2022

In this blog, I will discuss the availability of Spark-Radiant 1.0.4, Spark-Radiant will help optimize performance and cost considering catalyst optimizer rules, enhance auto-scaling in Spark, collect important metrics related to a Spark job, Bloom filter index in Spark, etc. Spark-Radiant is now available and ready to use.

Performance 246

Performance Metrics Availability Big Data 246

Uber Engineering

OCTOBER 30, 2018

Cluster management, a common software infrastructure among technology companies, aggregates compute resources from a collection of physical hosts into a shared resource pool, amplifying compute power and allowing for the flexible use of data center hardware.

Hardware 103

Hardware Infrastructure Engineering Technology 103

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Uber Engineering

OCTOBER 30, 2018

Cluster management, a common software infrastructure among technology companies, aggregates compute resources from a collection of physical hosts into a shared resource pool, amplifying compute power and allowing for the flexible use of data center hardware.

Hardware 62

Hardware Infrastructure Engineering Technology 62

All Things Distributed

APRIL 27, 2011

Given that I have frequently written about many of these technologies on this blog I asked investor relations to be allowed to reprint it here. To our shareowners: Random forests, naïve Bayesian estimators, RESTful services, gossip protocols, eventual consistency, data sharding, anti-entropy, Byzantine quorum, erasure coding, vector clocks.

Technology 151

Technology Technology AWS Storage 151

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

ACM Sigarch

APRIL 8, 2019

big-data processing, machine learning, quantum computing, and so on). Lena Olson is a Software Engineer at Google. . Disclaimer: Newsha is a Research Scientist at Baidu and Lena is a Software Engineer at Google. For those of us who pursued computer architecture as a career, this is well understood.

Architecture 74

Architecture Open Source Hardware Software Engineering 74

All Things Distributed

AUGUST 20, 2012

It requires substantial upfront capital investments in cold data storage systems such as tape robots and tape libraries, then thereâ??s In Amazon Glacier data is stored as archives, which are uploaded to Glacier and organized in vaults, which customers can control access to using the AWS Identity and Access Management (IAM) service.

Storage 122

Storage Cloud AWS Media 122

Testsigma

FEBRUARY 12, 2021

When more companies transition into digital-first projects, there must be an expanded number of processes and IT data departments to keep IT teams on track. According to Gartner, the greatest technological developments in 2021 will influence the future from technology affecting how people operate, to AI engineering and hyperautomation.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

All Things Distributed

DECEMBER 8, 2016

AWS data centers in Canada will draw from a regional electricity grid that is 99 percent powered by hydropower. It adopted Amazon Redshift, Amazon EMR and AWS Lambda to power its data warehouse, big data, and data science applications, supporting the development of product features at a fraction of the cost of competing solutions.

AWS 155

AWS Cloud Lambda Innovation 155

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

Rigor

JANUARY 13, 2020

When it comes to web content, you can easily find what you need through many different paths, from search engines and social media to playlists and blogs, jumping from one source to another with just a tap of a finger. It's packed with useful, real world hints and tips that you can use on your sites today. Building Progressive Apps.

Performance 75

Performance Social Media Website Website Performance 75