Uber Engineering

OCTOBER 30, 2018

Cluster management, a common software infrastructure among technology companies, aggregates compute resources from a collection of physical hosts into a shared resource pool, amplifying compute power and allowing for the flexible use of data center hardware.

Hardware 64

Hardware Infrastructure Engineering Technology 64

Percona

JANUARY 19, 2023

You can find more information in this good blog from Marco: MySQL Sharding with ProxySQL Vitess: It is an open source database clustering solution created by PlanetScale that is compatible with the MySQL engine. MyRocks: MyRocks is a storage engine developed by Facebook and made open source. It supports native sharding.

Open Source 89

Open Source Storage Database Big Data 89

Dynatrace

MAY 1, 2023

Additionally, ITOA gathers and processes information from applications, services, networks, operating systems, and cloud infrastructure hardware logs in real time. Then, big data analytics technologies, such as Hadoop, NoSQL, Spark, or Grail, the Dynatrace data lakehouse technology, interpret this information.

Analytics 192

Analytics Artificial Intelligence Big Data Open Source 192

All Things Distributed

SEPTEMBER 6, 2013

Shell leverages AWS for big data analytics to help achieve these goals. Shell''s scientists, especially the geophysicists and drilling engineers, frequently use cloud computing to run models.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Cluster Computer Instances are similar to other Amazon EC2 instances but have been specifically engineered to provide high performance compute and networking.

Cloud 118

Cloud AWS Automotive Latency 118

The Netflix TechBlog

APRIL 29, 2019

Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites. Python has long been a popular programming language in the networking space because it’s an intuitive language that allows engineers to quickly solve networking problems.

Open Source 279

Open Source Network Infrastructure Big Data 279

Dynatrace

JUNE 29, 2022

A hybrid cloud, however, combines public infrastructure and services with on-premises resources or a private data center to create a flexible, interconnected IT environment. Hybrid environments provide more options for storing and analyzing ever-growing volumes of big data and for deploying digital services.

Infrastructure 186

Infrastructure Cloud Azure AWS 186

O'Reilly

SEPTEMBER 19, 2023

Each time, the underlying implementation changed a bit while still staying true to the larger phenomenon of “Analyzing Data for Fun and Profit.” ” They weren’t quite sure what this “data” substance was, but they’d convinced themselves that they had tons of it that they could monetize.

Hardware 98

Hardware Storage Big Data Blockchain 98

All Things Distributed

OCTOBER 7, 2015

However, the data infrastructure to collect, store and process data is geared toward developers (e.g., In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. Big data challenges.

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

APRIL 4, 2017

After finding it cost prohibitive to use colocation centers in local markets where their users are based, iZettle decided to give up hardware. Scania, a world leading manufacturer of commercial vehicles, is using AWS to bring advanced technologies to their trucks, buses, coaches, and diesel engines.

AWS 116

AWS Airlines Latency Games 116

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, we will see new data integration patterns those rely either on a shared high-performance distributed storage interface ( Alluxio ) or a common data format ( Apache Arrow ) sitting between compute and storage. For instance, Alluxio, originally known as Tachyon, can potentially use Arrow as its in-memory data structure.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

The Morning Paper

SEPTEMBER 19, 2019

AliGraph covers Alibaba’s distributed graph engine supporting the development of new GNN applications. Their dataset has about 7B edges… Meanwhile, AnalyticDB is Alibaba’s real-time OLAP RDBMS handling 10PB of data (in excess of 100 trillion rows!). .” Could it be Analyzing efficient stream processing on modern hardware ?

Blockchain 46

Blockchain Hardware Google Analytics 46

All Things Distributed

DECEMBER 12, 2018

million vehicles in more than 75 countries with services like car locator, engine remote start, driving journal, heater start, and stolen vehicle tracking. The first platform is a real time, big data platform being used for analyzing traffic usage patterns to identify congestion and connectivity issues. They support more than 3.3

AWS 124

AWS Cloud Games Serverless 124

All Things Distributed

NOVEMBER 15, 2010

This lead to the birth of the Graphics Processing Unit (GPU) which was focused on providing a very fine grained parallel model, with processing organized in multiple stages, where the data would flow through. Driving down the cost of Big-Data analytics. Introducing the AWS South America (Sao Paulo) Region.

AWS 136

AWS Latency Programming Architecture 136

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. Intel Quick Assist Technology (QAT) was the focus of the QZFS paper which used this new hardware device to speed up file system compression.

Architecture 12

Architecture Hardware Cache Storage 12

All Things Distributed

NOVEMBER 15, 2016

They require companies to provision and maintain complex hardware infrastructure and invest in expensive software licenses, maintenance fees, and support fees that cost upwards of thousands of dollars per user per year. It is the underlying engine that allows QuickSight to deliver blazing fast response times on large data sets.

Analytics 152

Analytics Availability Media Social Media 152

ACM Sigarch

APRIL 8, 2019

big-data processing, machine learning, quantum computing, and so on). This is arguably a fundamentally hard problem for computer architecture, but efforts towards open source hardware (eg. Her current work focuses on hardware/software co-design for extremely large-scale deep learning training. Lack of Diversity.

Architecture 74

Architecture Open Source Hardware Software Engineering 74

All Things Distributed

NOVEMBER 30, 2016

Around 20 years ago, we used machine learning in our recommendation engine to generate personalized recommendations for our customers. The same conversational engine that powers Alexa is now available to any developer, making it easy to bring sophisticated, natural language 'chatbots' to new and existing applications.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165