Dynatrace

JANUARY 11, 2023

As cloud and big data complexity scales beyond the ability of traditional monitoring tools to handle, next-generation cloud monitoring and observability are becoming necessities for IT teams. Database monitoring. This ensures the database queries are performant, while also identifying host problems. Website monitoring.

Cloud 222

Cloud Monitoring Best Practices Infrastructure 222

Dynatrace

JANUARY 16, 2023

The strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform. Strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Java, Go, and Node.js

Open Source 343

Open Source Java Operating System Programming 343

Dynatrace

APRIL 20, 2023

-based financial services group, discussed how the bank uses log monitoring on the Dynatrace platform with an emphasis on observability and security data. To grasp the challenges of multifeatured, cross-team cooperation dealing with observability data, consider the content of the logs generated. But what about value versus cost?

Analytics 187

Analytics Infrastructure Storage Efficiency 187

All Things Distributed

AUGUST 18, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud.

Big Data 112

Big Data Analytics AWS Cloud 112

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The best they can usually do in real-time using general purpose tools is to filter and look for patterns of interest.

IoT 78

IoT Analytics Big Data Architecture 78

ScaleOut Software

NOVEMBER 24, 2020

Real-Time Digital Twins Can Add Important New Capabilities to Telematics Systems and Eliminate Scalability Bottlenecks. The volume of incoming telemetry challenges current telematics systems to keep up and quickly make sense of all the data. The results of batch analysis are typically produced after an hour’s delay or more.

Analytics 52

Analytics Architecture Scalability Software Architecture 52

Percona

JANUARY 14, 2019

What if we use ClickHouse (which is a columnar analytical database) as our main datastore? Well, typically, an analytical database is not a replacement for a transactional or key/value datastore. However, ClickHouse is super efficient for timeseries and provides “sharding” out of the box (scalability beyond one node).

Database 40

Database Analytics Blockchain Healthcare 40

Highly Scalable

MARCH 1, 2012

NoSQL databases are often compared by various non-functional criteria, such as scalability, performance, and consistency. At the same time, NoSQL data modeling is not so well studied and lacks the systematic theory found in relational databases. The second one is database-managed indexes, at least in some implementations.

Database 279

Database Ecommerce Efficiency Engineering 279

The Morning Paper

JUNE 23, 2019

Factor VI in the 12-factor app manifesto , “Execute the app as one or more stateless processes,” to be dropped and replaced with “Execute the app as one or more stateful processes.” session state that you want to survive an application process crash), and to keep the application server/services layer stateless.

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. ITAR is the International Traffic in Arms Regulatory framework which stipulates for example that data must be stored in an environment where physical and logical access is restricted to US Persons. Government and Big Data. All Things Distributed.

AWS 113

AWS Government Big Data Cloud 113

The Morning Paper

SEPTEMBER 19, 2019

MongoDB is an important database, and this paper explains the tunable (per-operation) consistency models that MongoDB provides and how they are implemented under the covers. Microsoft have a paper describing their new recovery mechanism in Azure SQL Database , the key feature being that it can recovery in constant time.

Blockchain 46

Blockchain Hardware Google Analytics 46

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. These questions can be answered using the latest data as it streams in from the field. What are real-time digital twins and why are they useful here?

Logistics 52

Logistics Analytics Scalability Cloud 52

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. These questions can be answered using the latest data as it streams in from the field. What are real-time digital twins and why are they useful here?

Logistics 52

Logistics Analytics Scalability Cloud 52

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. If you have a largely static site you can rely on the enormous power of S3 to make serving your content highly scalable and storing it extremely durable. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

Servers 126

Servers Social Media AWS Website 126

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Spot Instances are ideal for use cases like web and data crawling, financial analysis, grid computing, media transcoding, scientific research, and batch processing. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 87

AWS Storage Cloud Big Data 87

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Cluster Compute Instances for Amazon EC2 change the HPC game for two important reasons: Access to scalable on-demand capacity. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed. Comments ().

Cloud 119

Cloud AWS Automotive Latency 119

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. In the traditional boot process, the root partition of the image will be the local disk, which is created and populated at boot time. And the new boot process is significantly faster because a local disk no longer needs to be populated. Comments ().

AWS 60

AWS Storage Operating System Cloud 60

The Netflix TechBlog

MARCH 25, 2019

Central engineering teams provide paved paths (secure, vetted and supported options) and guard rails to help reduce variance in choices available for tools and technologies to support the development of scalable technical architectures. Challenges We faced a diverse set of challenges spread across many layers in the system.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

KeyCDN

OCTOBER 2, 2018

That’s why we’ve compiled an exhaustive list of web development blogs and newsletters to make this process easier. It’s awesome for discovering how grid systems, CSS animation, Big Data, etc all play roles in real-world web design. Be sure to check it out if your dev process needs a creative kick in the pants.

Development 75

Development Website Design Code 75

The Netflix TechBlog

FEBRUARY 16, 2021

To solve the challenges mentioned above and meet our rapidly evolving business needs, we re-architected the legacy SKU catalog from the ground up and partnered with the Growth Engineering team to build a scalable SKU platform. SKUDB: SKU catalog data was migrated from the metadata configuration files to a relational database.

Mobile 209

Mobile Engineering Infrastructure Scalability 209

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Another dimension of scalability to consider is the size of the workflow.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The processed data is typically stored as data warehouse tables in AWS S3. Moving data with Bulldozer at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

DECEMBER 21, 2020

There are several benefits of such optimizations like saving on storage, faster query time, cheaper downstream processing, and an increase in developer productivity by removing additional ETLs written only for query performance improvement. Some of the optimizations are prerequisites for a high-performance data warehouse.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

OCTOBER 7, 2015

However, the data infrastructure to collect, store and process data is geared toward developers (e.g., In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift.

Cloud 138

Cloud Big Data AWS Analytics 138

Highly Scalable

MARCH 10, 2015

More specialized data mining applications like supply chain optimization and fraud detection are out of scope, as well as the implementation details of the data mining process (such as evaluation of model quality). Outputs of this tier can be used to configure downstream processes.

Retail 152

Retail C++ Analytics Metrics 152

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. To do so, weve leaned heavily on the core principles from the distributed systems and database research communities and invented from there. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

Technology 151

Technology Technology AWS Storage 151

All Things Distributed

MARCH 28, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The methods for accessing these objects is also rapidly changing; where in the past you needed a PC or a Laptop to access these objects, now many of our electronic devices have become capable of processing them. Driving down the cost of Big-Data analytics.

AWS 138

AWS Cloud Storage Internet 138

All Things Distributed

FEBRUARY 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. There are a few small pieces of the blogging process that I still need a server for: editing postings, managing comments and to serve search and all of these can easily be run out of a single Amazon EC2 micro instance. All Things Distributed. Comments ().

AWS 134

AWS Website Storage Servers 134

All Things Distributed

FEBRUARY 25, 2011

Werner Vogels weblog on building scalable and robust distributed systems. They had taken the approach that they would not only be offering their software as a scalable multi-tenant product but also as a single tenant environment for customers that want to have their own isolated environment. All Things Distributed. Comments ().

AWS 123

AWS Cloud Scalability Storage 123

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. All Things Distributed. Comments ().

AWS 136

AWS Latency Programming Architecture 136