Dynatrace

FEBRUARY 16, 2023

As teams try to gain insight into this data deluge, they have to balance the need for speed, data fidelity, and scale with capacity constraints and cost. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022. And without the encumbrances of traditional databases, Grail performs fast. “In

Analytics 191

Analytics Innovation Metrics Database 191

Dynatrace

MARCH 11, 2021

In the fourth part of the series, I’ll show you how I used Dynatrace’s raw problem and event data to find the best fit for optimized anomaly detection settings. I took a big-data-analysis approach, which started with another problem visualization. Statistically analyzing Dynatrace’s event and problem data.

Tuning 264

Tuning Architecture Monitoring Big Data 264

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer uses a lightweight RPC-level tracing system to collect request traces and aggregate them in a Cassandra database. ASPLOS’19. Seer also works best when making prediction 10-100ms into the future.

Big Data 45

Big Data Cloud Performance Hardware 45

The Netflix TechBlog

MARCH 25, 2019

In the push model paradigm, various platform tools such as the data transportation layer, reporting tools, and Presto will publish lineage events to a set of lineage related Kafka topics, therefore, making data ingestion relatively easy to scale improving scalability for the data lineage system.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The best they can usually do in real-time using general purpose tools is to filter and look for patterns of interest.

IoT 78

IoT Analytics Big Data Architecture 78

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. And I’m sure we’ve all experienced frustration when an application crashes, is slow to load, or doesn’t load at all.

Artificial Intelligence 184

Artificial Intelligence Social Media Monitoring IoT 184

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

The Morning Paper

OCTOBER 26, 2020

As a production system within Microsoft capturing around a quadrillion events and indexing 16 trillion search keys per day it would be interesting in its own right, but there’s a lot more to it than that. it’s getting much more complex and expensive to process, store, and secure potentially sensitive data.

Cloud 104

Cloud Big Data Latency Architecture 104

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. And I’m sure we’ve all experienced frustration when an application crashes, is slow to load, or doesn’t load at all.

Monitoring 132

Monitoring Performance Social Media Artificial Intelligence 132

Dynatrace

APRIL 11, 2023

The focus on bringing various organizational teams together—such as development, business, and security teams — makes sense as observability data, security data, and business event data coalesce in these cloud-native environments. Only 27% of those CIOs say their teams fully adhere to a DevOps culture.

Cloud 192

Cloud DevOps Open Source Retail 192

The Netflix TechBlog

OCTOBER 15, 2019

Beyond data synchronization, some applications also need to enrich their data by calling external services. Delta is an eventual consistent, event driven, data synchronization and enrichment platform. CDC (Change-Data-Capture) events are sent by the Delta-Connector to a Keystone Kafka topic.

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

DECEMBER 21, 2020

These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing. Other than these principles, there are some other design considerations to support and enable: Multi-tenancy with database and table prioritization. Transparency to end-users.

Storage 203

Storage Latency Efficiency Data Engineering 203

Abhishek Tiwari

DECEMBER 27, 2017

ETL refers to extract, transform, load and it is generally used for data warehousing and data integration. ETL is a product of the relational database era and it has not evolved much in last decade. There are several emerging data trends that will define the future of ETL in 2018. Machine learning meets data integration.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

All Things Distributed

SEPTEMBER 26, 2014

We’re at 925 Market Street and our doors will be open 10AM to 6PM on weekdays, with select events running until 8PM on weeknights. Be sure to check the calendar regularly as new evening events will be added regularly. What’s Happening at the AWS Loft. AWS Technical Bootcamps.

AWS 111

AWS Games Education Innovation 111

Abhishek Tiwari

DECEMBER 22, 2017

Cheap storage and on-demand compute in the cloud coupled with the emergence of new big data frameworks and tools are forcing us to rethink the whole ETL and data warehousing architecture. Then we perform frequent batch ETL from application databases to a data warehouse. Classic ETL. Late transformation.

Big Data 40

Big Data Retail Storage Google 40

All Things Distributed

JULY 16, 2012

It is shaping up to be a great event with many Amazonians, partners and customers presenting in well over 150 sessions. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega.

AWS 83

AWS Big Data Media Storage 83

All Things Distributed

JUNE 20, 2017

Beyond running their web properties and applications, Next Digital also uses Amazon RDS (database), Amazon ElastiCache (caching), and Amazon Redshift (data warehousing). I'm excited to see the new and innovative use cases coming from our customers in Hong Kong and across Asia Pacific, all enabled by AWS.

AWS 146

AWS Logistics Cloud Social Media 146

Highly Scalable

MARCH 1, 2012

NoSQL databases are often compared by various non-functional criteria, such as scalability, performance, and consistency. At the same time, NoSQL data modeling is not so well studied and lacks the systematic theory found in relational databases. Document databases advance the BigTable model offering two significant improvements.

Database 279

Database Ecommerce Efficiency Engineering 279

SQL Server According to Bob

FEBRUARY 15, 2018

I have the blessed opportunity to speak at many customer events. Microsoft engineering is actually sending quite a few folks over the Atlantic to come talk about SQL Server 2017, SQL Server on Linux, GDPR, Performance, Security, Azure Data Lake, Azure SQL Database, Azure SQL Data Warehouse, and Azure CosmosDB.

Engineering 40

Engineering Azure Best Practices Servers 40

The Morning Paper

SEPTEMBER 19, 2019

MongoDB is an important database, and this paper explains the tunable (per-operation) consistency models that MongoDB provides and how they are implemented under the covers. Microsoft have a paper describing their new recovery mechanism in Azure SQL Database , the key feature being that it can recovery in constant time.

Blockchain 46

Blockchain Hardware Google Analytics 46

ScaleOut Software

APRIL 3, 2020

The real-time digital twin software tracks and updates this information using incoming messages whenever significant events affecting the ventilator occur, such as when it moves from place to place, is put in use, becomes available, encounters a mechanical issue, has an expected repair time, etc.

Logistics 52

Logistics Analytics Scalability Cloud 52

ScaleOut Software

APRIL 3, 2020

The real-time digital twin software tracks and updates this information using incoming messages whenever significant events affecting the ventilator occur, such as when it moves from place to place, is put in use, becomes available, encounters a mechanical issue, has an expected repair time, etc.

Logistics 52

Logistics Analytics Scalability Cloud 52

All Things Distributed

JULY 3, 2011

Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events.

AWS 67

AWS Storage Big Data Cloud 67

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. We’ve seen similar high marshalling overheads in big data systems too.) Fetching too much data in a single query (i.e.,

Cache 79

Cache Latency Google Lambda 79

Brendan Gregg

APRIL 30, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. LISA is a vendor-neutral event known for technical depth and rigor, and continues to attract an audience of seasoned professionals. Join us for 3 days in Nashville at LISA'18. Post by Brendan Gregg and Rikki Endsley. Hope to see you in Nashville!

DevOps 43

DevOps Network Best Practices Programming 43

Brendan Gregg

APRIL 29, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. LISA is a vendor-neutral event known for technical depth and rigor, and continues to attract an audience of seasoned professionals. Join us for 3 days in Nashville at LISA'18. Post by Brendan Gregg and Rikki Endsley. Hope to see you in Nashville!

DevOps 40

DevOps Network Best Practices Programming 40

Highly Scalable

MAY 1, 2012

Let us start with a simple example that illustrates capabilities of probabilistic data structures: Let us have a data set that is simply a heap of ten million random integer values and we know that it contains not more than one million distinct values (there are many duplicates). what is the cardinality of the data set)?

Analytics 191

Analytics Traffic Big Data Efficiency 191

All Things Distributed

SEPTEMBER 30, 2010

The AWS Events team is organizing a number of events where I will present together with a number of AWS customers: AWS Cloud Computing Event in Berlin on October 7 with AWS customers moviepilot , Cellular , Schnee von morgen and Plinga. In India there will be 3 AWS Cloud Computing events. Countdown to What is Next in AWS.

AWS 75

AWS Storage Cloud Best Practices 75

Highly Scalable

MARCH 10, 2015

The demand on a given product depends on many factors including a product’s own properties such as price or brand, prices of competing products in the category, sales events, and even the weather. This model can be adjusted to a retailer’s business use cases by adding more explanatory variables such as marketing events. Sale events.

Retail 152

Retail C++ Analytics Metrics 152