DZone

JULY 17, 2023

Apache Spark is a leading platform in the field of big data processing, known for its speed, versatility, and ease of use. Understanding Apache Spark Apache Spark is a unified computing engine designed for large-scale data processing. However, getting the most out of Spark often involves fine-tuning and optimization.

Big Data 130

Big Data Performance Open Source Tuning 130

Dynatrace

MAY 1, 2023

Then, big data analytics technologies, such as Hadoop, NoSQL, Spark, or Grail, the Dynatrace data lakehouse technology, interpret this information. Here are the six steps of a typical ITOA process : Define the data infrastructure strategy. Why use a data lakehouse for causal AI? Why is ITOA important? Apache Spark.

Analytics 181

Analytics Artificial Intelligence Big Data Open Source 181

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I developed many batch and real-time data pipelines using open source technologies for AOL Advertising and eBay.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Dynatrace

JANUARY 16, 2023

Open-source software drives a vibrant Kubernetes ecosystem. Open source software drives a vibrant Kubernetes ecosystem. Across all categories in the Kubernetes survey, open source projects rank among the most frequently used solutions. Dynatrace’s investment in open source technologies keeps growing.

Open Source 337

Open Source Java Operating System Programming 337

DZone

DECEMBER 21, 2020

Applications used in the field of Big Data process huge amounts of information, and this often happens in real time. Naturally, such applications must be highly reliable so that no error in the code can interfere with data processing. It is an open-source framework for distributed processing of large amounts of data.

Code 150

Code Java Big Data Open Source 150

DZone

JULY 29, 2019

In today's world, data is generated in high volumes and to make something out of it, extracted data is needed to be transformed, stored, maintained, governed and analyzed. These processes are only possible with a distributed architecture and parallel processing mechanisms that Big Data tools are based on.

Big Data 157

Big Data Government Open Source Storage 157

Dynatrace

MARCH 24, 2023

Originally created by Google, Kubernetes was donated to the CNCF as an open source project. Originally developed as a research project at the University of California, Berkeley, in 2009, Mesos launched formally as a mature product in 2016 under the auspices of the Apache Software Foundation, a decentralized open source community.

Infrastructure 179

Infrastructure Open Source Operating System Cloud 179

Dynatrace

APRIL 11, 2023

Open source software is likewise playing a larger role in cloud computing, which brings benefits and dilemmas: bad actors have ready access to open source software and can identify new vulnerabilities to exploit. This means that attackers may have already gained access to sensitive information or compromised the system.

Cloud 180

Cloud DevOps Open Source Retail 180

Scalegrid

MARCH 28, 2024

This article will explore how they handle data storage and scalability, perform in different scenarios, and, most importantly, how these factors influence your choice. Redis Revealed: An Overview Redis, a renowned open-source, in-memory remote dictionary server, stands out for its diverse data structures and advanced features.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

JULY 5, 2022

AIOps combines big data and machine learning to automate key IT operations processes, including anomaly detection and identification, event correlation, and root-cause analysis. As cloud-native technologies evolve, organizations layer in more tools and open source solutions to solve specific problems and provide specific benefits.

Artificial Intelligence 278

Artificial Intelligence Cloud Innovation Strategy 278

Dynatrace

JULY 6, 2020

Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. See the health of your big data resources at a glance. It enables you to use popular open-source frameworks such as Hadoop, Spark, and Kafka in Azure cloud environments.

Azure 145

Azure Cloud Big Data Virtualization 145

Dynatrace

FEBRUARY 16, 2023

As teams try to gain insight into this data deluge, they have to balance the need for speed, data fidelity, and scale with capacity constraints and cost. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022. Open source solutions are also making tracing harder.

Analytics 179

Analytics Innovation Metrics Database 179

The Morning Paper

OCTOBER 26, 2020

Helios also serves as a reference architecture for how Microsoft envisions its next generation of distributed big-data processing systems being built. What follows is a discussion of where big data systems might be heading, heavily inspired by the remarks in this paper, but with several of my own thoughts mixed in.

Cloud 104

Cloud Big Data Latency Architecture 104

Percona

JANUARY 19, 2023

ProxySQL: It is a feature-rich open-source MySQL proxy solution, that allows query routing for the most common MySQL architectures (PXC/Galera, Replication, Group Replication, etc.). Note that it requires some handling on the application as it doesn’t support the merging and data retrieval from multiple shards.

Open Source 91

Open Source Storage Database Big Data 91

ACM Sigarch

APRIL 8, 2019

big-data processing, machine learning, quantum computing, and so on). Communities in other fields have made a substantial effort towards “democratization,” where tools are not just made open source, but also accessible to everyone. For those of us who pursued computer architecture as a career, this is well understood.

Architecture 74

Architecture Open Source Hardware Software Engineering 74

O'Reilly

AUGUST 15, 2023

Back in the early 2000s, a widely quoted survey reported that CIOs almost unanimously said that their IT organizations weren’t making use of open source. We suspect this estimate is lowballing Copilot’s actual usage. How little they knew! Actual usage of Copilot, ChatGPT, and similar tools is likely to be much higher than 33%.

Development 73

Development Programming Speed Open Source 73

Abhishek Tiwari

DECEMBER 22, 2017

Cheap storage and on-demand compute in the cloud coupled with the emergence of new big data frameworks and tools are forcing us to rethink the whole ETL and data warehousing architecture. This type of analysis is greatly eased by open source tools such RStudio, Jupyter, Zeppelin along with scripting languages R and Python.

Big Data 40

Big Data Retail Storage Google 40

Rigor

SEPTEMBER 11, 2019

Sergey is an open source developer, tireless educator on performance topics, and author of many web performance-related tools, including ShowSlow , SVN Assets , drop-in.htaccess and more. He tweets about Chrome initiatives, open source tools, and performance news @ paul_irish. Scott Jehl. Scott Jehl. Yoav Weiss.

Performance 89

Performance Education Google Website 89

All Things Distributed

SEPTEMBER 6, 2013

Shell leverages AWS for big data analytics to help achieve these goals. The company has used AWS to build an IT innovation zone, based upon open source products, which is being used to launch new innovations for customers like E-Mobility and E-thermostat products with a very fast time-to-market.

Cloud 129

Cloud Energy AWS Healthcare 129

The Netflix TechBlog

APRIL 29, 2019

We use and contribute to many open-source Python packages, some of which are mentioned below. We’ve had a number of successful Python open sources, including Security Monkey (our team’s most active open source project). If any of this interests you, check out the jobs site or find us at PyCon.

Open Source 279

Open Source Network Infrastructure Big Data 279

The Netflix TechBlog

JULY 26, 2021

Instead they just need to configure the pipeline topology in the UI while getting other features like schema evolution and secure data access out of the box. Operational Reporting Pipeline Example Iceberg Sink Apache Iceberg is an open source table format for huge analytics datasets. Currently Iceberg sink is appended only.

Big Data 253

Big Data Government Analytics Processing 253

KeyCDN

OCTOBER 2, 2018

It’s awesome for discovering how grid systems, CSS animation, Big Data, etc all play roles in real-world web design. Ariya Ariya Hidayat, the author of this blog, maintains two well-known open source projects (PhantomJS and Esprima). Be sure to check it out if your dev process needs a creative kick in the pants.

Development 75

Development Website Design Code 75

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

FEBRUARY 16, 2021

After evaluating multiple open-source and commercial rule evaluation frameworks, we chose our internal Rules Management and Evaluation Framework?—?Hendrix. Building a scalable SKU catalog platform that allowed for rapid changes with the minimal intervention was challenging.

Mobile 209

Mobile Engineering Infrastructure Scalability 209

O'Reilly

SEPTEMBER 19, 2023

Each time, the underlying implementation changed a bit while still staying true to the larger phenomenon of “Analyzing Data for Fun and Profit.” ” They weren’t quite sure what this “data” substance was, but they’d convinced themselves that they had tons of it that they could monetize.

Hardware 99

Hardware Storage Big Data Blockchain 99