article thumbnail

Building an elastic query engine on disaggregated storage

The Morning Paper

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. Snowflake is a data warehouse designed to overcome these limitations, and the fundamental mechanism by which it achieves this is the decoupling (disaggregation) of compute and storage. joins) during query processing. Workload characteristics.

Storage 112
article thumbnail

Virtual consensus in Delos

The Morning Paper

Virtual consensus in Delos , Balakrishnan et al. Back in 2017 the engineering team at Facebook had a problem. If you think of this a bit like mapping memory addresses to data in memory, then another parallel comes to mind: the virtual address space. We propose the novel abstraction of a virtual shared log (or VirtualLog).

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Netflix Cloud Packaging in the Terabyte Era

The Netflix TechBlog

From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step. Since not all projects are terabytes projects, allocating the largest cloud storage to all packager instances is not an efficient use of cloud resources.

Cloud 237
article thumbnail

AWS EC2 Virtualization 2017: Introducing Nitro

Brendan Gregg

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. It's an exciting development in cloud computing: hardware virtualization is now fast. That's deliberate engineering: optimizing the most important workloads first.

article thumbnail

What is log analytics? How a modern observability approach provides critical business insight

Dynatrace

Log analytics is useful for application performance monitoring in cloud, virtualized, and physical environments, including Kubernetes workloads, application security, and business analytics. Cold storage and rehydration. Cold storage and rehydration. This is also known as root-cause analysis. Better-quality code.

Analytics 223
article thumbnail

What Is a Workload in Cloud Computing

Scalegrid

Various forms can take shape when discussing workloads within the realm of cloud computing environments – examples include order management databases, collaboration tools, videoconferencing systems, virtual desktops, and disaster recovery mechanisms. Storage is a critical aspect to consider when working with cloud workloads.

Cloud 130
article thumbnail

What is log analytics? How a modern observability approach provides critical business insight

Dynatrace

Log analytics is useful for application performance monitoring in cloud, virtualized, and physical environments, including Kubernetes workloads, application security, and business analytics. Cold storage and rehydration. Cold storage and rehydration. This is also known as root-cause analysis. Better-quality code.

Analytics 190