Remove Efficiency Remove Network Remove Storage Remove Tuning
article thumbnail

Optimizing data warehouse storage

The Netflix TechBlog

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203
article thumbnail

Dynatrace Kubernetes Observability for Persistent Volume Claims

Dynatrace

For example, let’s say you have an idea for a new social network and decide to use Kubernetes as your container management platform. You quickly realize that it will take ages to fill up the overprovisioned database storage. Unexpectedly, a famous influencer notices your social network and promotes it all over their other channels.

Storage 193
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

PostgreSQL Indexes Can Hurt You: Negative Effects and the Costs Involved

Percona

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning 123
article thumbnail

Netflix Cloud Packaging in the Terabyte Era

The Netflix TechBlog

Figure 1: A Simplified Video Processing Pipeline With this architecture, chunk encoding is very efficient and processed in distributed cloud computing instances. From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step.

Cloud 237
article thumbnail

Building In-Video Search

The Netflix TechBlog

To train these parameters as well as fine-tune the pretrained image-text model weights, we leverage in-house datasets that pair shots of varying durations with rich textual descriptions of their content. The embedding computation is based on a large neural network model and has to be run on GPUs for optimal throughput.

Media 225
article thumbnail

Observability engineering: Getting Prometheus metrics right for Kubernetes with Dynatrace and Kepler

Dynatrace

This challenge has given rise to the discipline of observability engineering, which concentrates on the details of telemetry data to fine-tune observability use cases. But often, we use additional services and solutions within our environment for backups, storage, networking, and more. Observability engineering success!

Metrics 183
article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.