article thumbnail

Designing Instagram

High Scalability

FUN FACT : In this talk , Rodrigo Schmidt, director of engineering at Instagram talks about the different challenges they have faced in scaling the data infrastructure at Instagram. We will use a graph database such as Neo4j to store the information. Sample Queries supported by Graph Database. System Components. API Design.

Design 334
article thumbnail

How It Works: SQL Server Lock Partitioning

SQL Server According to Bob

A handful of lock types (Database, Metadata, LOGIN_STATS, …) are eligible for lock partitioning. For example: When ‘use database’ takes place the session acquires a shared lock on database. Only distinct changes require an exclusive database lock, for example a drop database.

Servers 103
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Cloudy with a high chance of DBMS: a 10-year prediction for enterprise-grade ML

The Morning Paper

Many of the software engineering discipline and controls need to be brought over into an ML context. Flock treats ML models as software artefacts derived from data. Models themselves must be subject to scrutiny with their storage and querying/scoring secured and auditable. Data management.

article thumbnail

How It Works (It Just Runs Faster): Non-Volatile Memory SQL Server Tail Of Log Caching on NVDIMM

SQL Server According to Bob

There are two ways to take advantage of non-volatile storage (NVDIMM) for SQL Server (Direct access or Block Device storage.). Block storage is what you think of today as disk access. Create / Alter Database … LOG ON. SQL Server 2016 is designed to detect non-volatile storage devices. Tail Of Log Caching.

Cache 40
article thumbnail

New Metadata-Only Column Changes in SQL Server 2016

SQL Performance

Depending on the type of change and the configuration of the database, an ALTER COLUMN command will need to perform one of the following actions: Change metadata in system tables only. Particular care is needed when altering a string column that has a collation not matching the default for the database. Test2 ; GO. CREATE TABLE dbo.

Servers 63
article thumbnail

Conducting log analysis with an observability platform and full data context

Dynatrace

Causal AI—which brings AI-enabled actionable insights to IT operations—and a data lakehouse, such as Dynatrace Grail , can help break down silos among ITOps, DevSecOps, site reliability engineering, and business analytics teams. ” In many cases, indexed databases only provide access to a sample of statistical data summaries.

Analytics 186
article thumbnail

Futzing and moseying: interviews with professional data analysts on exploration practices

The Morning Paper

Software engineering for machine learning ’), is the lack of documentation, metadata, and provenance. Only 18 of the 30 participants mentioned using databases and related tools (that statement caused a significant recalibration in my mind, I would have guessed much closer to 100%!). SQL databases and spreadsheets (of course!!)