Expert insights. Personalized for you.
At Logicify , we are proud to be software monitoring geeks. We love to monitor both the apps we develop and the ones we use internally. Not because they are sloppy. Not because we don’t trust our code. MORE
Architecture General Engineering CPU Infrastructure Observability Productivity Reliability Search Infrastructure Storage Uber Eats Velocity MORE
Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Cloud Infrastructure Analysis : Public Cloud vs. On-Premise vs. Hybrid Cloud. Cloud Infrastructure Breakdown by Database. Now, let’s take a look at the cloud infrastructure setup breakdown by database management systems. So, which cloud infrastructure is right for you? Average Number of Database Types Used by Infrastructure. MORE
In Kubernetes environments, operating and successfully running your production applications and microservices requires getting additional insights into your Kubernetes infrastructure including the cluster, nodes, and pods that encapsulate and run the apps. Dynatrace news. MORE
The post The Importance of Validating the Testing Infrastructure appeared first on Abstracta Software Testing Services. Performance Engineering Software Testing Performance Performance Testing test infrastructure MORE
In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. MORE
They were either running their own infrastructure and installing and deploying Brotli everywhere proved non-trivial, or they were using a CDN who didn’t have readily available support for the new algorithm. MORE
One of the quickest wins—and one of the first things I recommend my clients do—to make websites faster can at first seem counter-intuitive: you should self-host all of your static assets, forgoing others’ CDNs/infrastructure. MORE
Here are a few critical ways in which it differs from replication: Analytics Cluster Appliction monitoring Cloning Clustering Database Database Development Database Reporting Database Testing DevOps Follower Cluster MongoDB Monitoring MySQL Postgres Production Data Replication admin analytics best platform cluster clusters database database replication database scalability databases deployment infrastructure mysql mysql cluster mysql load optimization postgresql replication sql testing MORE
Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the Cloud Network Infrastructure to address the identified problems. data-engineering cloud-networking big-data cloud-infrastructure netflix MORE
Architecture Uber Data Big Data Data Analytics Data Platform EoY Infrastructure Product Platform Uber Engineering MORE
As an open source database, it’s a highly popular choice for enterprise applications looking to modernize their infrastructure and reduce their total cost of ownership, along with startup and developer applications looking for a powerful, flexible and cost-effective database to work with. ScaleGrid for PostgreSQL is architectured to leverage-high performance SSD disks on DigitalOcean, and is finely tuned and optimized to achieve the best performance on DigitalOcean infrastructure. MORE
And, this is even more apparent due to the ever-increasing infrastructure complexity enterprises are dealing with. On-demand infrastructure: The ability to deploy infrastructure whenever it’s required. Dynatrace news. MORE
Central engineering teams enable this operational model by reducing the cognitive burden on innovation teams through solutions related to securing, scaling and strengthening (resilience) the infrastructure. All these micro-services are currently operated in AWS cloud infrastructure. MORE
Infrastructure as a service. To begin with, many businesses are going online. They are relying heavily on the cloud to facilitate their clients, which demands to collect, storing, and processing a vast amount of data before it can be presented to the end-user as information. MORE
Architecture Mobile bufferbloat Cronet HTTP/2 HTTP/3 Infrastructure Internet Engineering Task Force mobile engineering QUIC retransmission timeout Transmission Control Protocol Uber MobileUber operates on a global scale across more than 600 cities, with our apps relying entirely on wireless connectivity from over 4,500 mobile carriers. MORE
Mapping micro-services interactions, entities from real time infrastructure, and ML infrastructure and other non traditional data stores are few such examples. MORE
PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today? MORE
Most frameworks have a way to counter this kind of bloat, pushing infrastructure concerns into separate components that can be reused. The 4th item, creating a user, is the whole point of this message handler, but it's buried in a jumble of infrastructure soup! MORE
Gandalf: an intelligent, end-to-end analytics service for safe deployment in cloud-scale infrastructure , Li et al., NSDI’20. Modern software systems at scale are incredibly complex ever changing environments. MORE
Infrastructure exists to support the backing services that are collectively perceived by users to be your web application. Issues that manifest themselves as performance degradation on a user’s device can often be traced back to underlying infrastructure issues. Dynatrace news. MORE
If you’re doing it right, cloud represents a fundamental change in how you build, deliver and operate your applications and infrastructure. And that includes infrastructure monitoring. This also implies a fundamental change to the role of infrastructure and operations teams. MORE
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. MORE
The open source model is not only popular with the developer market, but also enterprise companies looking to modernize their infrastructure and reduce spend. PALO ALTO, Calif., MORE
Before we get into the tutorial hands-on, I would like to mention that this topic is not new. It has been covered in various helpful articles like the ones from TestAutomationGuru. MORE
Architecture Data Store Datastore Design Flask Frontless Go Golang Goroutine Infra Infrastructure Mezzanine NGINX Python Schemaless Sharding Uber Uber Engineering uWSGIIn 2014, Uber Engineering built Schemaless , our fault-tolerant and scalable datastore, to facilitate the rapid growth of our company. For context, we deployed more than 40 Schemaless instances and many thousands of storage nodes in 2016 alone. MORE
Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans. MORE
One of the promises of container orchestration platforms is to make i t easier for the developers to accelerate the deployment of their app lication s without having to worry about scalability and infrastructure dependencies. Dynatrace news. MORE
So that we can expand our coverage of infrastructure-related problems, we plan to work on more built-in infrastructure extensions, available out of the box with Dynatrace. Looking for ways to solve some of your infrastructure-related problems? Dynatrace news. MORE
Architecture CoDel CPU critical request Goroutine graceful degradation Infrastructure Jaeger load management load shedding Memory overload detector QALM QoS Quality of Service ridesharing RPC layer Uber for Business Uber Freight UberFx YARPCMuch of Uber’s business involves connecting people with people, making the reliability of our customer platform crucial to our success. The customer platform supports everything from ridesharing and Uber Eats , to Uber Freight and Uber for Business. MORE
To build and maintain infrastructure at scale, easy access to the current state of the system is paramount. As Uber’s business continues to expand, our infrastructure has grown in size and complexity, making it more difficult to get all the … The post Scaling Infrastructure Management with Grail appeared first on Uber Engineering Blog. MORE
Over the years, migrating data to the cloud has become a top priority for organizations looking to modernize their infrastructure for improved security, performance, and agility, closely followed by the trending shift from commercial database management systems to open source databases. MORE
As the Vice President of Engineering for Uber’s Core Infrastructure group, Matthew Mengerink faces a daunting task. He oversees 350 engineers across four teams tasked with not only maintaining the platform on which 3,500 microservices run, but also figuring out … The post Scaling for Growth: A Q&A with Uber’s VP of Core Infrastructure, Matthew Mengerink appeared first on Uber Engineering Blog. MORE
You may also like: Gaining a Systemic View of Immutable Infrastructure Tooling. devops performance integration docker openshift immutable openshift container immutable infrastructure deployments deployment solutionMake your infrastructure.immutable? MORE
Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis. Architecture Apache Hadoop Big Data Big Data Analysis Garbage Collection Hadoop Hadoop Distributed File System Hadoop Infra & Analytics Team HBase HDFS HDFS Federation HIVE Hoodie Infrastructure JAR Jenkins NameNode PRC Puppet Router-based Federation Uber Uber Data Foundation Team Uber Engineering View File System WebHDFS YARN MORE
As part of our robust and scalable metrics infrastructure, we built … The post M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus appeared first on Uber Engineering Blog. Architecture Open Source Grafana Infrastructure M3 M3 Coordinator M3DB Metrics Platform OSS Prometheus Uber Infrastructure MORE
But what happens if a service work perfectly but the underlying infrastructure, such as processes and hosts, experience an outage? Davis combines APM incident and impact detection with infrastructure monitoring root-cause detection at the process and host level. Dynatrace news. MORE
Architecture Uber Data Cassandra Data Management Data Storage Data Warehouse Databook Dropwizard Gradle HDFS HIVE Infrastructure Kafka Metadata MySQL Postgres Quartz Queryparser RESTful API Uber Uber Data Knowledge Uber Engineering VerticaFrom driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data. MORE
It will include an update to Chrome 73, a revised access management policy for detailed reports and a technical architecture revamped to meet the growing needs of our … Continue reading Update to Chrome 73 and infrastructure upgrade → Service UpdatesAfter several months of intensive work (and a new coffee machine), we are pleased to announce the next update of our service: June 13th (03:00 AM UTC). MORE
Architecture Uber Data Big Data Data Engineering Data Infrastructure data science Data Warehouse Engineering EfficiencyMaintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. MORE
Architecture Culture Aarhus Aarhus University Denmark Grail Infrastructure Lau Skorstengaard Ph.D. Lau Skorstengaard is a Ph.D. student at Aarhus University who pursued a 2018 internship with Uber Engineering’s Aarhus, Denmark office. MORE
With the release of Dynatrace 1.194, we’ve added CPU related infrastructure metrics for LPARs (host metrics) and regions (process metrics) and expanded our multidimensional analysis to IBM Z systems, including CICS, IMS, and the CICS transaction gateway. . Dynatrace news. MORE
cloud-storage data data-infrastructure aws netflixBy Torio Risianto, Bhargavi Reddy, Tanvi Sahni, Andrew Park Continue reading on Netflix TechBlog ». MORE
This helps save massively on infrastructure costs. Follower clusters are a ScaleGrid feature that allows you to keep two independent database systems (of the same type) in sync. Unlike cloning or replication, this allows you to maintain an active, point-in-time copy of your production data. This extra cluster, known as a follower cluster, can be leveraged for multiple use cases, including for analyzing, optimizing and testing your application performance for MongoDB , MySQL and PostgreSQL. MORE
Infrastructure Related Topics DZone
OCTOBER 31, 2019
You may also like: Gaining a Systemic View of Immutable Infrastructure Tooling. devops performance integration docker openshift immutable openshift container immutable infrastructure deployments deployment solutionMake your infrastructure.immutable?
The Netflix TechBlog
JULY 8, 2020
cloud-storage data data-infrastructure aws netflixBy Torio Risianto, Bhargavi Reddy, Tanvi Sahni, Andrew Park Continue reading on Netflix TechBlog ».
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Dynatrace
JULY 7, 2020
In Kubernetes environments, operating and successfully running your production applications and microservices requires getting additional insights into your Kubernetes infrastructure including the cluster, nodes, and pods that encapsulate and run the apps. Dynatrace news.
Dynatrace
JULY 8, 2020
One of the promises of container orchestration platforms is to make i t easier for the developers to accelerate the deployment of their app lication s without having to worry about scalability and infrastructure dependencies. Dynatrace news.
Dynatrace
JANUARY 8, 2020
If you’re doing it right, cloud represents a fundamental change in how you build, deliver and operate your applications and infrastructure. And that includes infrastructure monitoring. This also implies a fundamental change to the role of infrastructure and operations teams.
Dynatrace
JUNE 10, 2020
But what happens if a service work perfectly but the underlying infrastructure, such as processes and hosts, experience an outage? Davis combines APM incident and impact detection with infrastructure monitoring root-cause detection at the process and host level. Dynatrace news.
Dynatrace
APRIL 20, 2020
Infrastructure exists to support the backing services that are collectively perceived by users to be your web application. Issues that manifest themselves as performance degradation on a user’s device can often be traced back to underlying infrastructure issues. Dynatrace news.
Uber Engineering
DECEMBER 19, 2019
Architecture General Engineering CPU Infrastructure Observability Productivity Reliability Search Infrastructure Storage Uber Eats Velocity
Abstracta
APRIL 17, 2018
The post The Importance of Validating the Testing Infrastructure appeared first on Abstracta Software Testing Services. Performance Engineering Software Testing Performance Performance Testing test infrastructure
Uber Engineering
MARCH 13, 2018
To build and maintain infrastructure at scale, easy access to the current state of the system is paramount. As Uber’s business continues to expand, our infrastructure has grown in size and complexity, making it more difficult to get all the … The post Scaling Infrastructure Management with Grail appeared first on Uber Engineering Blog.
DZone
JULY 26, 2019
Before we get into the tutorial hands-on, I would like to mention that this topic is not new. It has been covered in various helpful articles like the ones from TestAutomationGuru.
Dynatrace
MAY 13, 2020
So that we can expand our coverage of infrastructure-related problems, we plan to work on more built-in infrastructure extensions, available out of the box with Dynatrace. Looking for ways to solve some of your infrastructure-related problems? Dynatrace news.
The Netflix TechBlog
MARCH 25, 2019
Mapping micro-services interactions, entities from real time infrastructure, and ML infrastructure and other non traditional data stores are few such examples.
The Netflix TechBlog
MARCH 5, 2019
Central engineering teams enable this operational model by reducing the cognitive burden on innovation teams through solutions related to securing, scaling and strengthening (resilience) the infrastructure. All these micro-services are currently operated in AWS cloud infrastructure.
DZone
NOVEMBER 13, 2019
Infrastructure as a service. To begin with, many businesses are going online. They are relying heavily on the cloud to facilitate their clients, which demands to collect, storing, and processing a vast amount of data before it can be presented to the end-user as information.
The Morning Paper
FEBRUARY 27, 2020
Gandalf: an intelligent, end-to-end analytics service for safe deployment in cloud-scale infrastructure , Li et al., NSDI’20. Modern software systems at scale are incredibly complex ever changing environments.
DZone
JULY 22, 2019
At Logicify , we are proud to be software monitoring geeks. We love to monitor both the apps we develop and the ones we use internally. Not because they are sloppy. Not because we don’t trust our code.
Uber Engineering
APRIL 12, 2018
As the Vice President of Engineering for Uber’s Core Infrastructure group, Matthew Mengerink faces a daunting task. He oversees 350 engineers across four teams tasked with not only maintaining the platform on which 3,500 microservices run, but also figuring out … The post Scaling for Growth: A Q&A with Uber’s VP of Core Infrastructure, Matthew Mengerink appeared first on Uber Engineering Blog.
Dareboost
MAY 28, 2019
It will include an update to Chrome 73, a revised access management policy for detailed reports and a technical architecture revamped to meet the growing needs of our … Continue reading Update to Chrome 73 and infrastructure upgrade → Service UpdatesAfter several months of intensive work (and a new coffee machine), we are pleased to announce the next update of our service: June 13th (03:00 AM UTC).
Scalegrid
JUNE 9, 2020
The open source model is not only popular with the developer market, but also enterprise companies looking to modernize their infrastructure and reduce spend. PALO ALTO, Calif.,
Scalegrid
JUNE 4, 2020
As an open source database, it’s a highly popular choice for enterprise applications looking to modernize their infrastructure and reduce their total cost of ownership, along with startup and developer applications looking for a powerful, flexible and cost-effective database to work with. ScaleGrid for PostgreSQL is architectured to leverage-high performance SSD disks on DigitalOcean, and is finely tuned and optimized to achieve the best performance on DigitalOcean infrastructure.
Dynatrace
JUNE 16, 2020
With the release of Dynatrace 1.194, we’ve added CPU related infrastructure metrics for LPARs (host metrics) and regions (process metrics) and expanded our multidimensional analysis to IBM Z systems, including CICS, IMS, and the CICS transaction gateway. . Dynatrace news.
Scalegrid
JUNE 6, 2019
Over the years, migrating data to the cloud has become a top priority for organizations looking to modernize their infrastructure for improved security, performance, and agility, closely followed by the trending shift from commercial database management systems to open source databases.
The Netflix TechBlog
MAY 26, 2020
Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the Cloud Network Infrastructure to address the identified problems. data-engineering cloud-networking big-data cloud-infrastructure netflix
Scalegrid
JANUARY 20, 2020
This helps save massively on infrastructure costs. Follower clusters are a ScaleGrid feature that allows you to keep two independent database systems (of the same type) in sync. Unlike cloning or replication, this allows you to maintain an active, point-in-time copy of your production data. This extra cluster, known as a follower cluster, can be leveraged for multiple use cases, including for analyzing, optimizing and testing your application performance for MongoDB , MySQL and PostgreSQL.
Scalegrid
OCTOBER 24, 2019
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.
Dynatrace
OCTOBER 17, 2019
And, this is even more apparent due to the ever-increasing infrastructure complexity enterprises are dealing with. On-demand infrastructure: The ability to deploy infrastructure whenever it’s required. Dynatrace news.
High Scalability
FEBRUARY 19, 2019
Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.
High Scalability
APRIL 16, 2019
In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II.
High Scalability
APRIL 3, 2019
PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today?
High Scalability
JANUARY 22, 2020
Here are a few critical ways in which it differs from replication: Analytics Cluster Appliction monitoring Cloning Clustering Database Database Development Database Reporting Database Testing DevOps Follower Cluster MongoDB Monitoring MySQL Postgres Production Data Replication admin analytics best platform cluster clusters database database replication database scalability databases deployment infrastructure mysql mysql cluster mysql load optimization postgresql replication sql testing
Uber Engineering
AUGUST 7, 2018
As part of our robust and scalable metrics infrastructure, we built … The post M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus appeared first on Uber Engineering Blog. Architecture Open Source Grafana Infrastructure M3 M3 Coordinator M3DB Metrics Platform OSS Prometheus Uber Infrastructure
CSS Wizardry
MAY 31, 2019
One of the quickest wins—and one of the first things I recommend my clients do—to make websites faster can at first seem counter-intuitive: you should self-host all of your static assets, forgoing others’ CDNs/infrastructure.
Uber Engineering
DECEMBER 17, 2019
Architecture Uber Data Big Data Data Analytics Data Platform EoY Infrastructure Product Platform Uber Engineering
Scalegrid
JUNE 11, 2019
Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Cloud Infrastructure Analysis : Public Cloud vs. On-Premise vs. Hybrid Cloud. Cloud Infrastructure Breakdown by Database. Now, let’s take a look at the cloud infrastructure setup breakdown by database management systems. So, which cloud infrastructure is right for you? Average Number of Database Types Used by Infrastructure.
CSS Wizardry
APRIL 22, 2020
They were either running their own infrastructure and installing and deploying Brotli everywhere proved non-trivial, or they were using a CDN who didn’t have readily available support for the new algorithm.
Uber Engineering
MAY 14, 2019
Architecture Mobile bufferbloat Cronet HTTP/2 HTTP/3 Infrastructure Internet Engineering Task Force mobile engineering QUIC retransmission timeout Transmission Control Protocol Uber MobileUber operates on a global scale across more than 600 cities, with our apps relying entirely on wireless connectivity from over 4,500 mobile carriers.
Uber Engineering
AUGUST 14, 2019
Architecture Uber Data Big Data Data Engineering Data Infrastructure data science Data Warehouse Engineering EfficiencyMaintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage.
Uber Engineering
APRIL 5, 2018
Three years ago, Uber Engineering adopted Hadoop as the storage ( HDFS ) and compute ( YARN ) infrastructure for our organization’s big data analysis. Architecture Apache Hadoop Big Data Big Data Analysis Garbage Collection Hadoop Hadoop Distributed File System Hadoop Infra & Analytics Team HBase HDFS HDFS Federation HIVE Hoodie Infrastructure JAR Jenkins NameNode PRC Puppet Router-based Federation Uber Uber Data Foundation Team Uber Engineering View File System WebHDFS YARN
Uber Engineering
AUGUST 3, 2018
Architecture Uber Data Cassandra Data Management Data Storage Data Warehouse Databook Dropwizard Gradle HDFS HIVE Infrastructure Kafka Metadata MySQL Postgres Quartz Queryparser RESTful API Uber Uber Data Knowledge Uber Engineering VerticaFrom driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data.
Uber Engineering
MARCH 22, 2018
Architecture CoDel CPU critical request Goroutine graceful degradation Infrastructure Jaeger load management load shedding Memory overload detector QALM QoS Quality of Service ridesharing RPC layer Uber for Business Uber Freight UberFx YARPCMuch of Uber’s business involves connecting people with people, making the reliability of our customer platform crucial to our success. The customer platform supports everything from ridesharing and Uber Eats , to Uber Freight and Uber for Business.
Uber Engineering
JANUARY 16, 2019
Architecture Culture Aarhus Aarhus University Denmark Grail Infrastructure Lau Skorstengaard Ph.D. Lau Skorstengaard is a Ph.D. student at Aarhus University who pursued a 2018 internship with Uber Engineering’s Aarhus, Denmark office.
Uber Engineering
FEBRUARY 22, 2018
Architecture Data Store Datastore Design Flask Frontless Go Golang Goroutine Infra Infrastructure Mezzanine NGINX Python Schemaless Sharding Uber Uber Engineering uWSGIIn 2014, Uber Engineering built Schemaless , our fault-tolerant and scalable datastore, to facilitate the rapid growth of our company. For context, we deployed more than 40 Schemaless instances and many thousands of storage nodes in 2016 alone.
130 
Let's personalize your content