Presentation: Effective Performance Engineering at Twitter-Scale
InfoQ
APRIL 12, 2024
Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering. By Yao Yue
This site uses cookies to improve your experience. By viewing our content, you are accepting the use of cookies. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country we will assume you are from the United States. View our privacy policy and terms of use.
InfoQ
APRIL 12, 2024
Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering. By Yao Yue
The Netflix TechBlog
MARCH 4, 2024
Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. Auto Remediation generates recommendations by considering both performance (i.e., Multi-objective optimizations.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Dynatrace
NOVEMBER 6, 2023
Successful deployments of cloud-native workloads at the edge help to reduce costs, boost performance, and improve customer experience. As organizations see an increasingly high number of compute locations, assessing health and finding root causes of emerging problems across heavily distributed workloads, at scale, has become a daunting task.
Dynatrace
FEBRUARY 1, 2024
From generating new code and boosting developer productivity to finding the root cause of performance issues with ease, the benefits of AI are numerous. Performance analytics Dynatrace hypermodal AI empowers development teams to dig deep into database statements and remediate issues quickly. The first risk is not adopting AI at all.
Dynatrace
JANUARY 31, 2024
While off-the-shelf models assist many organizations in initiating their journeys with generative AI (GenAI), scaling AI for enterprise use presents formidable challenges. This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability.
Dynatrace
APRIL 30, 2021
As organizations develop more applications and microservices, they are discovering they also need to run more performance tests in the same amount of time or less to meet service-level objectives (SLOs) that fulfill service-level agreements (SLAs). Current challenges with performance testing.
Scalegrid
JANUARY 5, 2024
Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity.
The Netflix TechBlog
APRIL 27, 2023
Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. Engineers want their alerting system to be realtime, reliable, and actionable. It allows us to overcome high dimensionality/cardinality limitations of the time-series database.
The Netflix TechBlog
NOVEMBER 14, 2023
By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. It also becomes inefficient as the data scale increases.
Dynatrace
FEBRUARY 20, 2024
Monitoring myriad tools and the accompanying data silos make it increasingly difficult for enterprises to optimize application performance and availability. Making waves was the theme of this year’s Perform conference. For the latest news and insights from the Dynatrace Perform 2024 conference, check out our guide.
Dynatrace
FEBRUARY 13, 2020
Across both his day one and day two mainstage presentations, Steve Tack, SVP of Product Management, described some of the investments we’re making to continue to differentiate the Dynatrace Software Intelligence Platform. This drives precise answers in real-time about performance issues and anomalies across the full stack.
Dynatrace
JANUARY 16, 2023
The rapid adoption is driven—and challenged by—an ever-growing ecosystem of Kubernetes technologies that add advanced platform features, such as security, microservice communications, observability, scaling, resource utilization, and so on. This Kubernetes survey shows how organizations actually use Kubernetes in production.
The Netflix TechBlog
NOVEMBER 9, 2021
This allows us to present the content exactly as creatively envisioned on devices and plans which support such high resolution and frame-rate playback. The Client and UI Engineering team built a certification test with these streams to analyze both the device logs as well as the pictures rendered on the screen. Some titles (e.g.,
Alex Podelko
AUGUST 18, 2019
First, I’d like to elaborate on “It may be less need for simple load testing due to increased scale and sophistication of systems” I meant that the traditional way – testing the system before deploying in production using production-type workload – is not the only way anymore.
Dynatrace
MAY 6, 2021
At Perform 2021 , Dynatrace lead data scientist Thomas Natschläger gave a deep dive into the Dynatrace AI engine, Davis. The underlying assumption of the Davis AI engine is that not every one of these individual metrics, timeseries, and unexpected fluctuations are important. So, how can Davis handle this problem?
The Netflix TechBlog
MARCH 5, 2019
Netflix’s engineering culture is predicated on Freedom & Responsibility, the idea that everyone (and every team) at Netflix is entrusted with a core responsibility and they are free to operate with freedom to satisfy their mission. All these micro-services are currently operated in AWS cloud infrastructure.
Brendan Gregg
JULY 4, 2021
It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.
The Netflix TechBlog
JANUARY 25, 2023
The databases we pick should be able to scale horizontally. One of the key initiatives at Netflix, Media Search Platform, now uses Marken to store annotations and perform various searches explained below. Different types of search queries are supported using the Elasticsearch as a backend search engine.
Dynatrace
FEBRUARY 14, 2022
As a guest keynote speaker at Dynatrace Perform 2022 , Tegmark set the stage for AI as the ultimate technology for game-changers. But at the scale of AGI, a reactive trial-and-error approach can be costly and potentially catastrophic. billion years of cosmic history and the potential of the human race to influence the next 13.8
Alex Podelko
DECEMBER 19, 2019
Even when I took out the sessions that don’t directly cover the topics of my primary interests as well as mainframe-specific presentations, I ended up with 21 sessions in 2.5 ITIL Version 4 Capacity and Performance Management in an Agile Container World by Chris Molloy, IBM. Meeting of the Minds: Performance Engineering.
Dynatrace
APRIL 15, 2022
At Dynatrace Perform 2022 , David Catanoso, acting director of cloud and edge solutions at the U.S. As a result, VA had to rapidly scale its on-premises Citrix environment. ” Since then, VA solved many cloud performance problems and kept its complex hybrid environment running without interrupting remote work.
The Netflix TechBlog
NOVEMBER 22, 2019
by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! In this session, we deep-dive into how Amazon EC2 Auto Scaling works to simplify continuous fleet management and automatic scaling with changing load.
The Netflix TechBlog
NOVEMBER 22, 2019
by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! In this session, we deep-dive into how Amazon EC2 Auto Scaling works to simplify continuous fleet management and automatic scaling with changing load.
Dynatrace
JUNE 10, 2020
Having been named as a Leader in the 2020 Gartner APM Magic Quadrant for the 10 th consecutive time proves that Dynatrace is the best-of-breed application performance monitoring tool available. Our Davis AI causation engine can easily detect root causes that are related to service slowdowns or increases in failures.
The Netflix TechBlog
OCTOBER 27, 2021
It allows data scientists to define ML workflows, test them locally, scale-out to the cloud, and deploy to production in idiomatic Python code. It makes it easy for data scientists to express even complex machine learning applications in idiomatic Python, test them locally, or scale them out in the cloud?—?all
Dynatrace
FEBRUARY 14, 2022
As a guest keynote speaker at Dynatrace Perform 2022 , Tegmark set the stage for AI as the ultimate technology for game-changers. But at the scale of AGI, a reactive trial-and-error approach can be costly and potentially catastrophic. billion years of cosmic history and the potential of the human race to influence the next 13.8
The Netflix TechBlog
AUGUST 28, 2020
In this blog post, we present benefits of applying the above-mentioned optimizations to standard dynamic range (SDR) 10-bit and 4K streams (some titles are also HFR). The encodes are decoded and scaled to a 4K canvas prior to extracting the cutouts. The 8-bit stream profiles go up to 1080p resolution.
Percona
NOVEMBER 2, 2023
MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success. In MongoDB 6.x:
Adrian Cockcroft
FEBRUARY 13, 2023
The new information from October 2022 states: To achieve our goal of powering our operations with 100% renewable energy by 2025 — five years ahead of our original 2030 target — Amazon contracts for renewable power from utility scale wind and solar projects that add clean energy to the grid. SUS209 — there was no talk with this code.
Smashing Magazine
NOVEMBER 8, 2021
We work with millions of merchants, and as many companies, we obsess about storefront performance. We obsess even more about finding the optimal balance between performance, capabilities, and merchants’ business objectives. Commerce At Shopify Scale: Hydrogen Powered By Oxygen. Large preview ). Large preview ).
Alex Podelko
JUNE 12, 2019
If we talk about commercial vendors targeting the corporate market, I guess only Neotys remains independent and active (I mean contributing into the performance testing ecosystem – innovation, publishing content, participating in events, etc). Microfocus acquired both LoadRunner from HP and Silk Performer (as a part of Borland).
Alex Russell
JUNE 22, 2022
As penance for this error, and for being short with Miguel , I must deconstruct the ways Apple has undermined browser engine diversity. Contrary to claims of Apple partisans, iOS engine restrictions are not preventing a "takeover" by Chromium — at least that's not the primary effect. And that's a choice. "WebKit
The Netflix TechBlog
FEBRUARY 14, 2020
We also need to source multiple images for each title representing different themes so we can present an image that is relevant to each member’s taste. Through testing we have learned that with proper checks and human curation in place, assisted artwork candidates can perform on par with agency designed artwork.
The Netflix TechBlog
JULY 30, 2019
and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. The Netflix Media Database (NMDB) is one such example.
All Things Distributed
MAY 19, 2017
In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. That database engine is now known as Amazon Aurora and launched in 2014 for MySQL and in 2016 for PostgreSQL.
Dynatrace
NOVEMBER 24, 2022
The key topic Michael brought to Amplify was around the opportunity the changing economic and technological landscape presents, explaining that observability shouldn’t be seen as a bolt-on but instead be seen as a built-in element to an intelligent platform. This series of challenges present an opportunity for advancement.
The Netflix TechBlog
JUNE 4, 2019
However, the key insight here is that these caches are partially shared among the CPUs, which means that perfect performance isolation of co-hosted containers is not possible. Traditionally it has been the responsibility of the operating system’s task scheduler to mitigate this performance isolation problem. Linux to the rescue?
Brendan Gregg
FEBRUARY 28, 2023
At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.
Dynatrace
OCTOBER 23, 2020
Large-scale software deployments rarely depend on the manual invocation of installers. In order to scale up and perform such operations within predefined maintenance windows (that are typically short), deployment administrators have inspired the creation of CMDB solutions and mass-deployment mechanisms. Operation modes.
Percona
JUNE 4, 2023
MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. Elevate your MariaDB environment with Percona Support for MariaDB. Contact us to learn more!
The Morning Paper
MARCH 8, 2020
Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.
Brendan Gregg
DECEMBER 31, 2017
My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.
Jos
JUNE 2, 2018
Web Performance is not only about understanding what makes a site fast. Performance is a feature and needs to be prioritized as such. Performance is a topic that has interested me for a long time. Moving over to web, the performance problems are different. This is not a post explaining why web performance is important.
KeyCDN
SEPTEMBER 12, 2019
We normally focus solely on the performance aspect, but today we want to dive into additional ways you can optimize images for the web. The file size of your images of course is very important, but SEO and social media also play an important part in helping your website perform and convert better.
Expert insights. Personalized for you.
We have resent the email to
Are you sure you want to cancel your subscriptions?
Let's personalize your content