Percona

DECEMBER 27, 2023

AI and MLOps Kubernetes has become a new web server for many production AI workloads, focusing on facilitating the development and deployment of AI applications, including model training. This fully automated scaling and tuning will enable a serverless-like experience in our Operators and Everest.

Cloud 81

Cloud Open Source Strategy Best Practices 81

Percona

MAY 15, 2023

Those that have or would like to sign up for a Percona Support Subscription will continue to receive operational support and services.

Servers 110

Servers Open Source Tuning Software 110

Sutter's Mill

JUNE 17, 2023

Instead, the subgroups are a three-stage pipeline and continue concurrently working on new feature development all the time, and the feature freezes are just the checkpoints where we pause loading new features into this particular train. Standard attributes must be parseable (i.e., can’t just contain random nonsense).

C++ 143

C++ Programming Tuning Design 143

The Morning Paper

OCTOBER 18, 2020

What really blew me away, is that this result includes the time taken to train the model used! Radix Sort is carefully designed to make effective use of the L2 cache and sequential memory accesses, whereas Learned Sort is making random accesses all over the destination array. The big idea. That’s going to be at position 287!

Cache 137

Cache C++ Java Tuning 137

The Morning Paper

JULY 7, 2019

More specifically, we’ll be looking at the results of an internal study with over 500 participants designed to figure out how product development and software engineering is changing at Microsoft with the rise of AI and ML. Models have a provenance tag explaining which data it has been trained on and which version of the model was used.

Software Engineering 92

Software Engineering Engineering Software Software 92

O'Reilly

MAY 25, 2021

GPT-3 is essentially an auto-complete bot whose underlying Machine Learning (ML) model has been trained on vast quantities of text available on the Internet. Indeed, Google recently announced LaMDA , a model at GPT-3 scale that is designed to participate in conversations. And the final paragraph of section 3.9.4

Social Media 138

Social Media Media Internet Internet 138

Adrian Cockcroft

JUNE 21, 2022

I also learned how marketing worked, and began to build my presentation and training skills as I was sent around the world by Sun to teach workshops and speak at events. I still code in R… One role I had for many years was to lead technical training events for the global specialist systems engineers, which we called the Ambassador Program.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Dynatrace

DECEMBER 2, 2021

By shifting production-level SLOs left into development , you can design apps to meet production SLOs to increase resilience and reliability far before there is actual downtime. This trains your teams to be proactive in maintaining software quality and saves you money by avoiding downtime. How SLOs work. SLO best practices.

Metrics 191

Metrics Best Practices DevOps Infrastructure 191

Sutter's Mill

NOVEMBER 11, 2023

This week’s meeting: Meeting #2 of C++26 At the previous meeting in June, the committee adopted the first 40 proposed changes for C++26, including many that had been ready for a couple of meetings and were just waiting for the C++26 train to open to be adopted. For those highlights, see the previous trip report. This is that library.

C++ 118

C++ Lambda Network Programming 118

The Morning Paper

JUNE 27, 2019

Performance on accelerators matters because almost all current machine learning research, and most training of production models, uses them. Our interpretation of these results is that current frameworks excel at workloads where it makes sense to manually tune the small set of computations used by a particular model or family of models.

Systems 87

Systems Tuning Programming Innovation 87

Scalegrid

JANUARY 11, 2024

To combat this issue, certain strategies are recommended such as prioritizing alerts based on severity levels, reducing false positives through advanced detection techniques, automating response protocols for faster action-taking, and providing adequate training and resources for personnel responsible for managing security.

Best Practices 130

Best Practices Cloud Monitoring Strategy 130

Percona

OCTOBER 18, 2023

Compatibility Open source databases are designed with interoperability at their core, adhering to industry standards and offering support for a wide range of data import and export formats. Does anyone on my team require further training before we start? Should I be bringing in external experts to help out?

Open Source 93

Open Source Database Hardware Strategy 93

Adrian Cockcroft

NOVEMBER 26, 2023

In this session, learn how AWS has been supporting customers like the Territorial Intelligence Centre (CIT) in designing cutting-edge tools to address traceability in supply chains with deforestation risks by integrating governmental databases, innovative map services, and land-use data from high spatial resolution satellite imagery.

AWS 52

AWS Energy IoT Best Practices 52

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 73

Entertainment Internet Internet Design 73

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. “ How to design mechanisms and policies to avoid or reduce this latency remains an open question.” Are there privacy concerns in doing so?

Hardware 58

Hardware Latency Serverless Energy 58

IO River

NOVEMBER 15, 2023

For example, if a request activates a rule designed to block SQL injection attempts, the WAF might automatically block that request, preventing it from reaching your web application.‍Security Two of them are particularly gnarly: fine-tuning rules to perfection and managing a WAF over a multi-CDN architecture.

Traffic 52

Traffic Network Logistics Architecture 52

Tasktop

JANUARY 30, 2020

This measure is tuned to the investment necessary for success in a particular value stream – and it is also the metric needed for refining investments over time. The newsletter, produced with the communications and training departments, called out all the things that would be changing in the upcoming release. Click cover to download.

Healthcare 52

Healthcare Metrics Tuning Software 52

IO River

NOVEMBER 2, 2023

For example, if a request activates a rule designed to block SQL injection attempts, the WAF might automatically block that request, preventing it from reaching your web application.‍Security Flywheel‍‍When it comes to fortifying web applications, think of security as a flywheel—an ever-revolving cycle that gains momentum with each turn.

Traffic 40

Traffic Network Logistics Architecture 40

SQL Server According to Bob

FEBRUARY 15, 2018

The conference kicks off next week on Wednesday February 21st with Training Days and lasts through Saturday, February 24th. Friday Sessions: SQL Intelligence excels your tuning and security expertise – Veljko Vasic, Ron Matchoro and Frans Lytzen. Azure Cosmos DB: design patterns and case studies – Andrew Liu.

Engineering 40

Engineering Azure Best Practices Servers 40

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. Training models and developing complex applications on top of those models is becoming easier. of users and 3.9%

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

The Morning Paper

OCTOBER 31, 2019

A risk score model is a a very simple points-based system designed to be used (and understood by!) Bear in mind there is no need for parameter tuning etc. The baseline methods required training and processing over 33,000 models! Such models are widely used in e.g. medicine and criminal justice.

Logistics 44

Logistics Programming Tuning Code 44

The Netflix TechBlog

MARCH 14, 2023

Much of the ML literature focuses on model training, evaluation, and scoring. Dawn Chenette , Design Lead This approach had several benefits for product engineering. In addition, we were able to perform a handful of A/B tests to validate or negate our hypotheses for tuning the search experience. Incredible!”

Media 291

Media Innovation Energy Architecture 291

O'Reilly

JULY 25, 2023

Here’s how I worked on it: I subscribed to ChatGPT Plus and used the GPT-4 model in ChatGPT (first the May 12, 2023 version, then the May 24 version) to help me with design and implementation. I liked how ChatGPT helped me work through the tradeoffs of these initial design decisions before diving head-first into coding.

Programming 98

Programming Code Design Benchmarking 98

All Things Distributed

MARCH 19, 2018

For example, training on more data means more accurate models. Last re:Invent, to make the problem of authoring, training, and hosting ML models easier, faster, and more reliable, we launched Amazon SageMaker. Machine learning models are usually trained tens or hundreds of times. In machine learning, more is usually more.

Scalability 159

Scalability Hardware AWS Tuning 159

The Netflix TechBlog

AUGUST 17, 2023

The tool provides an efficient way for creatives (photo editors, artwork designers, etc.) Each algorithm needed a process of evaluation and tuning to get great results in AVA Discovery View. This feedback is easily accessible by our algorithm partners and used in training improved versions of the models.

Media 169

Media Scalability Architecture Strategy 169

The Netflix TechBlog

OCTOBER 18, 2022

These include ETL pipelines, ML model training workflows, batch jobs, etc. Similarly, ML model training workflows usually consist of tens of thousands of training jobs within a single workflow. Advanced users can develop their own well-tuned docker image and let Maestro handle the scheduling and execution.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

DECEMBER 7, 2020

VMAF was originally designed with Netflix’s streaming use case in mind, in particular, to capture the video quality of professionally generated movies and TV shows in the presence of encoding and scaling artifacts. Also notice that this is an ongoing effort, so stay tuned for more speed improvements. animation vs. documentary).

Metrics 154

Metrics Open Source Tuning Speed 154

The Netflix TechBlog

NOVEMBER 20, 2023

Whether in analyzing A/B tests, optimizing studio production, training algorithms, investing in content acquisition, detecting security breaches, or optimizing payments, well structured and accurate data is foundational. The incremental processing solution (IPS) described here has been designed to address the above problems.

Processing 210

Processing Big Data Efficiency Engineering 210

O'Reilly

SEPTEMBER 19, 2023

A company then needed to train up their ops team to manage the cluster, and their analysts to express their ideas in MapReduce. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task. A basic, production-ready cluster priced out to the low-six-figures.

Hardware 98

Hardware Storage Big Data Blockchain 98

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Our Infrastructure Security team leverages Python to help with IAM permission tuning using Repokid. We leverage Python to protect our SSH resources using Bless.

Open Source 279

Open Source Network Infrastructure Big Data 279

The Netflix TechBlog

JANUARY 10, 2024

When Reloaded was designed, we focused on a single use case: converting high-quality media files (also known as mezzanines) received from studios into compressed assets for Netflix streaming. This drove the approach of the “release train”. The service also provides options that allow fine-tuning latency, throughput, etc.,

Processing 229

Processing Media Latency Innovation 229

O'Reilly

OCTOBER 11, 2022

You analyze what your staff does to process an invoice, and then design a system to perform that process. They’re inefficient, poorly designed, and perhaps even wholly inappropriate for the task. What would happen to product design, sales, and engineering if a constant digest of issues from customer service were available to them?

Games 116

Games Healthcare Processing Retail 116

Edge Perspectives

AUGUST 5, 2019

By learning, I don’t mean training programs or the sharing of existing knowledge. In fact, learning is a by-product of initiatives designed to find ways to increase impact, rather than an investment that may never yield returns. So, what’s the alternative? Scalable learning. Let me clarify. Learning is not an expense.

Strategy 17

Strategy Scalability Efficiency Programming 17

The Agile Manager

AUGUST 23, 2007

It is also not uncommon for a company to belittle the value of management by defining it as a collection of supervisory or hygienic tasks e.g., to ensure everybody on a team has taken requisite compliance training each quarter and submits their timesheet each week. 5 Grand Prix Tune-Ups” F1 Racing Magazine. 4 White, Erin. “

Innovation 40

Innovation Technology Technology Latency 40

Abhishek Tiwari

JULY 20, 2019

One thing stand-out to me is being intentional and practical about your engineering organisation design. First and foremost, being intentional about organisation design requires good and honest discussions about all possible option. Design your teams to stay small and iterate fast. product) don't change over a long period.

Engineering 61

Engineering Retail Airlines Healthcare 61

Smashing Magazine

AUGUST 22, 2021

As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. While this is conceptually possible (QUIC does exactly that), things were initially not designed like this, because we need to be able to use TCP with and without TLS on top. see figure 2c above). Finally convinced?

Performance 106

Performance Network Latency Servers 106

High Scalability

NOVEMBER 25, 2019

To help our customers manage ongoing data explosion, we have designed many of the core components over the last few years. I mean that as your scale grows then design patterns and strategies that used to work 2 years ago and allowed you to go from defensive to offensive positioning may buckle under pressure or becomes cost-prohibitive.

Architecture 52

Architecture Cache Azure Storage 52