All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

All Things Distributed

NOVEMBER 30, 2016

Today, there are thousands of machine learning scientists and developers applying machine learning in various places, from recommendations to fraud detection, from inventory levels to book classification to abusive review detection. in ML and neural networks) and access to vast amounts of data.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

The Netflix TechBlog

JUNE 7, 2021

By Alok Tiagi , Hariharan Ananthakrishnan , Ivan Porto Carrero and Keerti Lakshminarayan Netflix has developed a network observability sidecar called Flow Exporter that uses eBPF tracepoints to capture TCP flows at near real time. Without having network visibility, it’s difficult to improve our reliability, security and capacity posture.

Network 325

Network Transportation AWS Cloud 325

All Things Distributed

MAY 27, 2015

Over a year ago the AWS team opened a "pop-up loft" in San Francisco at 925 Market Street. The goal of opening the loft was to give developers an opportunity to get in-person support and education on AWS, to network, get some work done, or just hang out with peers. And don’t be shy — walk-ins are welcome too.

AWS 95

AWS Education Big Data Games 95

Scalegrid

MARCH 14, 2024

Developing Your Hybrid Cloud Strategy When devising a strategy for a hybrid cloud, numerous critical elements must be considered. Scalegrid for Hybrid Cloud Success Securing a reliable ally is essential in the intricate journey of developing hybrid clouds.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

SEPTEMBER 26, 2014

The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. Take a look at the AWS Loft homepage. What’s Happening at the AWS Loft.

AWS 111

AWS Games Education Innovation 111

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. Government and Big Data. All Things Distributed. Comments (). Cloud Readyâ??;

AWS 111

AWS Government Big Data Cloud 111

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Big data : To store, search, and analyze large datasets, 32% of organizations use Elasticsearch.

Open Source 349

Open Source Java Operating System Programming 349

All Things Distributed

DECEMBER 14, 2011

Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. Several prominent South American customers have been using AWS since the early days. Additionally, it allows them to keep their data inside of Brazil.

AWS 114

AWS Latency Storage Big Data 114

The Netflix TechBlog

APRIL 29, 2019

takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e., Subsequently, many useful libraries get developed, making the language even more desirable to learn and use. We have also developed a number of higher-level libraries to help integrate these with the rest of our ecosystem (e.g.

Open Source 279

Open Source Network Infrastructure Big Data 279

All Things Distributed

FEBRUARY 25, 2011

Simplifying IT - Create Your Application with AWS CloudFormation. With the launch of AWS CloudFormation today another important step has been taken in making it easier for customers to deploy applications to the cloud. Creating and managing these environments was a pain that AWS CloudFormation set out to relieve. Comments ().

AWS 121

AWS Cloud Scalability Storage 121

The Netflix TechBlog

MARCH 25, 2019

We adopted the following mission statement to guide our investments: “Provide a complete and accurate data lineage system enabling decision-makers to win moments of truth.” Nonetheless, Netflix data landscape (see below) is complex and many teams collaborate effectively for sharing the responsibility of our data system management.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

Dynatrace

APRIL 11, 2023

The focus on bringing various organizational teams together—such as development, business, and security teams — makes sense as observability data, security data, and business event data coalesce in these cloud-native environments. As organizations develop new applications, vulnerabilities will continue to emerge.

Cloud 195

Cloud DevOps Open Source Retail 195

High Scalability

MAY 26, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 100

Education AWS Software Engineering Scalability 100

All Things Distributed

FEBRUARY 17, 2011

New AWS feature: Run your website from Amazon S3. All of this can be done from the AWS console as well as with the AWS SDKs. More details about the website feature of Amazon S3 can be found here and in Jeff Barrs blog post on the AWS developer blog. Driving Storage Costs Down for AWS Customers. Comments ().

AWS 134

AWS Website Storage Servers 134

All Things Distributed

JULY 7, 2011

Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet.

AWS 96

AWS Cloud Storage Internet 96

All Things Distributed

JUNE 29, 2011

Driving Bandwidth Cost Down for AWS Customers. Any work we can do to improve over these dimensions generates long term benefits for AWS customers. Our solution architects work with customers to look for opportunities to exploit elasticity in AWS setups which can lead to significant savings in operational cost. Comments ().

AWS 104

AWS Retail Innovation Strategy 104

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements. Comments ().

AWS 115

AWS Cloud Java Scalability 115

The Netflix TechBlog

OCTOBER 27, 2020

Usually Data scientists and engineers write Extract-Transform-Load (ETL) jobs and pipelines using big data compute technologies, like Spark or Presto , to process this data and periodically compute key information for a member or a video. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 243

Latency Storage Big Data Tuning 243

All Things Distributed

OCTOBER 7, 2015

In such a data intensive environment, making key business decisions such as running marketing and sales campaigns, logistic planning, financial analysis and ad targeting require deriving insights from these data. However, the data infrastructure to collect, store and process data is geared toward developers (e.g.,

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

AUGUST 19, 2011

Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Countdown to What is Next in AWS.

AWS 75

AWS Database Storage Scalability 75

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. Put simply, data is not always readily available and accessible to organizational end users. Enter Amazon QuickSight.

Analytics 152

Analytics Availability Media Social Media 152

All Things Distributed

MARCH 24, 2011

Hacking with AWS at The Next Web Hackaton. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs. To make it easy we have free AWS usage credits available onsite for who ever needs them. There is one requirement; you have to be "hacking" using the AWS APIs.

AWS 93

AWS Internet Internet Storage 93

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

Testsigma

SEPTEMBER 8, 2021

If I consider current times, it has become a core concept in development, management, analytics, and also – automation testing. AppPerfect is one among the tools list that is a versatile tool – it is of great use for not only testers but developers and big data operations. AWS Device Farm. Signup now.

Cloud 76

Cloud Testing AWS Testing Tools 76

All Things Distributed

NOVEMBER 12, 2012

Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. This new Asia Pacific (Sydney) Region has been highly requested by companies worldwide, and it provides low latency access to AWS services for those who target customers in Australia and New Zealand. . | Comments ().

Cloud 117

Cloud AWS Ecommerce Latency 117

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. These sensors create massive amounts of geological data.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

The Netflix TechBlog

OCTOBER 15, 2019

Beyond data synchronization, some applications also need to enrich their data by calling external services. To address these challenges, we developed Delta. Delta is an eventual consistent, event driven, data synchronization and enrichment platform. High availability, via standby instances across AWS Availability Zones.

Transportation 192

Transportation Architecture Processing Storage 192

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Given the widespread use of caching in many of the applications in the AWS Cloud, a caching service had been high on the request list of our customers. Driving Storage Costs Down for AWS Customers.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

DECEMBER 20, 2017

Developments like cloud computing, the internet of things, artificial intelligence, and machine learning are proving that IT has (again) become a strategic business driver. Kärcher benefits as well: By developing this service, the company gets exact insight into how the machines are actually used by its customers.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

All Things Distributed

APRIL 27, 2011

In the 2010 Shareholder Letter Jeff Bezos writes about the unique technologies developed at Amazon.com over the years. To meet these demanding and unusual requirements, weve developed several alternative, purpose-built persistence solutions, including our own key-value store and single table store. Countdown to What is Next in AWS.

Technology 151

Technology Technology AWS Storage 151

All Things Distributed

AUGUST 20, 2012

Using Amazon Glacier AWS customers no longer need to worry about how to plan and manage their archiving infrastructure, unlimited archival storage is available to them with a familiar pay-as-you-go model, and with storage priced as low as 1 cent per GB it is extremely cost-effective. s largest organizations. A Complete Storage Solution.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

AUGUST 17, 2011

Cactus is a static website generator developed by Koen Bok of Made By Sofa (recently acquired by Facebook ). It has been developed by Tom Preston-Werner of GitHub fame. Next to that there is a very active community developing plugins and extensions which address a number of things that I want to do with the blog in the future.

Servers 126

Servers Social Media AWS Website 126

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. Ease of use: AutoOptimize provides a frictionless way to setup optimization with minimum maintenance overhead from Data Engineering.

Storage 203

Storage Latency Efficiency Data Engineering 203

Testsigma

MAY 14, 2021

Examples are DevOps, AWS, Big Data, Testing as Service, testing environments. However, they may differ from organization to organization but these are the standard ones: Developers: To perform unit and integration testing, apart from development.

Cloud 67

Cloud Testing Testing Tools Internet 67

All Things Distributed

MAY 24, 2011

Many AWS customers use Elastic Load Balancers (ELB) to front their Internet facing applications. More information can found on the Elastic Load Balancing and the Route 53 detail pages and on the two blog posts on the AWS developer blog. Driving Storage Costs Down for AWS Customers. Countdown to What is Next in AWS.

Internet 114

Internet Internet AWS Scalability 114