All Things Distributed

AUGUST 18, 2011

Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud. The posting on the AWS developer blog also has some more background.

Big Data 111

Big Data Analytics AWS Cloud 111

Scalegrid

MARCH 28, 2024

However, its limited feature set compared to Redis might be a disadvantage for applications that require more advanced data structures and persistence. Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load. Data transfer technology. 3d render.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

MARCH 24, 2023

By embracing public cloud and hybrid cloud computing environments, IT teams can further accelerate development and automate software deployment and management. Container technology enables organizations to efficiently develop cloud-native applications or to modernize legacy applications to take advantage of cloud services.

Infrastructure 191

Infrastructure Open Source Operating System Cloud 191

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., By instrumenting both the client-side of a request and the server-side it’s possible to figure out wait times. Seer is also tested on a 100-server GCE cluster with the Social Network microservices application.

Big Data 45

Big Data Cloud Performance Hardware 45

The Netflix TechBlog

JULY 21, 2022

We at Netflix, as a streaming service running on millions of devices, have a tremendous amount of data about device capabilities/characteristics and runtime data in our big data platform. With large data, comes the opportunity to leverage the data for predictive and classification based analysis.

Big Data 179

Big Data Cache Engineering Data Engineering 179

Dynatrace

JANUARY 16, 2023

On-premises data centers invest in higher capacity servers since they provide more flexibility in the long run, while the procurement price of hardware is only one of many cost factors. The immense growth of Kubernetes presents new security challenges in runtime and increased complexity in hardening CI/CD pipelines in development.

Open Source 347

Open Source Java Operating System Programming 347

Dynatrace

APRIL 21, 2021

On the Dynatrace Business Insights team, we have developed analytical views and an approach to help you get started. To do this effectively, you need a big data processing approach. Not all pages are equally important, and development resources are top priority. How do you know where to focus first with failing pages?

Traffic 264

Traffic Metrics Mobile Analytics 264

The Netflix TechBlog

APRIL 29, 2019

Content is placed on the network of servers in the Open Connect CDN as close to the end user as possible, improving the streaming experience for our customers and reducing costs for both Netflix and our Internet Service Provider (ISP) partners. data access, fact logging and feature extraction, model evaluation and publishing).

Open Source 279

Open Source Network Infrastructure Big Data 279

Dynatrace

JULY 6, 2020

As adoption rates for Microsoft Azure continue to skyrocket, Dynatrace is developing a deeper integration with the platform to provide even more value to organizations that run their businesses on Azure or use it as a part of their multi-cloud strategy. See the health of your big data resources at a glance. Azure Front Door.

Azure 150

Azure Cloud Big Data Virtualization 150

Dynatrace

OCTOBER 17, 2022

Artificial intelligence for IT operations, or AIOps, combines big data and machine learning to provide actionable insight for IT teams to shape and automate their operational strategy. This makes developing, operating, and securing modern applications and the environments they run on practically impossible without AI.

DevOps 202

DevOps Artificial Intelligence Healthcare Innovation 202

High Scalability

APRIL 14, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Scalability Engineering 105

High Scalability

MAY 12, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

APRIL 28, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 102

Education Software Engineering Scalability Engineering 102

KeyCDN

OCTOBER 2, 2018

In the world of web development, those who become experts usually do so by learning from their predecessors. Reading and following the right web development blogs makes it much easier to get a solid education. That’s why we’ve compiled an exhaustive list of web development blogs and newsletters to make this process easier.

Development 75

Development Website Design Code 75

High Scalability

MARCH 24, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Engineering Big Data 105

All Things Distributed

AUGUST 17, 2011

No Server Required - Jekyll & Amazon S3. The increasing sophistication of client-side JavaScript has redefined what dynamic means; where in the past dynamic content would be mainly server generated, today much content is served statically with JavaScript on the client side doing the dynamic modifications. No Server Required.

Servers 126

Servers Social Media AWS Website 126

High Scalability

MAY 26, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 100

Education AWS Software Engineering Scalability 100

High Scalability

MARCH 30, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Engineering Big Data 105

Percona

JANUARY 19, 2023

Sharding: Sharding is the concept of splitting data horizontally, i.e. by distributing data into multiple servers (shards), meaning that the different portions of data for a given table, may be stored on many different servers. This can help to split large data sets into smaller ones stored in multiple servers.

Open Source 85

Open Source Storage Database Big Data 85

All Things Distributed

DECEMBER 13, 2016

With the launch of the AWS Europe (London) Region, AWS can enable many more UK enterprise, public sector and startup customers to reduce IT costs, address data locality needs, and embark on rapid transformations in critical new areas, such as big data analysis and Internet of Things. Fraud.net is a good example of this.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

Percona

MARCH 15, 2023

Operators seamlessly handle lots of Kubernetes primitives and database configuration bits and pieces, all to remove toil from operation teams and provide a self-service experience for developers. The why Percona Server for MongoDB can handle petabytes of data. The feature is now in technical preview.

Database 83

Database Big Data Processing Servers 83

Alex Podelko

DECEMBER 19, 2019

. – which would be great to attend to keep up with recent developments and their impact on my area. What’s that VM/Server Doing? How is DevOps changing the Modern Software Development Landscape? , – Today’s hottest question for development – how we build performance engineering into continuous integration.

Efficiency 100

Efficiency Artificial Intelligence Scalability Performance 100

Testsigma

MAY 14, 2021

The traditional testing that was done on the software installed on local servers is now slowly fading away. Executed on the local servers of the organisation. Executed on third-party servers of the service providers. Data is present on the local server and hence cannot be accessed from everywhere.

Cloud 67

Cloud Testing Testing Tools Internet 67

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. However, building and utilizing HCM presents challenges, including interconnecting various memory technologies (e.g.,

Latency 52

Latency Hardware Cache Architecture 52

All Things Distributed

APRIL 4, 2017

We have also added teams in the Nordics to help customers of all sizes as they move to AWS, including account managers, solutions architects, business developers, partner managers, professional services consultants, technology evangelists, start-up community developers, and more.

AWS 116

AWS Airlines Latency Games 116

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Why are developers using RInK systems as part of their design? Fetching too much data in a single query (i.e.,

Cache 79

Cache Latency Google Lambda 79

ScaleOut Software

NOVEMBER 24, 2020

It sends messages over the cell network to the telematics system, which uses its compute servers (that is, web and application servers) to store incoming messages as snapshots in an in-memory data grid , also known as a distributed cache. The results of batch analysis are typically produced after an hour’s delay or more.

Analytics 52

Analytics Architecture Scalability Software Architecture 52

All Things Distributed

FEBRUARY 17, 2011

Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. I had held out implementing an alternative to my simple blog server that had. Driving down the cost of Big-Data analytics. Comments (). Amazon S3 FTW!

AWS 134

AWS Website Storage Servers 134

Rigor

JANUARY 13, 2020

Take, for example, The Web Almanac , the golden collection of Big Data combined with the collective intelligence from most of the authors listed below, brilliantly spearheaded by Google’s @rick_viscomi. How to use and combine these popular tools to set up a customized development workflow from start to finish.

Performance 75

Performance Social Media Website Website Performance 75

All Things Distributed

AUGUST 22, 2011

Caching has become a standard component in many applications to achieve a fast and predictable performance, but maintaining a collection of cache servers in a reliable and scalable manner is not a simple task. For more hands-on information and to get started right away, see Jeff Barrs posting on the AWS Developer Blog.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

JANUARY 19, 2011

Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements. AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Comments ().

AWS 115

AWS Cloud Java Scalability 115

All Things Distributed

FEBRUARY 25, 2011

When a new customer is onboarded, the ISV has to spin up a collection of AWS resources to run their web-servers, app-servers and databases in a multi-AZ (availability zone) setting to achieve high-availability. A simple scenario is for example the ability to clearly identify production from staging and development environments.

AWS 121

AWS Cloud Scalability Storage 121

All Things Distributed

AUGUST 16, 2011

Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. Several agencies of very different parts of the government have needs for data analytics that really put the Big in Big-Data, sometimes several orders of magnitude larger than commonly found in industry.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

DECEMBER 14, 2011

These companies can now benefit from the fact that the new Sao Paulo Region is similar to all other AWS Regions, which enables software developed for other Regions to be quickly deployed in South America as well. Please also visit the AWS developer blog for more great stories from our South American customers.

AWS 114

AWS Latency Storage Big Data 114

All Things Distributed

JULY 7, 2011

With Import into EBS customers can now develop arbitrary complex layouts as the import service is doing a full binary copy of the disk into Amazon EBS and is not interpreting file system layouts, etc. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. Spot Instances - Increased Control.

AWS 96

AWS Cloud Storage Internet 96

All Things Distributed

AUGUST 19, 2011

For more information: Head of Software Development  . Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. She (or he) will be able to reason about the standard tradeoffs in building large scale distributed databases and is capable of guiding the team to make these tradeoffs.

AWS 75

AWS Database Storage Scalability 75

All Things Distributed

DECEMBER 5, 2010

The naming system that we are all most familiar with in the internet is the Domain Name System (DNS) that manages the naming of the many different entities in our global network; its most common use is to map a name to an IP address, but it also provides facilities for aliases, finding mail servers, managing security keys, and much more.

Cloud 117

Cloud Internet Internet AWS 117