Software engineering for machine learning: a case study

The Morning Paper

Software engineering for machine learning: a case study Amershi et al., Respondents were well spread across data and applied science (42%), software engineering (32%), program management (17%), research (7%) and other (1%).

Team building in software engineering

Tasktop

This can be a challenge for engineering teams: engineers can be less social and more competitive than non-engineers. We’re typically heads-down, and it seems any interaction we have is just business: problem solving, design discussions, code review comments, story planning. The post Team building in software engineering appeared first on Tasktop Blog. EngineeringWhen you come in to work, do your teammates greet you? Are jokes told on your team?

From Student to Junior Software Engineer at Tasktop

Tasktop

The beginning of my experience as a Junior Software Engineer on one of Tasktop’s ‘Integrations Teams’ marked a definitive transition in the way I learned and practiced computer science and software development. I was drawn to Tasktop because of its strong impact on the software development industry. Software Engineers, was introduced to the fundamental concepts and tools on which Tasktop is built. Looking for a career in software development?

The 737Max and Why Software Engineers Might Want to Pay Attention

J. Paul Reed

The 737Max and Why Software Engineers Might Want to Pay Attention As someone with a bit of a reputation for talking about aviation and software development and operations , I’ve been asked about the 737Max repeatedly over the past week.

The ‘Chocolate Sauce’ Design Heuristic

Strategic Tech

A trip to the supermarket can teach you a lot about designing software systems and shaping teams to build them… I was recently in need of some chocolate sauce. The designers of the supermarket had to decide where the chocolate sauce should live.

How Netflix microservices tackle dataset pub-sub

The Netflix TechBlog

This post is a high level overview of the design and architecture of Gutenberg. An important point to note is that Gutenberg is not designed as an eventing system?—?it Gutenberg, however, is designed for publishing and consuming an entire immutable view of a dataset.

Cache 184

Automating chaos experiments in production

The Morning Paper

degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. ChAP runs chaos engineering experiments within Netflix’s production systems. Uncategorized Operations Software Engineering

Teaching rigorous distributed systems with efficient model checking

The Morning Paper

We would like students to consider the performance characteristics of their systems, and our tests check that their designs attain reasonable run-time performance. and used to taking small incremental steps, fail to appreciate the need for some degree of up-front design. (Of

Three key checklists and remedies for trustworthy analysis of online controlled experiments at scale

The Morning Paper

Last time out we looked at machine learning at Microsoft , where we learned among other things that using an online controlled experiment (OCE) approach to rolling out changes to ML-centric software is important. Experiment design analysis checklist. Uncategorized Software Engineering

Book Review: Pro JavaScript Design Patterns

Tim Kadlec

The books reviewed will all be somehow related to web development or design so you will never hear me tell you how much I enjoyed Stephen King’s Dark Tower series or Napoleon’s Pyramids by William Dietrich… except for right now of course. Pro JavaScript Design Patterns is written by Ross Harmes and Dustin Diaz. Ross is a front-end engineer from Yahoo! Dustin works for Google as a user interface engineer.

Stuff The Internet Says On Scalability For October 5th, 2018

High Scalability

Because the device in question is a high-speed unit designed to process a high volume of ballots for an entire county, hacking just one of these machines could enable anattacker to flip the Electoral College and determine the outcome of a presidential election?. Hey, wake up!

How It Works: SQL Server Lock Partitioning

SQL Server According to Bob

The lock manager (LockMgr) is designed to track partitioned and non-partitioned locks. The lock manager design allows lock types benefiting from partitioning to co-exist with non-partitioned lock types and increased scalability. Bob Dorr – Principal Software Engineer SQL Server

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. Design a flexible data model ? —?Represent

World’s Top Web Performance Leaders To Watch

Rigor

Reading time 16 min Whether you’re a web performance expert, an evangelist for the culture of performance, a web engineer incorporating performance into your process, or someone new to the web performance entirely, you probably identify as curious, excited about new ideas, and always learning.

Tackling the Pipeline Problem in the Architecture Research Community

ACM Sigarch

Her current work focuses on hardware/software co-design for extremely large-scale deep learning training. Lena Olson is a Software Engineer at Google. . Disclaimer: Newsha is a Research Scientist at Baidu and Lena is a Software Engineer at Google.

Sponsored Post: Fauna, Sisu, Educative, PA File Sight, Etleap, PerfOps, Triplebyte, Stream

High Scalability

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

Sponsored Post: InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. For heads of IT/Engineering responsible for building an analytics infrastructure , Etleap is an ETL solution for creating perfect data pipelines from day one. Unlike older enterprise solutions, Etleap doesn’t require extensive engineering work to set up, maintain, and scale. Who's Hiring?

Sponsored Post: Etleap, PerfOps, InMemory.Net, Triplebyte, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. For heads of IT/Engineering responsible for building an analytics infrastructure , Etleap is an ETL solution for creating perfect data pipelines from day one. Unlike older enterprise solutions, Etleap doesn’t require extensive engineering work to set up, maintain, and scale. Who's Hiring?

Snap: a microkernel approach to host networking

The Morning Paper

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The little engine that could.

How It Works: SQL Server Lock Iteration / Enumeration

SQL Server According to Bob

The iterator is designed to remain lock free whenever possible to avoid contention with active queries. Bob Dorr – Principal Software Engineer SQL Server When executing a query to enumerate the locks, such as select * from sys.dm_tran_locks,

Sponsored Post: InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. For heads of IT/Engineering responsible for building an analytics infrastructure , Etleap is an ETL solution for creating perfect data pipelines from day one. Unlike older enterprise solutions, Etleap doesn’t require extensive engineering work to set up, maintain, and scale. Who's Hiring?

Sponsored Post: Educative, PA File Sight, Etleap, PerfOps, InMemory.Net, Triplebyte, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet. Unlike older enterprise solutions, Etleap doesn’t require extensive engineering work to set up, maintain, and scale.

Sponsored Post: InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. For heads of IT/Engineering responsible for building an analytics infrastructure , Etleap is an ETL solution for creating perfect data pipelines from day one. Unlike older enterprise solutions, Etleap doesn’t require extensive engineering work to set up, maintain, and scale. Who's Hiring?

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr, MemSQL

High Scalability

Engineers will be tasked with building new products and features to solve business and ecommerce challenges as we're dealing with engaging problems at a massive scale and will create solutions that impact millions of people around the world. Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr, MemSQL

High Scalability

Engineers will be tasked with building new products and features to solve business and ecommerce challenges as we're dealing with engaging problems at a massive scale and will create solutions that impact millions of people around the world. Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Engineers will be tasked with building new products and features to solve business and ecommerce challenges as we're dealing with engaging problems at a massive scale and will create solutions that impact millions of people around the world. Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

Making our Android Studio Apps Reactive with UI Components & Redux

The Netflix TechBlog

Our very first mobile app is called Prodicle and was built for Android & iOS using the same reactive architecture in both platforms, which allowed us to build 2 apps from scratch in 3 months with 4 software engineers.

Sponsored Post: Datadog, InMemory.Net, Triplebyte, Etleap, Scalyr, MemSQL

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. For heads of IT/Engineering responsible for building an analytics infrastructure , Etleap is an ETL solution for creating perfect data pipelines from day one. Unlike older enterprise solutions, Etleap doesn’t require extensive engineering work to set up, maintain, and scale. Who's Hiring?

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Watch a demo and learn how Etleap can save you on engineering hours and decrease your time to value for your Amazon Redshift analytics projects. Shape the future of software in your industry.

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Watch a demo and learn Etleap can save you on engineering hours and decrease your time to value for your Amazon Redshift analytics projects. Shape the future of software in your industry. Who's Hiring?

SQL Mysteries: Why is my SQL Server experiencing lots of 17830 (TCP 10054) errors?

SQL Server According to Bob

Unfortunately, the timings were always small and not something the SQL Server engine was doing, instead the client was closing the connection. The design where the first connection to be opened wins is a nice addition to the connection capabilities. Bob Dorr – Principal Software Engineer SQL Server I was reviewing a test run this week that had more SQL 17830 (TCP 10054 / 0x2746) errors than I could explain from just kills or login timeouts.

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Watch a demo and learn how Etleap can save you on engineering hours and decrease your time to value for your Amazon Redshift analytics projects. Shape the future of software in your industry.

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Shape the future of software in your industry. The Software Buyers Council is a panel of engineers and managers who want to share expert knowledge, contribute to improvement of software, and help startups in their industry. Why engineers are joining the Software Buyers Council: 1) Make a big impact.

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Shape the future of software in your industry. The Software Buyers Council is a panel of engineers and managers who want to share expert knowledge, contribute to improvement of software, and help startups in their industry. Why engineers are joining the Software Buyers Council: 1) Make a big impact.

Sponsored Post: NationBuilder, Twitch, InMemory.Net, Triplebyte, Etleap, Scalyr, MemSQL

High Scalability

NationBuilder — if you’re a systems engineer, SRE or DevOps focused developer and have been looking for a place where you can help other people while still working in tech? Engineers will be tasked with building new products and features to solve business and ecommerce challenges as we're dealing with engaging problems at a massive scale and will create solutions that impact millions of people around the world. Who's Hiring?

Sponsored Post: pMD, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Senior DevOps Engineer : Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast. Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

Sponsored Post: Datadog, InMemory.Net, Triplebyte, Etleap, Scalyr, MemSQL

High Scalability

Engineers will be tasked with building new products and features to solve business and ecommerce challenges as we're dealing with engaging problems at a massive scale and will create solutions that impact millions of people around the world. Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

How to drive customer obsessed Product Development

Tasktop

In my past career as a Software Engineer at a giant Fintech company, I seldom got the chance to talk with the Product Manager of my team. A healthy relationship between the PM and Engineering is critical to building customer-centric products.

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr, MemSQL

High Scalability

Engineers will be tasked with building new products and features to solve business and ecommerce challenges as we're dealing with engaging problems at a massive scale and will create solutions that impact millions of people around the world. Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Who's Hiring?

Organise your engineering teams around the work by reteaming

Abhishek Tiwari

When it comes to organising engineering teams, a popular view has been to organise your teams based on either Spotify's agile model (i.e. One thing stand-out to me is being intentional and practical about your engineering organisation design. hires more full-stack engineers.

10 talks to look for at the 2018 O'Reilly Software Architecture Conference in London

O'Reilly Software

From chaos architecture to event streaming to leading teams, the O'Reilly Software Architecture Conference offers a unique depth and breadth of content. Two of the outstanding features of the O'Reilly Software Architecture Conference are the depth and breadth of our content.

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Shape the future of software in your industry. The Software Buyers Council is a panel of engineers and managers who want to share expert knowledge, contribute to improvement of software, and help startups in their industry. Why engineers are joining the Software Buyers Council: 1) Make a big impact.

SQL Server on IoT Edge and Developer Machines – Smaller Footprint

SQL Server According to Bob

Engineering Rigor. As we ranked the ideas a pattern emerged, termed ‘ Engineering Rigor. Testing shows that locking mechanisms, such as spin locks, start to become saturated when shared across 8 to 12 CPUs and where the physics become a direct contributor to partitioned design. Bob Dorr – Principal Software Engineer SQL Server. . SQL Server will ship Azure SQL Database Edge: [link].

IoT 54