HubofML - Newsletter #7
ML Engineering Best Practices, Debugging Google's Distributed Systems, The $10m Engineering Problem, Soft Skills for Managers & More
Hey,
Welcome to another edition of my newsletter, the seventh this year, which I hope will spark new ideas 💡 and provide you with useful information on how tech companies are tackling various engineering problems. 💯 If you miss the last one, you can catch up here.
I want to make sure each edition brings something valuable to you; that's why your feedback matters to me. If you have any ideas or requests for future editions, let me know.
I hope you enjoy this month's edition. Please forward it to a friend, colleague, or stranger you just met. 🙏
Let's get started!
Machine Learning (ML)
Best Practices for ML Engineering
Martin Zinkevich, a research scientist at Google, published this 24-pages document on ML engineering's best practices from around Google.
Scalable Data Classification for Security and Privacy
Facebook published a paper on solving privacy problems within Facebook at scale, enforce data retention and access controls automatically.
Using Machine Learning to Predict What File you Need Next at Dropbox (Part 2)
Using an ML model to improve folder and cloud-based documents suggestions at Dropbox.
How Machine Learning Brings Medium's Tags to Life
Tags are used to describe posts, and due to tags' free-form nature, it can quickly grow to millions. Here is a post on how Medium is enhancing tags with machine learning.
Object Detection with RetinaNet
Srihari Humbarwadi wrote this guide on implementing a fast, accurate object detection with RetinaNet.
How Pinterest Uses AutoML, Multi-task Learning, and Multi-tower Models for Pinterest Ads
How Pinterest switched from a single output node deep neural net (DNN) to multi-task learning (MTL) based DNN and calibrated each output node's probability prediction to be combined into a utility value.
Powering Inclusive Search & Recommendations with Pinterest New Visual Skin Tone Model
How Pinterest developed more inclusive skin tone ranges for its search and recommendation engines.
Grammatical Error Correction: Tag, Not Rewrite
Kostiantyn Omelianchuk shares how Grammarly is using sequence-tagging to correct errors in Grammar.
Building a Large-scale Transactional Data Lake at Uber Using Apache Hudi
Apache Hudi is a storage abstraction framework that helps distributed organizations build and manage petabyte-scale data lakes. Nishith Agarwal shares how Uber is building a large-scale transactional data lake using Apache Hudi.
Software Engineering
Things I Learned to Become a Senior Engineer
Valuable lessons from Neil Kakkar on things he learned to become a Senior Engineer.
Systems Design for Advanced Beginners
Systems design is an integral part of software engineering. If you're looking for an entry into system design, you should read this.
Debugging Incidents in Google's Distributed Systems
Debugging is something we do every day. Have you ever wondered how it's done on complex distributed systems? Here is how experts debug production issues in complex distributed systems at Google
Scaling to 100k Users
Many startups have been there - what feels like legions of new users are signing up for accounts every day, and the engineering team is scrambling to keep things running. But how do you take a web app from 0 to hundreds of thousands of users?
Going Faster With Continuous Delivery
An insightful post on Amazon's journey to continuous deployment.
Recipe for Software Development Success
Elegant software is not born; It's created following a recipe. Here is moove-it's recipe for software development.
The $10m Engineering Problem
For every dollar that a business makes, how many dollars does it cost to deliver? Reducing delivery cost by a penny is equally as important as making a penny from the delivery. This post contains valuable lessons learned at Segment on saving software delivery costs.
Under Deconstruction: The State of Shopify's Monolith
Monolith applications can be complex to manage, and adding features in a structured, well-bounded way for a growing organization is daunting. This post from Shopify shares how they're managing their monolith app.
Tech Leadership
Soft Skills for Managers
@staysassy shares a few valuable soft skills for managers and some ideas in how to access them in interviews.
Want to Code as an Engineering Manager? Time to Find a Unicorn
Robyn Rap shared some of what I've learned: the challenges of coding as an engineering manager, the benefits, and the ways to identify well-scoped unicorn projects to work on.
Thanks for reading
Thanks for reading! If you like this newsletter and want to support it, please share it with others. If you have feedback, send it to me via mail.
Cheers,
Samuel