Svitla Smart Talk: Testing at scale - how to test when you go globally with a fleet of thousands of machines

We'd like to run multiple types of tests - unit tests, end-to-end tests, manual tests, A/B tests. How should we organize them so they are fast and reliable? What to do if we need to handle GDPR-protected data? How can we run those tests when thousands of machines handle the traffic? How to roll back?

In this talk, we'll see how to build a real-life end-to-end testing pipeline used in the biggest companies in the world. We'll start with unit tests running locally in milliseconds, go through correctness tests, regression tests, performance tests, and security tests, and finally end with A/B tests proving that our code is correct and provides a better customer experience. All of that is based on experience with desktop, mobile, service, and machine learning domains at the biggest companies.


Adam Furmanek - Software Developer, Blogger, Public Speaker, Book Writer. Interested in systems programming, .NET and JVM internals, big data, and machine learning. 


by Svitla Team
October 04, 2023