Newly open sourced XSE handles six million queries a second across services including Search, Ads, and YouTube Shorts Train in Python, serve in C++ might as well be Google motto when it comes to much of its ML work. Python is easy for data scientists to wield, but keeping its interpreter in the serving pipeline can add overhead and deployment headaches. The industry backed OpenXLA Project provides tools for compiling machine learning computations into native code for different processors. The...
