Pinterest and Nvidia Speed Up AI Search 85-Fold
Pinterest and Nvidia have built an AI infrastructure on Blackwell GPUs: responses generate 85 times faster, latency has dropped by a factor of 7.3, and Pinterest Assistant takes into account 25 times more visual data.
A new AI infrastructure built by Pinterest together with Nvidia makes it possible, on average, 85 times faster to begin generating a response to a user query. Overall latency has been reduced by a factor of 7.3, according to the companies' press release.
The system runs on Nvidia Blackwell GPUs and the Nvidia Dynamo software platform, along with Pinterest's in-house image analysis developments. It helps algorithms analyze images and text simultaneously.
What Will Change for Users?
The main beneficiary of the update is Pinterest Assistant, an AI assistant for finding ideas and products. After the update, it takes into account 25 times more visual information when processing a single query.
Pinterest will also leverage data from more than 80 billion search queries that users make on the platform every month. The company expects to understand audience interests more accurately and improve product recommendations.
Why Did the System Get Faster?
Previously, models re-analyzed the source image on every query. Now Pinterest preprocesses the images and feeds the model already-prepared information about them.
Internal tests showed the result: responses begin generating 85 times faster on average, and overall latency has dropped by a factor of 7.3.
Where Else Is the Technology Used?
- recommendation algorithms;
- visual search and online shopping;
- content safety verification tools;
- text recognition in images;
- the platform's advertising technologies.
Instead of building separate infrastructure for each new AI feature, different Pinterest teams use a shared technology base.
How Long Have the Companies Been Partners?
Pinterest and Nvidia have been working together for nearly five years. During that time, Pinterest has deployed more than 14,000 Nvidia GPUs. The company plans to use the new infrastructure as the foundation for further development of visual and conversational AI tools.
Original: newsroom.pinterest.com
More from Екатерина Ларина
132 articles
Related articles
- Elvis Presley Song Rights Holders Demand $41.1 Million from Anthropic
- Pinduoduo and Anthropic paid Kazakhstan 8 billion tenge in taxes
- Disney Will Show Super Bowl 2027 Through the Eyes of Star Wars Characters
- Mom's Touch to Open 50 Restaurants in Kazakhstan with Shin-Line
- Prada answered AI slop with a pencil: 6 million views and mice in the style of Disney