Pinterest Labs

Pinterest Labs serves as the centerpiece for machine learning research and AI product innovation. It's an initiative by Pinterest designed to develop and implement advanced AI and machine learning strategies across their platform. The firm focuses on areas like recommendation systems, computer vision models, hyper-scale graph understanding, responsible AI development, and multimodal generative modeling.

Pinterest Labs uses AI in several ways. Primarily, it uses AI for developing recommendation systems and computer vision models. The AI is used to represent Pinterest-native content through systems like OmniSage, which can represent pins, boards, products, and search queries. In addition, Pinterest Labs uses generative models, like Pinterest Canvas, for creating personalized content experiences, as well as visual embedding systems for enhanced visual understanding.

OmniSage is a unified embedding system developed by Pinterest Labs. It's designed to represent Pinterest-native content, including pins, boards, products, and search queries. This model is a culmination of a decade of graph machine learning advances initiated by Pinterest Labs.

Generative models at Pinterest Labs are used to create personalized content experiences for users. For instance, Pinterest Canvas, a multimodal image and video diffusion model, allows for open-ended image editing and enhancement. These models understand and learn from the visual graph data of Pinterest which is then used to generate new content tailored for the user.

Pinterest Canvas is a multimodal image & video diffusion model developed by Pinterest Labs. It's trained on the entirety of visual graph data of Pinterest, which allows for open-ended image editing and enhancement.