Sharon Ferguson / en How does Spotify know what you like? Expert sheds light on 'recommender' systems at 老司机直播 event /news/how-does-spotify-know-what-you-expert-sheds-light-recommender-systems-u-t-event <span class="field field--name-title field--type-string field--label-hidden">How does Spotify know what you like? Expert sheds light on 'recommender' systems at 老司机直播 event </span> <div class="field field--name-field-featured-picture field--type-image field--label-hidden field__item"> <img loading="eager" srcset="/sites/default/files/styles/news_banner_370/public/2023-05/PXL_20230327_185237613-crop.jpeg?h=afdc3185&amp;itok=vEijg89i 370w, /sites/default/files/styles/news_banner_740/public/2023-05/PXL_20230327_185237613-crop.jpeg?h=afdc3185&amp;itok=0-XT4eXe 740w, /sites/default/files/styles/news_banner_1110/public/2023-05/PXL_20230327_185237613-crop.jpeg?h=afdc3185&amp;itok=NTwGiyNq 1110w" sizes="(min-width:1200px) 1110px, (max-width: 1199px) 80vw, (max-width: 767px) 90vw, (max-width: 575px) 95vw" width="740" height="494" src="/sites/default/files/styles/news_banner_370/public/2023-05/PXL_20230327_185237613-crop.jpeg?h=afdc3185&amp;itok=vEijg89i" alt="&quot;&quot;"> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span>Christopher.Sorensen</span></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2023-05-03T09:14:48-04:00" title="Wednesday, May 3, 2023 - 09:14" class="datetime">Wed, 05/03/2023 - 09:14</time> </span> <div class="clearfix text-formatted field field--name-field-cutline-long field--type-text-long field--label-above"> <div class="field__label">Cutline</div> <div class="field__item"><p>Mounia Lalmas, senior director of research at Spotify, and with 老司机直播 Assistant Professor Ashton Anderson recently took part in an event hosted by the Schwartz Reisman Institute for Technology and Society (photo by Marco Monteiro Silva)</p> </div> </div> <div class="field field--name-field-topic field--type-entity-reference field--label-above"> <div class="field__label">Topic</div> <div class="field__item"><a href="/news/topics/our-community" hreflang="en">Our Community</a></div> </div> <div class="field field--name-field-story-tags field--type-entity-reference field--label-hidden field__items"> <div class="field__item"><a href="/news/tags/schwartz-reisman-institute-technology-and-society" hreflang="en">Schwartz Reisman Institute for Technology and Society</a></div> <div class="field__item"><a href="/news/tags/artificial-intelligence" hreflang="en">Artificial Intelligence</a></div> <div class="field__item"><a href="/news/tags/computer-science" hreflang="en">Computer Science</a></div> <div class="field__item"><a href="/news/tags/faculty-arts-science" hreflang="en">Faculty of Arts &amp; Science</a></div> <div class="field__item"><a href="/news/tags/music" hreflang="en">Music</a></div> </div> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>Streaming giant Spotify鈥檚&nbsp;popularity&nbsp;is due in part to its uncanny&nbsp;ability to sift through a library of more than 82 million tracks&nbsp;to match the tastes of&nbsp;each of its&nbsp;500 million monthly active users.</p> <p>How does it do it?&nbsp;The answer lies in the platform鈥檚 recommender machine learning algorithms, which develop custom content individual users based on their past behaviour.&nbsp;</p> <p>Mounia Lalmas, senior director of research at Spotify, shed light on some of the techniques used by the world鈥檚 largest music streaming platform at a recent event hosted by&nbsp;the University of Toronto鈥檚 Schwartz Reisman Institute for Technology and Society (SRI).</p> <p>She emphasized the importance of 鈥渃reating personalized listening experiences鈥 and delved into how Spotify processes data to match users and tracks, providing insight into the types of data used, which includes not only the taste preferences of users, but also their interactions with the app, including time of day&nbsp;and history.</p> <p>鈥淩eally, what is important for Spotify are two sides: the artists and creators, and the listeners and users,鈥 said&nbsp;Lalmas,&nbsp;who leads&nbsp;a team of interdisciplinary researchers at Spotify who are working on personalization. 鈥淲e focus on both, and how we view things is really a symbiotic relationship where each side matters equally.鈥</p> <p>Rather than seeking to predict the next click, Lalmas&nbsp;鈥&nbsp;who holds an honorary professorship at University College London and is a distinguished research fellow at the University of Amsterdam&nbsp;鈥 said the goal&nbsp;is to develop algorithms that guide users鈥 long-term journeys, and that this necessarily shifts what factors determine a 鈥済ood recommendation.鈥 She rounded out her presentation by sharing recent methods her team has developed, including how the platform is supporting users to explore diverse content and helping to connect users with new artists.</p> <p>The event, held at the Rotman School of Management, also featured&nbsp;SRI Research Lead <strong>Ashton Anderson</strong>, an assistant professor in 老司机直播鈥檚 department of computer science in the Faculty of Arts &amp; Science.&nbsp;Anderson鈥檚 research in the field of computational social science led him to Spotify in 2018 鈥 and a collaboration with Lalmas 鈥 to explore how algorithms impact user journeys.</p> <style type="text/css">.embed-container { position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden; max-width: 100%; } .embed-container iframe, .embed-container object, .embed-container embed { position: absolute; top: 0; left: 0; width: 100%; height: 100%; } </style> <div class="embed-container"><iframe allowfullscreen frameborder="0" src="https://www.youtube.com/embed/NHhJgpQxF_8"></iframe></div> <h4>&nbsp;</h4> <h4>Creating personalized listener experiences</h4> <p>At the heart of Spotify鈥檚 listening experience lies a sophisticated recommendation engine composed of three layers: data, models, and experience.&nbsp;</p> <p>Beginning with data, Lalmas highlighted the role of user playlists and listening history, as well as instrumentation 鈥 the actions taken on the platform 鈥 in shaping recommendations. For instance, a user who spends a lot of time scrolling is likely seeking out new content rather than something they are already familiar with, she said, adding that Spotify uses metadata provided by the music label, as well as the audio profile of the song&nbsp;to further factor into its recommendations.</p> <figure role="group" class="caption caption-drupal-media align-left"> <div> <div class="field field--name-field-media-image field--type-image field--label-hidden field__item"> <img loading="lazy" src="/sites/default/files/2023-05/IMG_8706-crop.jpeg" width="750" height="500" alt="People seated in a conference room"> </div> </div> <figcaption><em>(photo by Dan Browne)</em></figcaption> </figure> <p>Next, user and track data are mapped onto an embedding space that enables the platform to assess relationships between content. In natural language processing, embeddings enable systems to grasp the relative proximity between words 鈥 for instance, the word 鈥渄og鈥 would be closer to 鈥渃at鈥 than to 鈥渢ree.鈥 Every track, artist&nbsp;and user can be represented in this space, which serves as a backbone for the platform鈥檚 models, while proximity within these spaces determines similarity and cohesion.</p> <p>The last layer is experience, which consists of the app that Spotify users interact with. Recommendation engines power tailored playlists in this layer, including 鈥淒iscover Weekly,鈥 and determine how content is surfaced on a user鈥檚 homepage. This layer provides crucial feedback (for example, a user who skips a suggested song), which helps the engine to continuously refine its recommendations, Lalmas said.</p> <h4>Balancing wants and needs</h4> <p>Lalmas said that recommendation systems should&nbsp;deliver a lifetime of content, with the goal of building trust. To do this,&nbsp;algorithms must be fine-tuned to strike a balance between satisfying users鈥 wants and needs.</p> <p>Imagine, for example,&nbsp;that you opened a newly recommended playlist&nbsp;and you skipped the first five songs because they weren鈥檛 your style. Feeling frustrated, you would probably close the playlist. On the other hand, if the app continually suggests only familiar songs, you鈥檇 soon become bored. The key to engage&nbsp;listeners, Lalmas said, is striking a delicate balance between the two.</p> <h4>Diversifying listening experiences</h4> <p>Lalmas wrapped up her talk by sharing some of the progress her team has made towards understanding how to diversify listening experiences, including a survey of recent research publications.</p> <p>In <a href="https://dl.acm.org/doi/abs/10.1145/3488560.3498477">a paper presented at the 2022 ACM Conference on Web Search and Data Mining</a>, her team proposed and evaluated a machine learning algorithm that models a user鈥檚 recent sequential listening patterns (which change quickly) and their all-time listening profile (which changes slowly). The result is a more accurate user profile developed over time, improving recommendations.</p> <p>In <a href="https://dl.acm.org/doi/10.1145/3442381.3450028">a collaboration with Anderson</a>, Lalmas and team modelled the evolution of user preferences over time. Their findings showed that changes in musical preferences were directional, meaning that those who listened to hard rock may eventually develop an interest in blues rock, but those who started with blues rock would not shift to hard rock. By identifying these preferential pathways, it can become possible to introduce users to new music different enough to diversify their listening 鈥 but not different enough for engagement to drop.</p> <p>Another collaborative project between Anderson and Lalmas analyzed the long-term consequences of Spotify recommendations on users鈥 listening habits. They labelled users as 鈥済eneralists鈥 or 鈥渟pecialists鈥 based on the diversity of songs they listen to, and found that recommender systems can be fine-tuned to encourage diverse listening without affecting engagement&nbsp;by steering consumption towards less popular content. This study highlights a common challenge with recommender systems: the tendency to promote the most popular items, which can lead to 鈥渞ich-get-richer鈥 scenarios.</p> <p>The influence of algorithmic recommendations on consumption has motivated researchers to investigate their technical design and governance. Meanwhile,&nbsp;finding new ways to align recommender systems with social values has emerged as an important area of research.</p> <p>SRI Director and Chair <strong>Gillian Hadfield</strong> is currently engaged in a multi-stakeholder project exploring how to improve user satisfaction with Facebook鈥檚 recommender systems, which proposes that partnerships between academia and Big Tech are vital to shed light on the social impacts of algorithms. Recommender systems were also the focus of a session at SRI鈥檚 2022 Absolutely Interdisciplinary conference, which discussed the importance of policy to shape the design of algorithms in the context of democratic rights.</p> <p>Lalmas noted that&nbsp;diversity is key when creating personalized experiences, and that 鈥渁 diverse and dynamic diet鈥 generates long-term benefits for users and platforms alike.&nbsp;</p> </div> <div class="field field--name-field-news-home-page-banner field--type-boolean field--label-above"> <div class="field__label">News home page banner</div> <div class="field__item">Off</div> </div> <div class="field field--name-field-add-new-author-reporter field--type-entity-reference field--label-above"> <div class="field__label">Add new author/reporter</div> <div class="field__items"> <div class="field__item"><a href="/news/authors-reporters/sharon-ferguson" hreflang="en">Sharon Ferguson</a></div> </div> </div> Wed, 03 May 2023 13:14:48 +0000 Christopher.Sorensen 301482 at