USA: Computer Scientists, including a Moroccan, Devise Algorithm to Break Through ‘Search Bubbles’

A group of computer scientists from the New York University (NYU), which includes a Moroccan national, has devised a way to break through search bubbles with an algorithm, called Pyrorank, which reduces the impact of users’ profiles and broadens recommendations that still reflect the focus of the search. Pyrorank, which draws from the natural world—mimicking interactions in an ecosystem, takes into account the content a user is seeking by capturing an array of recommendations. Pyrorank functions as an algorithmic “add-on” to existing recommender systems, NYU says in a release. “It does so by reducing the impact of users’ profiles and broadening recommendations that still reflect the focus of the search, producing more diverse and useful results”, the release adds. “When it comes to inspiration for solutions to computer science problems, nature is the perfect place to look,” explains Morocco’s Anasse Bari, a clinical associate professor at NYU’s Courant Institute of Mathematical Sciences and a co-creator of the algorithm. “Natural phenomena, such as bird flocks searching for food, show that nature can often find optimal, yet simple, solutions to address needs,” the researcher points out. The work appears in a newly released volume, Advances in Swarm Intelligence (Springer Nature).  Recommendation systems, used by Google, Netflix, and Spotify, among others, are algorithms that use data to suggest or recommend products or choices to consumers based on the users’ past purchases, search history, and demographics. However, these parameters bias search outcomes because they put users in filter bubbles. “The traditional way recommendation systems work is by basing recommendations on the notion of similarity,” explains Bari, who leads the Courant Institute’s Predictive Analytics and AI Research Lab. “This means that you will see similar items in the choice and recommended lists based on either users similar to you or similar items you have bought. For instance, if I am an Apple product user, I will increasingly see more and more Apple products in my recommendations,” he stresses. The limitations of existing recommendation systems have become evident in striking ways.  To address these concerns, Bari and his colleagues created Pyrorank, an algorithm that takes into account the content a user is seeking by capturing an array of recommendations while, at the same time, diminishing the emphasis of what the user has already purchased or interacted with. “This makes it highly adaptable compared to replacing the whole recommendation pipeline to promote diversification, potentially saving many engineer-hours,” explains Bari, who developped the new algorithm along with Nicholas Greenquist and Doruk Kilitcioglu.  In testing the viability of the algorithm, the researchers compared the search outcomes generated by the Pyrorank add-on with those from traditional recommender systems by using three large datasets—MovieLens, which offers user-generated movie ratings, as well as Good Books and Goodreads, which house readers’ book ratings. They then ran a series of experiments to determine which systems created a greater diversity of recommended content while also staying true to the aims of the core recommendations, NYU underlines. Overall, the systems using Pyrorank generated more diverse recommendations than did existing ones, demonstrating its value in breaking through filter bubbles. “You can apply a very small amount of diversity tuning and still get large gains in the range of outcomes while only marginally reducing predictive accuracy,” explains Bari. “Each case will be different, depending on the context of the recommendation system. While there is some give-and-take between diversity and accuracy, recommender systems can be calibrated to bolster the heterogeneity of search outcomes while minimizing the loss of accuracy.” “Successf