Take 5: The impact of Web personalization

06/08/15 – BOSTON, MA. – Dr. Christo Wilson, Assistant Professor of Computer and Information Science, discussed Measuring and Understanding Personalization of Web Services, as a part of the Minds over Matters: NUterm Faculty Speaker Series held in the Raytheon Amphitheater at Northeastern University on June 8, 2015. Staff Photo: Matthew Modoono/Northeastern University

Christo Wilson, an assistant professor in the College of Computer and Information Science at Northeastern University, discussed the ins and outs of Web personalization on Monday afternoon in the Raytheon Amphitheater. His lec­ture marked the latest install­ment in the Minds over Mat­ters: NUterm Fac­ulty Speaker Series, which fea­tures weekly pre­sen­ta­tions from top fac­ulty scholars who dis­cuss their research and examine timely topics of global importance.

Here are five takeaways from his lecture:

Web personalization is ubiquitous

Do an innocuous Google search for “Old Navy” on your laptop in your residence hall and you’ll get a personalized set of results for the popular clothing retailer, including a list of the chain’s local stores. Or log in to your Netflix account and browse through row after row of movies and TV shows—films and programs that have been suggested to you based on the streaming service’s recommendation algorithms.

It’s no surprise anymore: Whether you’re killing time on social media platforms like Facebook, shopping for goods on e-commerce sites like Amazon, or downloading tunes from music services like Pandora, the content you see—and the products you purchase—have been tailored to match your preferences.

“We’ve all encountered personalization,” said Wilson, whose scholarship focuses on using measured data to analyze and understand the complex phenomenon of the Web. “By and large we love this stuff, and we’re delighted when Netflix knows we’re fans of House of Cards and tells us when the new season will be available.”

Price discrimination—and price steering—is a common practice

Wilson does not dispute the potential beauty of Web personalization, which oftentimes makes our lives better, simpler, and more convenient. But the practice, he said, is not infallible, and sometimes leads to cases of intentional manipulation and discrimination.

He and his research colleagues recently examined 16 pop­ular e-​​commerce sites—10 gen­eral retailers and six hotel and car rental sites—to mea­sure two spe­cific forms of per­son­al­iza­tion: price dis­crim­i­na­tion, in which a product’s price is cus­tomized to the user; and price steering, in which the order of search results are cus­tomized to the user. They found evi­dence of per­son­al­iza­tion on four gen­eral retailers and five travel sites, including cases where sites altered prices by hun­dreds of dol­lars.

Among their findings: Cheaptickets and Orbitz imple­mented price dis­crim­i­na­tion by offering reduced prices on hotels to “mem­bers”; Expedia and Hotels​.com steered a subset of users toward more expen­sive hotels; and Home Depot and Trav­e­locity per­son­al­ized search results for users on mobile devices.

“My goal is to increase transparency,” Wilson said. “Only when you understand a system and its data can you have an informed discussion on how it’s being used and whether we’re willing to accept that.”

Home Depot, Wilson found, personalized search results for users on mobile devices.

Home Depot, Wilson found, personalized search results for users on mobile devices.

Google forgets after 10 minutes

Yes, Wilson said, it’s true: Google is intuitive and has the ability to shape the results of your next query based on your prior search history. This, he said, is called the carryover effect, wherein one past search can affect the results of the next search. But there is a caveat—and it’s a pretty big one. “Google only cares about prior search history for 10 minutes,” he said. “After 10 minutes they don’t care anymore. They forget.”

Mobile devices>laptops

In the Q&A following his lecture, one student asked Wilson to offer up some tips for getting the best price when shopping online. In response, he noted that “there is no simple answer since every site is doing something different,” and then reeled off a few must-do’s:

  • Conduct your searches in a private browsing window, which will enable you to surf the Web without leaving a trail of cookies;
  • Eschew your laptop for your smartphone or your tablet (Wilson and his research colleagues found that Travelocity offers discounts on hotels for users on mobile devices);
  • And call up a friend to do a second search—his Internet cookies will be different—and then compare the results

Hacking is permitted

Wilson is one of five members of Northeastern’s personalization research group, which is housed within the College of Computer and Information Science. He and his colleagues post their open-source data and code from their research projects to their website, where you can find in-depth explanations of their work. “Everything we do is open source,” Wilson said. “If you’re technically-minded, go hack away.”