Airbnb: Data Informed Decision Making
From guiding hosts to perfect pricing, to refining guest search results, to doubling the ratio of female employees. How Airbnb uses data to drive real change.
Airbnb: Data informed not data driven
The highly successful startup believes that using data in highly complex environments is challenging. The company believes that it is common for data scientists to “toss the results of an analysis ‘over the wall’ and then move on to the next problem”, and when decision makers do not understand data they may not act on it and lose out on the value of insights. Airbnb emphasizes proactive partnership between its data scientists and decision makers within the organization, and so the solution was integrating data scientists with decision makers for better decision making. Through this the company has managed to improve on its features and services in ways that created value for users while allowed Airbnb to maximize booking and capture customers.
Price Tips:
Based on data from millions of stays Airbnb has developed a tool to help hosts price in order to increase the likelihood of bookings. Using algorithms Airbnb provides suggested pricing for every day of the year. Making this a user friendly feature hosts can easily look at the calendar and see dates in green indicating a high likelihood of booking and red to indicate that the host should revisit pricing. This feature both creates value for hosts and allows the company to capture value from higher booking rates.
Improving Search Results:
In a continuous process to improve search results for guests, Airbnb dove into data to create solutions of this algorithmically challenging issue. The main challenge was factoring in user unique preferences alongside rankings and geographical proximity. Through a series of complex tests and experiments Airbnb final algorithm combined user behavior data using statistical models and data visualization, to produce more location relevant results for users. Leveraging community insights the search results show guests locations within a destination where they are more likely to have great experiences. This model has also made it easier to the company to apply to cities across the worth rather than map out individual cities purely based on proximity from city centers which is not always where guests would have the best travel experience.
Understating Host Acceptance Decisions:
In order to maximize the guest user experience Airbnb needed to maximize the likelihood that a stay request would be accepted by a host, therefore requiring Airbnb to create better matching algorithms. Airbnb used the results of the experiments to influence guests search results by ranking host properties with a higher likelihood of acceptance higher. To simplify this model (shown in the flowchart below) took into considered accommodation requests and the host preferences based on historic data, this produced a preference coefficient. “The weight the preference of each trip characteristic has on the acceptance decision is the coefficient that comes out of the logistic regression”. This yielded a 4% improvement in acceptance creating value for both hosts and guests and capturing value for Airbnb through improved booking rates.
Diversity at Airbnb:
The data science team at Airbnb found that only 10% of new hires were women, by digging deeper into the data the team realized that while the percent of female applicants was much higher than 10% the interview process seemed to be unfair to female candidates. While the exact details of what was uncovered were not clear, the company made changes to the process starting by making the initial evaluation stage blind which yielded a higher percent of women making it to the next stage of the interview process. Through small data-informed changes, Airbnb eventually doubled the ratio of female hires at the company.
While it’s clear that Airbnb is data conscious, its approach to using data to inform decisions is key to its success. The tight integration between decision makers and data scientists has allowed the company to leverage insights to further business goals. When in many organizations valuable data insights are often lost due to managers’ inability to interpret the data or further explore it, at Airbnb the data-informed and integrated culture allows employees to avoid these pitfalls.
How Airbnb’s Data Science Team Doubled The Ratio Of Female Employees Last Year
https://www.forbes.com/sites/ellenhuet/2015/06/05/how-airbnb-uses-big-data-and-machine-learning-to-guide-hosts-to-the-perfect-price/#5a502f106d49
http://nerds.airbnb.com/scaling-data-science/
https://gigaom.com/2013/07/29/airbnb-is-engineering-itself-into-a-data-driven-company/
https://blog.kissmetrics.com/how-airbnb-uses-data-science/
Great post, Lulu! Your analysis of acceptance decisions and diversity brought to mind the SA’s Airbnb diversity hackathon, and the challenge of combating racial discrimination on the platform. With that in mind, I’m curious: do you think there are ways that Airbnb might leverage data and analytics to ensure equitable treatment of guests on its platform.