{"id":36142,"date":"2018-11-13T19:46:10","date_gmt":"2018-11-14T00:46:10","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/"},"modified":"2018-11-13T19:46:10","modified_gmt":"2018-11-14T00:46:10","slug":"youtube-machines-cleaning-up-human-content","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/","title":{"rendered":"YouTube | Machines Cleaning Up Human Content"},"content":{"rendered":"<p>The internet has democratized video content creation and distribution. Today, over 400 hours of video are uploaded to YouTube every minute.<sup>1\u00a0<\/sup>While the speed and volume at which content is added to the platform has been key to YouTube\u2019s success, it also poses many questions and risks: How can YouTube ensure that content is appropriate for advertisers and consumers? How can YouTube stop extremist organizations from using the site to spread hate?<\/p>\n<p>One answer is artificial intelligence (AI) and machine learning. YouTube\u2019s \u201canti-abuse machine learning algorithm\u201d enables YouTube to combat some of the biggest threats to their business by automatically spotting content deemed inappropriate for the platform, such as content featuring child pornography, hate speech, and violence.<sup>2<\/sup><\/p>\n<p>The need for a more robust review of YouTube content came into the public spotlight with an investigation by <em>The Times\u00a0<\/em>in February 2017.<sup>3\u00a0<\/sup>The investigation highlighted how advertisements for global companies were being shown in tandem with indecent content. For example, a L\u2019Oreal ad appeared on a video posted by hate preacher Steven Anderson.<sup>4\u00a0<\/sup>As a reaction, advertisers, including key global iconic CPG conglomerates such as Unilever, have been threatening to pull their advertisements from YouTube, posing a significant threat to the platform\u2019s key revenue stream.<sup>5<\/sup><\/p>\n<p>YouTube has taken a few significant actions in response. For one, YouTube has committed to building out its content moderation workforce, by \u201cbringing the total number of people working to address violative content to 10,000 across Google by the end of 2018.\u201d<sup>6\u00a0<\/sup>This includes hiring full-time artificial intelligence and machine learning specialists as well as those with expertise in \u201cviolent extremism, counterterrorism, and human rights.\u201d<sup>6\u00a0<\/sup>In addition, YouTube is leveraging micro-labor sites such as Amazon\u2019s Mechanical Turk to train their AI algorithms via human intelligence.<sup>7\u00a0<\/sup>Workers are asked to watch a piece of content and indicate what it contains.<sup>7\u00a0<\/sup>The learning fuels the AI algorithm, teaching it to better review and identify content in the future.<sup>7<\/sup><\/p>\n<p>In April 2018, YouTube published its first quarterly report on content moderation. Results have been promising: from October \u2013 December 2017, YouTube removed over 8 million indecent videos, 6.7 million of which were first flagged for review by machines rather than by humans.<sup>6\u00a0<\/sup>Of the 6.7 million videos taken down, 76 percent were removed before they ever received a single view.<sup>6\u00a0<\/sup>To further highlight the progress of the content moderation, fueled by AI, YouTube has rolled out a reporting history dashboard that shows YouTube users the status of the videos they\u2019ve flagged.<sup>6<\/sup><\/p>\n<p>YouTube has also refined the way they categorize and sell content to advertisers via the Google Preferred offering, which comprises 5% of total video inventory.<sup>8\u00a0<\/sup>Seen as the most premium video inventory, YouTube highlights that all Google Preferred content is reviewed by humans before it is sold as an ad placement.<sup>8\u00a0<\/sup>One might infer that this suggests human review is still superior to YouTube\u2019s AI enabled algorithms.<\/p>\n<p>As YouTube looks to the future, it is important to carefully consider how the algorithms are being taught. This includes implementing practices that prevent biases in content review. Put eloquently by reporter Jacob J. Hunt in a piece for the ACLU, machine learning\u2019s role should not be to \u201caggregate our biases and mechanize them.\u201d<sup>9\u00a0<\/sup>Also, YouTube should be transparent with advertisers and consumers on what content YouTube allows, as the lines are often blurry. For example, in March 2018, YouTube initially defended its decision to permit Neo-Nazi group Atomwaffen Division to publish videos on its platform, but later decided to remove them after receiving pressure from the Anti-Defamation League.<sup>7 \u00a0<\/sup>Further, the speed at which YouTube\u2019s AI can review content will become increasingly important as live-streaming becomes more prevalent.<\/p>\n<p>A few questions that remain to be answered include: What is YouTube\u2019s responsibility in monitoring content vs. enabling freedom of speech? Will YouTube ever be able to entirely rely on its AI technology or will human content review always be needed? How else might YouTube be able to leverage AI to enhance its product offering \u2013 for example, through more targeted video recommendations to users, review of comments on video posts, or anything else? How are you seeing other digital media platforms, such as Facebook and Twitter, think through similar challenges?<\/p>\n<p>As you think through these questions, consider the below iconic photograph by Nick Ut (1972), referred to as \u201cThe Napalm Girl.\u201d<sup>11\u00a0<\/sup>How might a human interpret this image as opposed to an AI algorithm? What are the implications?<\/p>\n<p>(Word Count: 735).<\/p>\n<p><a href=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Picture1-34.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-35968\" src=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Picture1-34.png\" alt=\"\" width=\"417\" height=\"312\" srcset=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Picture1-34.png 550w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Picture1-34-300x225.png 300w\" sizes=\"auto, (max-width: 417px) 100vw, 417px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><strong><u>Sources<\/u><\/strong><\/p>\n<p>[1] Nilas, J. (2018). <em>YouTube Subjecting All \u2018Preferred\u2019 Content to Human Review.<\/em>[online] Available at: <a href=\"http:\/\/www.wsj.com\/articles\/youtube-subjecting-all-preferred-content-to-human-review-1516143751\">www.wsj.com\/articles\/youtube-subjecting-all-preferred-content-to-human-review-1516143751<\/a>.<\/p>\n<p>[2] Meyer, D (2018). <em>AI Is Now YouTube&#8217;s Biggest Weapon Against the Spread of Offensive Videos.<\/em>[online] Available at: <a href=\"http:\/\/fortune.com\/2018\/04\/24\/youtube-machine-learning-content-removal\/\">http:\/\/fortune.com\/2018\/04\/24\/youtube-machine-learning-content-removal\/<\/a>.<\/p>\n<p>[3] Mostrous, A. (2017). <em>Big brands fund terror through online adverts<\/em>. [online] Available at: <a href=\"https:\/\/www.thetimes.co.uk\/article\/big-brands-fund-terror-knnxfgb98\">https:\/\/www.thetimes.co.uk\/article\/big-brands-fund-terror-knnxfgb98<\/a>.<\/p>\n<p>[4] Vizard, S. (2017). <em>Google under fire as brands pull advertising and ad industry demands action. <\/em>[online] Available at: <a href=\"https:\/\/www.marketingweek.com\/2017\/03\/17\/google-ad-safety\/\">https:\/\/www.marketingweek.com\/2017\/03\/17\/google-ad-safety\/<\/a>.<\/p>\n<p>[5] Marvin, G. (2018).<em>A final call? Unilever threatens to pull ads from platforms swamped with \u2018toxic\u2019 content. <\/em>[online] Available at: <a href=\"https:\/\/marketingland.com\/final-call-unilever-threatens-pull-ads-platforms-swamped-toxic-content-234323\">https:\/\/marketingland.com\/final-call-unilever-threatens-pull-ads-platforms-swamped-toxic-content-234323<\/a>.<\/p>\n<p>[6] YouTube (2018). Official Blog. [online] Available at: <a href=\"https:\/\/youtube.googleblog.com\/2018\/04\/more-information-faster-removals-more.html\">https:\/\/youtube.googleblog.com\/2018\/04\/more-information-faster-removals-more.html<\/a>.<\/p>\n<p>[7] Matsakis, L. (2018). <em>A Window Into How YouTube Trains AI To Moderate Videos. <\/em>[online] Available at: <a href=\"https:\/\/www.wired.com\/story\/youtube-mechanical-turk-content-moderation-ai\/\">https:\/\/www.wired.com\/story\/youtube-mechanical-turk-content-moderation-ai\/<\/a>.<\/p>\n<p>[8] Nicas, J (2018). <em>YouTube Subjecting All \u2018Preferred\u2019 Content to Human Review<\/em>. [online] Available at: <a href=\"https:\/\/www.wsj.com\/articles\/youtube-subjecting-all-preferred-content-to-human-review-1516143751\">https:\/\/www.wsj.com\/articles\/youtube-subjecting-all-preferred-content-to-human-review-1516143751<\/a>.<\/p>\n<p>[9] Hutt, J. (2018). <em>Why YouTube Shouldn\u2019t Over-Rely on Artificial Intelligence to Police Its Platform. <\/em>[online] Available at: <a href=\"https:\/\/www.aclu.org\/blog\/privacy-technology\/internet-privacy\/why-youtube-shouldnt-over-rely-artificial-intelligence\">https:\/\/www.aclu.org\/blog\/privacy-technology\/internet-privacy\/why-youtube-shouldnt-over-rely-artificial-intelligence<\/a>.<\/p>\n<p>[10] Ut, N (1972). <em>Napalm Girl Photo<\/em>. [online] Available at: <a href=\"http:\/\/www.apimages.com\/Collection\/Landing\/Photographer-Nick-Ut-The-Napalm-Girl-\/ebfc0a860aa946ba9e77eb786d46207e\">http:\/\/www.apimages.com\/Collection\/Landing\/Photographer-Nick-Ut-The-Napalm-Girl-\/ebfc0a860aa946ba9e77eb786d46207e<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Every minute, over 400 hours of video are uploaded to YouTube. What role can AI and Machine Learning have in monitoring content to ensure it is safe and suitable for the platform and viewers? <\/p>\n","protected":false},"author":11042,"featured_media":36185,"comment_status":"open","ping_status":"closed","template":"","categories":[4627,2809,2401,2545,1355,346,5094],"class_list":["post-36142","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-artificial-intellgience","category-digital-advertising","category-digital-marketing","category-digital-video","category-ethics","category-machine-learning","category-sensorship","hck-taxonomy-organization-youtube","hck-taxonomy-industry-media-and-broadcasting","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>YouTube | Machines Cleaning Up Human Content - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"YouTube | Machines Cleaning Up Human Content - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"Every minute, over 400 hours of video are uploaded to YouTube. What role can AI and Machine Learning have in monitoring content to ensure it is safe and suitable for the platform and viewers?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png\" \/>\n\t<meta property=\"og:image:width\" content=\"734\" \/>\n\t<meta property=\"og:image:height\" content=\"518\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/\",\"url\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/\",\"name\":\"YouTube | Machines Cleaning Up Human Content - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png\",\"datePublished\":\"2018-11-14T00:46:10+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#primaryimage\",\"url\":\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png\",\"contentUrl\":\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png\",\"width\":734,\"height\":518},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/d3.harvard.edu\/platform-rctom\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"YouTube | Machines Cleaning Up Human Content\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/d3.harvard.edu\/platform-rctom\/#website\",\"url\":\"https:\/\/d3.harvard.edu\/platform-rctom\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"YouTube | Machines Cleaning Up Human Content - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/","og_locale":"en_US","og_type":"article","og_title":"YouTube | Machines Cleaning Up Human Content - Technology and Operations Management","og_description":"Every minute, over 400 hours of video are uploaded to YouTube. What role can AI and Machine Learning have in monitoring content to ensure it is safe and suitable for the platform and viewers?","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/","og_site_name":"Technology and Operations Management","og_image":[{"width":734,"height":518,"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/","name":"YouTube | Machines Cleaning Up Human Content - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png","datePublished":"2018-11-14T00:46:10+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/yt_icon_rgb.png","width":734,"height":518},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/youtube-machines-cleaning-up-human-content\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"YouTube | Machines Cleaning Up Human Content"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/36142","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11042"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=36142"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/36142\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/36185"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=36142"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=36142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}