{"id":17546,"date":"2022-11-30T17:42:33","date_gmt":"2022-11-30T22:42:33","guid":{"rendered":"https:\/\/d3.harvard.edu\/platform-digit\/?post_type=hck-submission&#038;p=17546"},"modified":"2022-11-30T23:57:11","modified_gmt":"2022-12-01T04:57:11","slug":"who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/","title":{"rendered":"Who is in that video? D-ID and the AI-powered journey into synthetic media"},"content":{"rendered":"\n\n\n\n\t\t<div class=\"embed-wrapper\">\n\t\t\t<figure class=\"wp-block-embed wp-embed-aspect-16-9 wp-has-aspect-ratio\"> \n\t\t\t\t<div\n\t\t\t\t\tclass=\"rkv-video-placeholder \"\n\t\t\t\t\tstyle=\"background-image:url(https:\/\/img.youtube.com\/vi\/cQ54GDm1eL0\/hqdefault.jpg);aspect-ratio:16 \/ 9\"\n\t\t\t\t\tdata-provider=\"youtube\"\n\t\t\t\t\tdata-video-id=\"cQ54GDm1eL0\"\n\t\t\t\t><\/div>\n\t\t\t<\/figure>\n\t\n\t\t\t\t\t<\/div>\n\t\t\n\n\n<p>You probably have seen the videos in the last 5 years: someone famous saying or doing something, except, it is not really them \u2013 it is not actually real. Synthetic media is the official name for what became known as \u201cdeepfakes\u201d, a combination of the terms \u201cdeep learning\u201d and \u201cfake\u201d, and it is the modern AI-powered equivalent of \u201cphotoshopping\u201d one person\u2019s likeness in a video. While there are many concerns on how the technology could be used to create misinformation, some companies are trying to use the underlying technology to create and capture value in arguably a more ethical manner.<\/p>\n\n\n\n<p>D-ID is a startup founded in 2017 that initially tried to address the concerns around surveillance systems and facial recognition by developing its AI algorithms to digitally \u201cde-identify\u201d a person\u2019s face in media (such as video or photographs) to protect the privacy of the individuals. They developed technology to alter identifiable parameters used by facial recognition algorithms while preserving the high-level structure that our brains visually process \u2013 i.e., they modify the face representation in media so that the difference is small or imperceptible to the human eye but scrambles what the machine algorithms can understand.<\/p>\n\n\n\n<p>However, even though this privacy focus provided some value to a niche segment of the population, their pivot to generative AI for synthetic media after a couple of years has allowed them to better align their business proposition with higher customer demand. The company\u2019s underlying expertise in deep-learning facial features positioned them to leverage its AI technology to produce animations of photo portraits and production of human-like videos.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Deep Nostalgia: bringing old pictures to life<\/strong><\/h2>\n\n\n\n<p>One of the successful business partnerships for D-ID in the synthetic media pivot has been with genealogy service MyHeritage, which released a new feature called \u201cdeep nostalgia\u201d where users can generate an animated video of an uploaded photo. This AI-powered feature served as viral marketing for MyHeritage services, providing a life-like representation of long-lost relatives in the family tree \u2013 allowing their customers to create a stronger connection and emotional reaction to genealogy as reported by major international newspapers. Furthermore, it also served to promote D-ID face animation technology and capabilities making \u201clive portraits\u201d of historical figures, as some people attempted through Deep Nostalgia. D-ID offers paid access to an \u201cAI Face\u201d platform that provides deep learning, computer vision, and image processing technologies to third parties like historical organizations and museums for synthesized video creation of known figures.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">So glad to see finally <a href=\"https:\/\/twitter.com\/hashtag\/AlanTuring?src=hash&amp;ref_src=twsrc%5Etfw\">#AlanTuring<\/a> &quot;alive&quot;!  Makes me feel even more connected to computer science and <a href=\"https:\/\/twitter.com\/hashtag\/AI?src=hash&amp;ref_src=twsrc%5Etfw\">#AI<\/a>. Via <a href=\"https:\/\/twitter.com\/MyHeritage?ref_src=twsrc%5Etfw\">@MyHeritage<\/a> <a href=\"https:\/\/t.co\/FKYlBHELAR\">https:\/\/t.co\/FKYlBHELAR<\/a> <a href=\"https:\/\/t.co\/lWbsYzcvR3\">pic.twitter.com\/lWbsYzcvR3<\/a><\/p>&mdash; Kristian Kersting (@kerstingAIML) <a href=\"https:\/\/twitter.com\/kerstingAIML\/status\/1365628452825686017?ref_src=twsrc%5Etfw\">February 27, 2021<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Creative Reality: AI media Studio<\/strong><\/h2>\n\n\n\n<p>After the success of animated photos, D-ID trained its neural networks with videos of people speaking input text, so that they could add audio lip-synced with the animation. This product has been used in a partnership with media giant Warner Bros for promotional material of some of its film assets such as interactive trailer of sci-fi movie \u201cReminiscence\u201d or a \u201cHarry Potter\u201d exhibition.<\/p>\n\n\n\t\t<div class=\"embed-wrapper\">\n\t\t\t<figure class=\"wp-block-embed wp-embed-aspect-16-9 wp-has-aspect-ratio\"> \n\t\t\t\t<div\n\t\t\t\t\tclass=\"rkv-video-placeholder \"\n\t\t\t\t\tstyle=\"background-image:url(https:\/\/img.youtube.com\/vi\/p6qhZESoYag\/hqdefault.jpg);aspect-ratio:16 \/ 9\"\n\t\t\t\t\tdata-provider=\"youtube\"\n\t\t\t\t\tdata-video-id=\"p6qhZESoYag\"\n\t\t\t\t><\/div>\n\t\t\t<\/figure>\n\t\n\t\t\t\t\t<\/div>\n\t\t\n\n\n<p>However, its largest business segment today comes from enterprise customers looking for an easy \u201cone stop shop\u201d video production, particularly in the marketing, sales, and training needs. D-ID studio platform enables customers to generate realistic AI personas, which after uploading the input script and selecting a speech voice, creates a high-quality video for corporate uses. The AI studio platform significantly decreases the cost and complexity around video production at scale, as well as the ability to customize for multiple digital presenters, voices, languages, or script edits while avoiding the hassles of content creation.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-embed-handler wp-block-embed-embed-handler wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Generate Speaking Avatars and Presenters | Generative AI\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/-GMumyyhGfo?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Challenges and Opportunities<\/strong><\/h2>\n\n\n\n<p>Synthetic Media is still a recent concept, but we have seen a proliferation of startups in the last years entering the space, whether by mobile apps for content creators in social platforms or more established enterprise partnerships. While D-ID remains one of the leaders in this technology, and a successful partner for synthetic human media production for enterprise content needs, their foothold is not cemented yet and multiple startups coming for different segments may eat away some of the early mover advantage.<\/p>\n\n\n\n<p>The interesting thing about being at the cutting-edge of technology is that it does not stay at the \u201ccutting-edge\u201d for long \u2013 as machine learning techniques and processing power evolves, more players join the game, and more companies try to specialize on a particular area for value capture. Alternative startups like Synthesia have doubled down on synthetic video content production platform for training and marketing of well-known companies. Others such as Revel AI have focused on creating hyperreal content for the entertainment industry \u2013 synthetic media is now joining video commercials for big brands like Adidas. <\/p>\n\n\n\t\t<div class=\"embed-wrapper\">\n\t\t\t<figure class=\"wp-block-embed wp-embed-aspect-16-9 wp-has-aspect-ratio\"> \n\t\t\t\t<div\n\t\t\t\t\tclass=\"rkv-video-placeholder \"\n\t\t\t\t\tstyle=\"background-image:url(https:\/\/img.youtube.com\/vi\/_h6aWfAhiis\/hqdefault.jpg);aspect-ratio:16 \/ 9\"\n\t\t\t\t\tdata-provider=\"youtube\"\n\t\t\t\t\tdata-video-id=\"_h6aWfAhiis\"\n\t\t\t\t><\/div>\n\t\t\t<\/figure>\n\t\n\t\t\t\t\t<\/div>\n\t\t\n\n\n<p>D-ID continues to explore different use cases of the same underlying technology, and where to evolve to (what industry and at what level should they play as a provider), but depending on this choice, they may need to streamline their product portfolio, acquire (or develop) complimentary tech stack and revamp their organization to serve their industry of choice.<\/p>\n\n\n\n<p>And still, let us not forget that the concept of \u201cdeepfakes\u201d has a negative connotation for the general public. The threat of bad actors using this technology for fake content generation with the intent of misinformation will continue to be an obstacle, or at least a reason for caution, around the spread and adoption of the technology. Today, this content is not particularly regulated or contained by copyright laws, so depending how the space evolves and what actions the governments decide to take (particularly those with stronger data privacy focus like in Europe) will affect the future of D-ID.<\/p>\n\n\n\n<p>D-ID has found a way to evolve to the needs of their most pressing customers through the years and remain a valued partner for creation and capture. But will they know their real identity to grasp an opportunity that will solidify their value, or will they just get blurred away from the space as synthetic media continues to grow?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>From removing personal identifiers for privacy to making you believe that is another human in the video.<\/p>\n","protected":false},"author":19331,"featured_media":17560,"comment_status":"open","ping_status":"closed","template":"","categories":[],"class_list":["post-17546","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/machine-learning-3\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Who is in that video? D-ID and the AI-powered journey into synthetic media - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Who is in that video? D-ID and the AI-powered journey into synthetic media - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"From removing personal identifiers for privacy to making you believe that is another human in the video.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-01T04:57:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2022\/11\/download.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"310\" \/>\n\t<meta property=\"og:image:height\" content=\"163\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/\",\"name\":\"Who is in that video? D-ID and the AI-powered journey into synthetic media - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/11\\\/download.jpg\",\"datePublished\":\"2022-11-30T22:42:33+00:00\",\"dateModified\":\"2022-12-01T04:57:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/11\\\/download.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/11\\\/download.jpg\",\"width\":310,\"height\":163},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Who is in that video? D-ID and the AI-powered journey into synthetic media\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Who is in that video? D-ID and the AI-powered journey into synthetic media - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/","og_locale":"en_US","og_type":"article","og_title":"Who is in that video? D-ID and the AI-powered journey into synthetic media - Digital Innovation and Transformation","og_description":"From removing personal identifiers for privacy to making you believe that is another human in the video.","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/","og_site_name":"Digital Innovation and Transformation","article_modified_time":"2022-12-01T04:57:11+00:00","og_image":[{"width":310,"height":163,"url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2022\/11\/download.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/","name":"Who is in that video? D-ID and the AI-powered journey into synthetic media - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2022\/11\/download.jpg","datePublished":"2022-11-30T22:42:33+00:00","dateModified":"2022-12-01T04:57:11+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2022\/11\/download.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2022\/11\/download.jpg","width":310,"height":163},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/who-is-in-that-video-d-id-and-the-ai-powered-journey-into-synthetic-media\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"Who is in that video? D-ID and the AI-powered journey into synthetic media"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/17546","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/19331"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=17546"}],"version-history":[{"count":3,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/17546\/revisions"}],"predecessor-version":[{"id":17612,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/17546\/revisions\/17612"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media\/17560"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=17546"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=17546"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}