{"id":69,"date":"2023-03-24T15:17:49","date_gmt":"2023-03-24T15:17:49","guid":{"rendered":"https:\/\/replicantnexus.com\/?p=69"},"modified":"2023-03-24T15:17:50","modified_gmt":"2023-03-24T15:17:50","slug":"metahuman-facial-scan-technology-facemapping-3-0","status":"publish","type":"post","link":"https:\/\/replicantnexus.com\/index.php\/2023\/03\/24\/metahuman-facial-scan-technology-facemapping-3-0\/","title":{"rendered":"MetaHuman Facial scan technology &#8211; Facemapping 3.0"},"content":{"rendered":"\n<p>One step closer to having your own, real-time, hyper-realistic face ready for you in the MetaVerse in mere minutes!<\/p>\n\n\n\n<p>Man, what an impressive presentation this week by Epic, owner of the Unreal 5 engine. Epic flexed their muscles by showing us a real-time smartphone face-scan of <a href=\"https:\/\/www.imdb.com\/name\/nm8750141\/\" target=\"_blank\" rel=\"noreferrer noopener\">Melina Juergens<\/a>, the real-life actress from the (rather great!) videogame <a href=\"https:\/\/www.hellblade.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Hellblade<\/a> (2). They transferred the scan in the Unreal engine MetaHuman generator and within minutes, there&#8217;s this true-to-life animated facial scan of Melina that can be used independently of the scan that they made.  To save you some time, below is the end-result (no sound). Read on for more info and the longer video, where you can see the process yourself!<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"nv-iframe-embed\"><iframe loading=\"lazy\" title=\"Melina - MetaHuman - Real-time face scan\" width=\"1200\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/ll7Lp2CRGLY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<p><br><br>The process is a bit difficult to describe, but have a look below! Four screens, from the original actress to a fully independent, facial animated 3D avatar. After mere minutes, flexing just three emotions (happy, angry, neutral), there&#8217;s a jaw-dropping rendition of her face with fully animated face muscles that you can &#8220;paste&#8221; in the Metaverse \/ a videogame with facial animations that are almost life-like. <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"279\" src=\"https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/Melina4-1024x279.png\" alt=\"\" class=\"wp-image-70\" srcset=\"https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/Melina4-1024x279.png 1024w, https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/Melina4-300x82.png 300w, https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/Melina4-768x209.png 768w, https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/Melina4.png 1146w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>The process looks so simple. Create a scan within minutes where the actor shows some different faces \/ emotions. The specific animations of this person are made into a standardized facial construct, where you can use the actor&#8217;s specific emotional features and facial movements on any avatar you create in the future. So yes, you can create your own life-like avatar and implement your own facial animations on the head of an orc.. or Donald Trump&#8230; or&#8230; whatever beast \/ person you want. Hello possibilties&#8230; hello ethics! The video below doesn&#8217;t show Melina&#8217;s facial animations on an orc (what a shame! \ud83d\ude42 ), but on totally different human 3d avatars. <\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"nv-iframe-embed\"><iframe loading=\"lazy\" title=\"MetaHuman Animator - Official Unreal Engine 5 Tech Demo\" width=\"1200\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/T38ZURD768w?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<p>Just imagine what this means for low budget videogame studios. Full mo-cap esque animations in mere minutes of work. Even if you look at the end resut in the video there&#8217;s still something&#8230; &#8220;off&#8221; I guess. There&#8217;s still a slight gap between animated and true-to-life (luckiliy!) But man, have we come a long way in real-time character rendering. Onwards to shooting your own created avatars in Fortnite! \ud83d\ude42<\/p>\n\n\n\n<p>This isn&#8217;t avaiable for the gen-pop right now, but what is&#8230; is the MetaHuman creator to design your own 3d avatar based on a character building tool, still without the scan possibilities. Register with Epic and you can create your own real-time digital avatar, in the available cloud-based version of <a rel=\"noreferrer noopener\" href=\"https:\/\/metahuman.unrealengine.com\/\" target=\"_blank\">MetaHuman<\/a>. You can even set the tooth-spacing, what a time to be alive! For real: just tinker a bit in this tool, it will give you an all new vision on the usage of avatars.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/MetaHuman2-1024x613.png\" alt=\"\" class=\"wp-image-72\" width=\"587\" height=\"351\" srcset=\"https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/MetaHuman2-1024x613.png 1024w, https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/MetaHuman2-300x179.png 300w, https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/MetaHuman2-768x459.png 768w, https:\/\/replicantnexus.com\/wp-content\/uploads\/2023\/03\/MetaHuman2.png 1314w\" sizes=\"auto, (max-width: 587px) 100vw, 587px\" \/><\/figure>\n<\/div>\n\n\n<p>The full on-stage demo:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"nv-iframe-embed\"><iframe loading=\"lazy\" title=\"MetaHuman - Real-Time Facial Model Animation Demo | State of Unreal 2023\" width=\"1200\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/pnaKyc3mQVk?start=224&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>One step closer to having your own, real-time, hyper-realistic face ready for you in the MetaVerse in mere minutes! Man, what an impressive presentation this week by Epic, owner of the Unreal 5 engine. Epic flexed their muscles by showing us a real-time smartphone face-scan of Melina Juergens, the real-life actress from the (rather great!)&hellip;&nbsp;<a href=\"https:\/\/replicantnexus.com\/index.php\/2023\/03\/24\/metahuman-facial-scan-technology-facemapping-3-0\/\" rel=\"bookmark\">Lees verder &raquo;<span class=\"screen-reader-text\">MetaHuman Facial scan technology &#8211; Facemapping 3.0<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":73,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"neve_meta_sidebar":"","neve_meta_container":"","neve_meta_enable_content_width":"","neve_meta_content_width":0,"neve_meta_title_alignment":"","neve_meta_author_avatar":"","neve_post_elements_order":"","neve_meta_disable_header":"","neve_meta_disable_footer":"","neve_meta_disable_title":"","footnotes":""},"categories":[13,14],"tags":[20,18,17,15,16,21,19],"class_list":["post-69","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-metahuman","category-metaverse","tag-3d-avatar","tag-epic","tag-melina-juergens","tag-metahuman","tag-metaverse","tag-real-time-scan","tag-unreal-engine-5"],"_links":{"self":[{"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/posts\/69","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/comments?post=69"}],"version-history":[{"count":2,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/posts\/69\/revisions"}],"predecessor-version":[{"id":74,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/posts\/69\/revisions\/74"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/media\/73"}],"wp:attachment":[{"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/media?parent=69"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/categories?post=69"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/replicantnexus.com\/index.php\/wp-json\/wp\/v2\/tags?post=69"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}