{"id":1339,"date":"2017-05-03T14:51:46","date_gmt":"2017-05-03T14:51:46","guid":{"rendered":"http:\/\/ico.bukvic.net\/main\/?p=1339"},"modified":"2018-12-22T03:49:00","modified_gmt":"2018-12-22T03:49:00","slug":"mirror-worlds","status":"publish","type":"post","link":"https:\/\/ico.bukvic.net\/main\/mirror-worlds\/","title":{"rendered":"Mirror Worlds"},"content":{"rendered":"<p><a href=\"http:\/\/ico.bukvic.net\/main\/wp-content\/uploads\/2017\/05\/MirrorWorlds.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-1340 size-full\" title=\"Mirror Worlds (render by Dane Webster)\" src=\"http:\/\/ico.bukvic.net\/main\/wp-content\/uploads\/2017\/05\/MirrorWorlds.jpg\" alt=\"Mirror Worlds (render by Dane Webster)\" width=\"900\" height=\"600\" srcset=\"https:\/\/ico.bukvic.net\/main\/wp-content\/uploads\/2017\/05\/MirrorWorlds.jpg 900w, https:\/\/ico.bukvic.net\/main\/wp-content\/uploads\/2017\/05\/MirrorWorlds-300x200.jpg 300w, https:\/\/ico.bukvic.net\/main\/wp-content\/uploads\/2017\/05\/MirrorWorlds-768x512.jpg 768w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><\/a><\/p>\n<p>In 2013, a collaborative team led by the <a href=\"http:\/\/ico.bukvic.net\/main\/icat\/\">ICAT<\/a> director Dr. Ben Knapp was awarded an <a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1305231\">NSF grant<\/a> for an innovative infrastructure to be embedded throughout the newly introduced Moss Arts Center. I served in a Co-PI role focusing&nbsp;on the aural aspects of the project.<\/p>\n<p><em>Mirror Worlds<\/em>&nbsp;was envisioned as persistent infrastructure designed to monitor user activity within the physical building and its virtual counterpart. Its implementation consists of an array of fish eye cameras, a microphone array, and a series of &#8220;stations&#8221;, namely large wall-mounted tablets that pose as virtual &#8220;mirrors&#8221;. The infrastructure is envisioned to serve as a bridge between the real and virtual agents traversing the space, allowing for the agents to interact across the virtual and real divides. In that respect the aforesaid &#8220;mirrors&#8221; instead of literally mirroring passers by through a webcam or a similar camera technology focus on rendering their presence in the virtual rendition of the building that is accessible online.<\/p>\n<p>My work focused on two things:&nbsp;<em>Mirrorcraft&nbsp;<\/em>project (a subset of what later became known as&nbsp;<em><a href=\"http:\/\/ico.bukvic.net\/main\/cinemacraft\/\">Cinemacraft<\/a><\/em>) designed to provide real-virtual mirrors using a custom <a href=\"https:\/\/minecraft.net\/en-us\/\">Minecraft<\/a> mod in conjunction with Kinect HD, and a means to quadrilateralize sound sources within a space in real-time. The latter led to an efficient implementation within MaxMSP that continues to be developed as we explore optimal beam-forming strategies. The ultimate goal of the project is <strong>sensory fusion<\/strong> that combines visual blob tracking with aural quadrilateralization and thereby improve fidelity of tracked data and minimize artifacts inherent to either of the two approaches when used in isolation.<\/p>\n<p>Research team:<br \/>\nIvica Ico Bukvic (Co-PI)<br \/>\nYong Cao (VT, Boeing)<br \/>\nJames Ivory (VT)<br \/>\nBenjamin Knapp (VT, PI)<br \/>\nNicholas Polys (VT)<\/p>\n<p>Research publications:<\/p>\n<ul>\n<li><a href=\"https:\/\/www.researchgate.net\/publication\/300490248_Fusality\">Nicholas F. Polys, Knapp, B., Bock, M., Lidwin, C., Webster, D., Waggoner, N., and Bukvic, I. (2015). Fusality: an open framework for cross-platform mirror world installations. 20th International Conference on 3D Web Technology (Web3D \u201915) (pp. 171-179). ACM, New York, NY, USA.<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>In 2013, a collaborative team led by the ICAT director Dr. Ben Knapp was awarded an NSF grant for an innovative infrastructure to be embedded throughout the newly introduced Moss Arts Center. I served in a Co-PI role focusing&nbsp;on the aural aspects of the project. Mirror Worlds&nbsp;was envisioned as persistent infrastructure designed to monitor user [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1340,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34,96,97],"tags":[41,131,380,381,66,390,300,398,460,393,14,354,401,400,196,402,394],"class_list":["post-1339","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-collaboration","category-research","category-software","tag-41","tag-131","tag-380","tag-381","tag-audio","tag-cinemacraft","tag-grant","tag-immersion","tag-irb","tag-kinect-hd","tag-maxmsp","tag-minecraft","tag-mirror-worlds","tag-mirrorcraft","tag-nsf","tag-quadrilateration","tag-sensory-fusion"],"_links":{"self":[{"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/posts\/1339","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/comments?post=1339"}],"version-history":[{"count":4,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/posts\/1339\/revisions"}],"predecessor-version":[{"id":1529,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/posts\/1339\/revisions\/1529"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/media\/1340"}],"wp:attachment":[{"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/media?parent=1339"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/categories?post=1339"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ico.bukvic.net\/main\/wp-json\/wp\/v2\/tags?post=1339"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}