On Demand Art Gallery · Full Access, Onsite Experience, Onsite Student Access, Virtual Basic Access, Virtual Full Access, VirtualArt Gallery 在别处/ Escaping to another Biin Shen (Independent Artist)  Biography BiographyBiin Shen  Shen is an artist whose practice circulates between art, design, technology and social issues. She received her MA in design interactions , following her time with Professor Dunne & Raby at the Royal College of Art in London. In 2013, she was featured as the guest speaker for LondonDesignWeek to represent young Chinese creators. Her work has been exhibited in events/institutions worldwide, including European Alternatives, SALON(NL),TOKYO GALLERY+BTAP, Shanghai Expo, Beijing World Art Museum and more. In 2020, she was selected as the first and only media artist to represent China in the UNESCO Creative City project. Since 2012, she has used her creative practice to participate in debates about issues that are of increasing urgency today. Besides her installations, curation has become one of the mediums within her practice; she has also been writing for art/public media platforms to share her unique thoughts on the relationship between technology and humanity.
Abstract Abstract"Escaping to another" is a live stream installation created during the epidemic. Consists of a hanging screen in a dark space, that continuously shows Skies from different cities in real time, thus composing a mixed reality landscape between machine and the human imagination. Aerobanquets RMX Mattia Casalegno (Aerobanquets RMX)  Biography BiographyMattia Casalegno  Mattia Casalegno is an Italian artist known for his sculptures and his immersive, relational, and participatory installations. He often deploys emerging technologies to investigate themes of phenomenology, ecology and cybernetics.
Nominated for the New Technological Art Awards in 2014 and artist-in-residence at Eyebeam in 2015, he received various grants and fellowships from, among others, NEW INC, the Center for Cultural Innovation, Young Italian Artists Network, NYFA, the Elizabeth Foundation for the Arts and the Asia Culture Center in South Korea. In 2018 he was recipient of a Lumen Prize Award.
Casalegno has exhibited in such museums and institutions as MACRO Museum and Auditorium, Italy; Mutek Festival, Canada; Kuandu Museum of Fine Arts, Taiwan; ISEA in S.Korea; Chronus Art Center, China; Cimatics festival and Nuit Blanche in Belgium; Optronica in the UK; Le Cube Museum in France; OFFF in Spain, LACMA, YAA Museum and Satellite Art Fair in the US.
Abstract AbstractAerobanquets RMX is an immersive, multi-sensorial culinary experience focused on taste perception. Aerobanquets RMX is about reframing our perceptions and changing the way we experience food. It is not only a life changing experience, but, in a sense, a tool to reprogram all our perceptive expectations. Aurora Australis Ultimo Choro John McCormick (Wild System, Swinburne University of Technology); Adam Nash (Wild System); and Stephen Jeal and Kim Vincs (Swinburne University of Technology) Biographies BiographiesJohn McCormick  John McCormick is a technology based artist with a major interest in movement. John has collaborated on works worldwide, including at International Symposium of Electronic Art (ISEA), ZERO1SJ, SIGGRAPH, Melbourne Festival, Venice Biennale, Siggraph Asia, Ars Electronica Futurelab, Tokyo International Forum and Art Science Museum Singapore. John’s current artistic work explores human robot interaction mediated by mixed reality environments. John was an Australian Antarctic Research Fellow in 2020 supported by the Australian Antarctic Division and Australian Network for Art and Technology. John was lucky enough to travel on the last Australian Antarctic voyage of the research vessel Aurora Australis to the Antarctic continent. John is currently a lecturer and researcher in the Centre for Transformative Media Technologies at Swinburne University of Technology where he investigates artistic practice in mixed reality environments, robotics, artificial intelligence and human action.
Adam Nash  Adam Nash is a digital artist, composer, programmer, performer, teacher and writer. He is widely recognized as one of the most original artists working in virtual environments and mixed-reality technology, exploring them as sites of playable art. Working in a post-convergent idiom, he uses the web, game engines, virtual environments, generative and procedural programming, data and motion capture, artificial intelligence, synthetic evolution, audio, vision and live performance.
His work has been presented in galleries, festivals and online in Australia, Europe, Asia and The Americas, including SIGGRAPH, ISEA, 01SJ, the Venice Biennale, the National Gallery of Victoria and the National Portrait Gallery of Australia. He has been artist in residence at Ars Electronica FutureLab and was shortlisted for the National Art Award in New Media at the Queensland Gallery of Modern Art.
Stephen Jeal  Stephen Jeal is a technical artist and teacher, specializing in 3D modelling, motion capture and visual effects for both film and games. Stephen has a knack for problem-solving and an eye for artistic and technical detail which he applies to all his projects.
Kim Vincs  Kim Vincs is a leading researcher in the creative arts, with collaborations across motion capture, game development, robotics, haptics, app design, 3D stereoscopy, artificial intelligence, virtual reality, augmented reality, cognitive psychology, biomechanics, mathematics, architecture and exercise science.
She has commercial motion capture credits including the Cannes Silver Lion winning Nocturnal Migration. Kim integrates scientific, technological and artistic methodologies to deliver innovative research to digital and performing arts industries, companies and communities. Her work spans creative technology for performance, digital scenography, VR, AR and robotics applications for motion capture technology. Recent works include The Crack Up, premiered at the Merlyn Theatre, Coopers Malthouse; Multiverse, with Garry Stewart and Australian Dance Theatre and 3D digital scenography for Victorian Opera’s production The Flying Dutchman and Four Saints in Three Acts, 2016. Her works have been shortlisted for Greenroom, Australian Dance and AEAF awards. The Flying Dutchman was a finalist in Unity’s 2015 Unite.
Abstract AbstractAurora Australis Ultimo Choro depicts the final Australian voyage of the RSV Aurora Australis to the Antarctic continent. An immersive visual and sonic feast of three-dimensional VR environments and spatial sound visualising and sonifying the last grand Antarctic dance of the Aurora Australis, crew and expeditioners. Ethereal Phenomena Silvana Malaver (Keio University Graduate School of Media Design); Natalia Barragán Nieto (Universidad de los Andes); Igor Igorevich Segrovets (Tokyo Institute of Technology); Carlos Rizzi (Sabana Records); and George Chernyshov, Christopher Changmok Kim, and Kai Kunze (Keio University Graduate School of Media Design) Biographies BiographiesSilvana Malaver  Silvana Malaver is a multidisciplinary artist and Ph.D student at the Graduate School of Media Design, Keio University, Yokohama, Japan. Her research and creative process mainly focus on exploring how to produce altered states of consciousness through diverse media artworks, from poetry and essay-films to interactive installations. She Majored in Literature at Universidad de Los Andes, Bogota, Colombia, and obtained a Master in Japanese Culture at the Graduate School of Humanities and Social Sciences, Saitama University, Saitama, Japan, where she specialized in Buddhism and Media Art. At Keio Media Design she is part of the project "Geist" ("mind" or "spirit" in German) that works on augmenting human capacities by combining cognitive science, psychology, and technology.
Natalia Barragán Nieto  Natalia Barragán Nieto. 1994. Gemini. Bogota, Colombia. Languages: SP_ENG_FR. Spirituality and esoterism. Tea and bubbles. Plants. Where things come from. Electronic music. Intuitively rational. Rationally intuitive. Communications designer, aesthete.
I don’t believe in coincidences. I believe in the alignment of specific factors at a specific moment: synchronicity. I believe that life is the result of a constant decision-making process, which is done both consciously and unconsciously. It is an eternal quest in order to achieve equilibrium and equanimity. I believe in what I create, consisting of a dialog between the analog and the digital, between reality and fiction, between images, sounds and words.
Igor Igorevich Segrovets  Igor Segrovets joined the Ethereal Phenomena project in the role of programmer and was responsible for curating the installation to be engaging, seamless and aesthetically pleasing. Igor’s contribution included technically realising the vision of a gamified, live and interactive meditation experience. This is Igor’s first contribution to human-computer interaction. In the past, while dreaming of becoming a rocket scientist, Igor completed his Bachelor degrees in Aerospace Engineering and Physics from The University of Queensland in Brisbane, Australia. During this time, Igor designed projects for teams researching photo-computing at The University of Queensland and quantum-sensing at Australian National University. Currently, Igor is completing a Masters degree in Mechanical Engineering at the Tokyo Institute of Technology, Tokyo, Japan. There, Igor's project with Onishi Laboratory simulates the turbulent dynamics of wind around city trees with the aim of realising real-time micro-scale weather prediction.
Carlos Rizzi  Carlos Rizzi is an electronic music producer, performer and multi instrumentalist from Bogotá, Colombia. He studied classical composition at the Pontificia Universidad Javeriana in Bogotá and Electronic Music Production and Performance at Catalyst Berlin. His work is based on the exploration of soundscapes and sound design in conjunction with IDM inspired beats, moody sequences and extreme sample manipulation.
He has released an album (Now Here Nowhere) and two EP’s (Tank! and Vestigial).
In 2020, during the Covid-19 pandemic, he and fellow collaborator Mateo Walschburger created Sabana Records, an independent record label focused on promoting left field electronica and avant garde electronic music from Colombia and Latin America.
Carlos Rizzi is currently working as a music producer to a wide variety of projects from artists from Colombia as well as some personal projects such as a sound installation in Bogotá’s National Library, various remixes and a couple of EP’s.
George Chernyshov  George Chernyshov. Postdoctoral at the Graduate School of Media Design, Keio University, Japan.
Your ad could go here.
Christopher Changmok Kim  Christopher Kim, more commonly referred to as Chris by pretty much everyone around him for obvious reasons of convenience, received his bachelor’s degree in Technological Systems Management at Stony Brook University located in Long Island, New York. He also minored in Engineering and Technology Entrepreneurship. He worked as the student database manager and admissions officer of his alma mater for three years before starting graduate school. His main interests lie in the realm of measuring the physiological reactions of people reading works of fiction using unintrusive sensing equipment. He is also interested in working to eliminate technological alienation, and is a big advocate of modular design of technology.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Abstract Abstract“Ethereal Phenomena” is an interactive experience for the expansion of consciousness. The user meditates in front of an illustration based on Tibetan thangka art that reacts to the way they breathe. Through the breathing process, the image becomes an extension of the user’s body and a reflection of their mind. From our deceased bodies flowers will grow, we are in them and that is eternity. Wade Marynowsky (University of Technology Sydney) Biography BiographyWade Marynowsky  Dr Wade Marynowsky is an artist, academic and researcher working across digital media, including robotics, immersive and interactive performance / installation, music and video.
His main body of research explores the notion of robotic performance agency by challenging traditional notions of classical spectatorship and performance. Through the use of humour, irony and a host of unnerving thematics he addresses important issues relevant to our ever increasing technological society.
Dr Marynowsky has exhibited nationally and internationally since 1998, with his work being presented in major festivals, biennales and survey exhibitions around the world. He is also a lecturer in Interactive Design, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney.
Abstract AbstractThe artist has purposely input photography of local flowers into the Portrait AI engine, forcing it to find faces where there are none. The sequence flows from machine abstraction to the representation of faces, confusing the threshold of anthropomorphism, human's innate tendency to see faces in the world around us. Goldfish Architecture: Therapeutic Urban Aquaponics Alex Orsholits (the University of Tokyo) and Zhou Li, Kritika Dhupar, Yusuke Obuchi, Chengzhe Zhu, Yusuke Komata, and Shuta Takagi (University of Tokyo) Biographies BiographiesAlex Orsholits  Holder of a Bachelor of Science from the EPFL (Switzerland), and a Master of Engineering from UTokyo, Alex Orsholits is currently a PhD candidate of Obuchi Lab at the University of
Tokyo. His work focuses on implementing new and upcoming technologies to establish functional processes of interfacing innate human perception with computer-based mathematical representations of space within the context of architecture and digital fabrication
Zhou Li  Zhou Li is a Ph.D. student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, Obuchi Laboratory. Prior to the University of Tokyo, he studied architecture at Cornell University and at the University of Southern California, where he acquired his Bachelor of Architecture Degree with honors. He has also worked in the Beijing Institute of Architectural Design and Liang Architecture Bureau+ in Los Angeles.
His work is often centered around sustainability, digital fabrication, and computational design, and ranges from kinetic sculptures to animatronics to architectural and urban design. His work has been awarded numerous honors such as the Director’s Choice Award of the RESIDE Mumbai Mixed Housing International Open Ideas Competition, First Place in the Cornell York Prize Competition, and was selected to be exhibited and collected at the Los Angeles A+D Museum.
Kritika Dhupar  Kritika graduated from the Chandigarh College of Architecture with the Pierre Jeanneret Gold medal for her undergraduate thesis. Her early interests in adaptive reuse and contextual/experiential urban interventions radically expanded with the experience gained from interning in Vienna and later working at prominent practices in New Delhi for five years. She is currently pursuing her masters at the University of Tokyo Obuchi lab, to explore advanced/alternative means of design and production and potential ways to deploy them in the unique constraints and architectural/urban traditions which she hails from.
Yusuke Obuchi  Yusuke Obuchi is an Associate Professor in Architecture at the University of Tokyo, where he has directed Obuchi Laboratory at the Department of Architecture since 2010. He is also a founding Co-director of the Advanced Design Studies Program, which consists of Digital Fabrication Lab, Sustainable Prototyping Lab, Media Initiative Lab, Design Think Tank, Design Practice Lab, Social Design Lab, and Computational Unit. Prof. Obuchi was Co-Director of the Design Research Laboratory at the Architectural Association (AA) in London from 2005 to 2010, and Course Master and Unit Master of the Architectural Association from 2003 to 2005. He studied architecture at Princeton University, Southern California Institute of Architecture, the University of Toronto, and received his Ph.D from the University of Tokyo. He has previously taught at Princeton University, Harvard University’s Graduate School of Design, University of Kentucky, and New Jersey Institute of Technology.
Chengzhe Zhu  Chengzhe Zhu is a Master student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, and a member of Obuchi Lab. He received a Master of Science in Design from the University of Pennsylvania and a Bachelor of Architecture from Tongji University. He participated in several urban regeneration projects during his internship at TJAD Original Design Studio. His academic works centered digital design, analysis and fabrication methods and he is currently exploring novel implementations of digital tools in the process of design and production to make architecture more inclusive and adaptable.
Yusuke Komata  Yusuke Komata is an architect and a researcher based in Tokyo. He graduated from University of Tsukuba Master’s Program in Art & Design, and started working from 2009 at an architects office Arata Isozaki & Associates established by Arata Isozaki, winner of the 2019 Pritzker Prize. Komata has led many projects such as university campus designs in Central Asia and Egypt, an art museum design in Russia, a movable pneumatic concert hall, and so on. After 7 years of working in Arata Isozaki’s office, he founded his own firm called Yusuke Komata New Building Office in 2016 and started designing various projects in many different regions, with in collaboration with many architects and engineers. In 2019, he joined Department of Architecture at University of Tokyo as a researcher in Obuchi Laboratory, and started working for research projects including the UAE pavilion at Venice Biennale 2021.
Shuta Takagi  Commencing his studies at the Tokyo University of Science in 2004, Shuta Takagi developed his skills as an architect and programmer until 2011, and in 2016 founded his firm Takagi Shuta Office LLC. He also works since 2016 as an academic specialist at the University of Tokyo Obuchi Laboratory and provides several lectures on digital design throughout Japan, such as the University of Tokyo, Tokyo University of Science, Kogakuin University, Nagaoka University of Art and Design, Hokkaido University, and Tama Art University.
Abstract AbstractGoldfish Architecture is a digitally augmented and functional vernacular construction that harnesses the therapeutic effects of plants and aqueous pets to propose a future for mindful and sustainable living. The pavilion serves as a prototype for a productive and captivating smart aquaponic appliance that brings together individuals and communities alike. Iris Yamin Xu (Bowling Green State University) Biography BiographyYamin Xu  Yamin Xu is an artist and electronics geek, working on the edge that blurs animation, coding, and electronics with an emphasis on the exploration of emerging technology and art. He strives to create and define new things, which have not been clearly perceived as art. This motivation is sustained by his rigorous art/engineering practice, which is informed by the convergence of divergent spheres of study: religion and science, privacy and surveillance, the robotic and organic. The result is an innovation - feedback to affect and expand his understanding and definition of art.
Before he earned his MFA in the United States researching computer vision, he obtained a BA in art and design. His experience includes being a VFX artist at CCTV, an instructor at Peking University, and a researcher at Argonne National Laboratory. Currently, he is an Assistant Professor in the Digital Arts program at Bowling Green State University.
Abstract AbstractAs an experiment of "bring on-screen animation closer to physical", the iris is given independent perception and temperament. By measuring physiological signals of the wearer, its mood is affected by the wearer. Depending on itself and the wearer's feeling, iris performs different responses, which affects interpersonal interactions and relationships. Microbiospheric Engineering Kevin Blackistone (Kunstuniversität Linz) and Amir Bastan (Creative Robotics)   Biographies BiographiesKevin Blackistone  Kevin Blackistone is an intermedia artist exploring uses & impacts of technology and data. He works using backgrounds in 3d animation, video, sound design and creative coding. As a intramural research fellow with the National Institute of Health, Section of Comparative Behavioral Genomics (U.S., 2012-2014) he further developed his coding and research skills and uses this knowledge to inform his present works. He has received production awards for prior works from the Johns Hopkins Saul Zaentz Innovation Fund (Who’s Watching), Ruby’s Arts Awards (Extensions of the Self), and the Baltimore Office of Promotion and the Arts (Radiant Flux).
Kevin received his degree in Intermedia and Digital Arts from the University of Maryland Baltimore County in 2000 and is currently pursuing masters in the Interface Cultures and the Post Digital Lutherie programs at Kunstuniversität Linz.
Amir Bastan  As a new media artist with a background in fine arts and philosophy, Amir explores ways of designing narratives within robotics, computer arts and creative coding. He is a member of the vvvv community as a tutor and contributor. His expertise in 3D animations and real-time interaction design forms a variety of research, artistic and commercials projects. Amir has been working as a programmer and concept developer for artists and art-based studios realizing projects for robotics, data visualisation, generative design, computer vision and physical computing.
Currently, he is a PhD candidate and a researcher at the Creative Robotics Labor UfG–Linz, where he is designing customized and purposeful tools for real-time interaction with robots, ranges from KUKA robotic arms to Spot, the Boston Dynamics quadruple robot.
Amir is teaching “Creative Coding”– a programming course for artist and “Sequence of Meaning”– a theoretical course on analytical approach to new media arts.
Abstract AbstractA merger of micro/macro considerations of our world and the biology present upon it. Microbiospheric Engineering explores human growth using industrial robotics to portray a microbial colonies as the global surface landscapes to which we are accustomed from our own environment. Mixed Reality Ulysses (or MR Ulysses) Neill O'Dwyer, Gareth W. Young, Aljosa Smolic, and Matthew Moynihan (Trinity College, Dublin; V-SENSE) and Paul O'Hanrahan (Balloonatics Theatre Company) Biographies BiographiesNeill O'Dwyer  Neill O'Dwyer is a Senior Postdoctoral Research Fellow in V-SENSE at Trinity College Dublin (TCD). He is an adjunct lecturer of the School of Creative Arts, where he teaches Performance and Technology. He is an awardee of the prestigious Irish Research Council (IRC) Government of Ireland Research Fellowship (2017 – 2019). He is the sole author of Digital Scenography: 30 years of experimentation and innovation in performance and interactive media (2021). His research focuses on the impact of technology on artistic processes.
Gareth W. Young  Gareth W. Young is a postdoctoral research fellow on the V-SENSE project at Trinity College Dublin. His current research focuses on the evaluation of creative uses for extended-reality technology. This approach includes studying the design and use of XR technology in innovative practices, focusing on the interface between users and the XR platform. Gareth’s role is to observe and record how users interact with XR and design new methods to interact with XR in innovative and novel ways.
Aljosa Smolic  Aljosa Smolic is Professor of Creative Technologies at Trinity College Dublin. His research group V-SENSE focuses on immersive XR and deep learning for visual computing by combining computer vision, computer graphics, and media technology. He was Senior Research Scientist for Disney Research Zurich and Head of the Advanced Video Technology group. With Fraunhofer Heinrich-Hertz-Institut (HHI) Berlin, he headed a research group as Scientific Project Manager. He has published over 250 peer-reviewed papers and filed over 40 patents.
Matthew Moynihan  Matthew Moynihan is a PhD Candidate in the V-SENSE project at Trinity College Dublin. His research involves the development and refinement of Volumetric Video and Performance Capture systems. Specifically, this research aims to leverage temporal information to improve the quality and efficiency of volumetric sequences. Matthew also holds a BSc in Physics and an MEng in Electronic systems from Dublin City University (2011-2017), where both degrees had a focus on Computer Vision. Having worked on industry-focused applications prior to his PhD, Matthew hopes to continue extending his research into more creative fields.
Paul O'Hanrahan  Dr. Paul O’Hanrahan, artistic director of Balloonatics Theatre Company, is an award-winning actor and director who specialises in the in-situ performance of Irish writers, particularly James Joyce and Samuel Beckett. He is particularly interested in place and memory studies and has a doctorate combining German and Contemporary Literature Studies from the University of Liverpool. He has Edinburgh Fringe First Awards for productions based on Joyce’s Ulysses and Finnegans Wake. In 2014 he devised the inaugural Beckett Walk for Dun Laoghaire-Rathdown Council and has led this guided tour for the last eight years.
Abstract Abstract'MR Ulysses' is an innovative performance experiment hybridizing theatre and volumetric video, enabling individuals to experience a live-action re-enactment of James Joyce's 'Ulysses' in VR. Audiences are invited to don an HMD, embody the character of Stephen Dedalus, and engage Buck Mulligan in Joyce's famous Martello tower-top scene. SeoulVibe Taeil Lee (Korea University) Biography BiographyTaeil Lee  He studied Industrial Design at KAIST in Daejon, Korea, and Institute of Design, Illinois Institute of Tech in 90's. He has been teaching mainly Industrial Design and Interaction Design for 20+ years in Universities, and working in various projects mostly on UX Design and interactive design applications. He has been interested in Open Source Development tools and environment such as Processing and Arduino along the path, and recently trying to extend the course of interest more towards artistic representation of artifacts.
Abstract AbstractSeoulVibe is an effort to literally feel the city of Seoul. The jacket with over 45 individual units that can sense sounds and convert to vibrations and lights. We experienced various streets of Seoul through the unique sounds they produce and form the city of Seoul. Siren Wenqian GAO (studio Gao Wenqian, Beijing Institute of Fashion Technology (BIFT)) Biography BiographyWenqian GAO  Gao Wenqian
Bron in ShanDong, China
Education
2009-2013 Academy of fine art of China.
2015-2019 École national supérieur des beaux-arts de paris
work and live in Beijing
Abstract AbstractIn the future, is there also the program who use disillusioned human like siren in the virtual world? Signal Chin-Hsiang Hu, Zhao-Qing Chang, Che-Wei Hsu, Kuan-Wen Chen, and Yu-Chi Fu (Peppercorns Interactive Media Art) Biographies BiographiesChin-Hsiang Hu  artist, engineer, interactive designer. Desires to focus his artwork on the creation of new media art to examine the over-development of science and technology. Each kind of creative direction expressed a different idea and required the use of different technologies. In terms of integrating technologies, the development of interactive software played a very important role in his development. and to manage the interactive devices, augmented reality, and motion sensors. By combining different artistic forms, he built his creative skills and abilities. He continuously challenged himself to create works that form a dialogue between his personal experiences and new media art. works form the assumption that though the performing arts, interactive art, and visual art are separate disciplines, their combination can give rise to a new form of technology-based performing arts. This also includes a self dialogue that results in a clash between the inner self and external factors.
Zhao-Qing Chang  I accidentally entered the interactive industry. With each project and work as an oppartunity. I saw the laughter of my big friends and children, sa that I realized the nature of 'interaction" and also found the joy of persisting in the fiald of interaction. I like to draw closer to people's relationship through the discussion, learing, sharing and teaching of "interactive tachnolagy".
Che-Wei Hsu  Che-Wei Hsu graduated fromTaiwan University of Science and Technology,Majored in Computer Science and Information Engineering.
He is a creative technologist,interactive engineer and drummer.He focuses on making new media art projects,interdisciplinary performance ,interactive advertising and interactive experiment.He creates works to avoid the boring life and breaking the limit of being human. And tries to find possibilities about hacking senses , human behaviour and acting Chūnibyō style..etc.
Kuan-Wen Chen  Kuan Wen Chen graduated from National Chiao Tung University, Master of Science in Architecture. In college, she majored in Communications Design at Shih Chien University and mainly engaged in digital arts, interactive design, and installation arts. With regard to the style and concept of design, she prefers her projects created in programming so that the works would exhibit properties of real-time and interaction. Also, as an explorer, communicator and connector of design and computer science, Kuan Wen has dedicated herself to applying innovative technology from a designer's perspective and to employing digital tools for opening the world of design to new possibilities.
Yu-Chi Fu  Yu Chi, Fu, a Visual designer based in Taipei, Taiwan.
Recently been focusing on merging human emotions, relationships with various formats, such as 3d art, video art, digital graphics.
Education:
Bachelor of Visual Design, She-Te University, 2018
Experince
Visual Designer / Designer at Peppercorns Interactive Media art
Abstract AbstractAwaiting for light in the darkness(covid-19) is similar to searching for hope(normal life).
The artwork combined with the space, projection, laser, smoke, represent as "Cyber Sea".
The way to interact with the work can be from the data of people’s mobile phone, or the audience who walks into the artwork. Strands of Mind Adrian Meyer (Filmakademie Baden-Württemberg) Biography BiographyAdrian Meyer  Adrian Meyer is a multidisciplinary Digital Artist and Filmmaker from Germany. His work is focused on moving images to inspire, and spark emotional experiences; often using a surreal and dark visual language.
Initially working in the field of Audiovisual Installations and Stage Visuals, he also has a broad background in Visual Effects. He has worked on international motion pictures and commercials in Berlin and London.
Adrian graduated in Computer Animation & Visual Effects at Filmakademie Baden-Württemberg. His work was internationally screened at Annecy Animation Festival, Siggraph Electronic Theatre and many more, and received multiple nominations such as the Visual Effects Society Student Award and the Special Jury Prize VR at NewImages Festival Paris.
Abstract AbstractExplore a world beyond the bounds of our human perception. A world full of mystery, of beauty and darkness. Let yourself be taken on a trip into the woven nature of existence. The Tides Within Us Barnaby Churchill Steel (Marshmallow Laser Feast); Kate Farrell (York Mediale, York Museums Trust); and Bianka Hofmann (Fraunhofer Institute for Digital Medicine MEVIS) Biographies BiographiesBarnaby Churchill Steel  Marshmallow Laser Feast (MLF) create immersive experiences, expanding perception and exploring our connection with the natural world. Fusing architectural tools, contemporary imaging techniques and performance with tactile forms, MLF sculpt spaces that lay dormant until animated by curiosity and exploration. Informed as much by playfulness as research, MLF break the boundaries to worlds beyond our senses.
MLF’s work has been exhibited in the UK and internationally including at the Saatchi Gallery, NXT Museum, Lisbon Triennial, Istanbul Design Biennial, the Sundance Film Festival, and the V&A and Design Museum.
Kate Farrell  York Mediale is an independent arts charity, originally founded in 2016 that works year-round to deliver new commissions, live events and artistic development
Through incorporating technologies into their work, the artists we work with bridge the gap between the new and the traditional, to challenge and inspire. We work alongside artists, building trust through our actions, not just our words, to create lasting relationships, collaborations and partnerships with those who share and champion our values.
Bianka Hofmann  Embedded in a worldwide network of clinical and academic partners, Fraunhofer MEVIS develops real-world software solutions for image and data-supported early detection, diagnosis, and therapy. Strong focus is placed on cancer and the circulatory system, brain, breast, liver, and lung diseases. The goal is to detect diseases earlier and more reliably, tailor treatments to each individual, and make therapeutic success more measurable.
The Institute is committed to raising awareness about how digital transformation influences health care by opening up its R&D and integrating the arts and humanities. The focus is on life-long learning, collaborative production, and scientifically inspired art. Laypersons and experts are invited to get involved, exchange ideas, and disseminate innovative R&D eye-to-eye with the researchers and developers.
Abstract AbstractA cross-sectoral project utilizing high-end MR research results, 'The Tides Within Us' -created by Marshmallow Laser Feast (MLF) and Fraunhofer Institute for Digital Medicine MEVIS-is an ongoing exploration into the world beyond the limits of our senses at the intersection of art, science and technology. Volume II of Voids shaoyu su (University of Southern California) and Weidi Zhang (university of california, santa barbara)   Biographies Biographiesshaoyu su  Shaoyu Su is a new media artist, cinematographer, and curator. His artistic practices and research employ interdisciplinary methodologies from computer graphics, photography, physics, and literature, investigating concepts about deep space-time-mining: alternative projection from ancient history to the far future. His works have been shown internationally, at venues such as J.Paul Getty Museum, International Symposium on Electronic Art(ISEA), IEEE PacificVis, Today Art Museum Beijing, and Vortex Immersion Dome L.A.
Weidi Zhang  Weidi Zhang is an LA-based new media artist, visual designer, and researcher. Her current research and media art practices investigate the possibilities of semantic meanings and non-linear narrativity of assemblage art in the context of Intelligence system design, immersive media, and interactive generative art. Her works are featured at different international venues, such as the SIGGRAPH, SIGGRAPH ASIA, ISEA, Times Art Museum, IEEE VISAP, SwissNex Gallery, Japan Media Art Festival, and shortlisted in Lumen Prize. Currently, she is a Ph.D. candidate in the Media Arts and Technology Program and a researcher in Experimental Visualization Lab. She holds her MFA degree in Art + Technology at California Institute of the Arts.
Abstract AbstractVolume II of Voids is an intelligent interactive art experience that is generated based on the voids between humans. The project is realized by using volumetric capturing, real-time visualization, and machine learning algorithms. Wednesday 10:00am-6:00pm Hall E, Experience Hall (B2F, E Block) Art Gallery, Emerging Technologies, XR · Full Access, Onsite Experience, Onsite Student Access, OnsiteExperience Hall 10am: Room Tilt Stick Kousuke Motohashi, Koyo Mori, and Kenri Kodaka (Nagoya City University) Biographies BiographiesKousuke Motohashi  Motohashi Kosa is a graduate student in the Graduate School of Design and Architecture, Nagoya City University. He is interested in distorting subjective gravity using HMD technology based on the physical interaction.
Koyo Mori  Koyo Mori is a researcher in the Graduate School of Design and Architecture, Nagoya City University. He is interested in using HMD technology to induce the sensation of stretching and contracting the body.
Kenri Kodaka  Kerni Kodaka is an associate professor in the Graduate School of Design and Architecture, Nagoya City University. His special interest is distorting the body-image using natural materials or virtual-reality techniques, in the framework of cognitive psychology.
Abstract AbstractRoom Tilt Stick provides an illusory experience of tilting a room using a stick and of walking on an acutely inclined slope, accomplished by correlating the tilting velocity of a three-dimensional modeled room in HMD with the degree of force transferred to the wall or ground with a special stick. 10am: WizardOfVR: Emotion-Adaptive Virtual Wizard Experience Kunal Gupta and Yuewei Zhang (University of Auckland, Empathic Computing Lab); Yun Suen Pai (Keio University Graduate School of Media Design); and Mark Billinghurst (University of Auckland, Empathic Computing Lab) Biographies BiographiesKunal Gupta  Kunal Gupta is a Ph.D. candidate at the Empathic Computing Laboratory, University of Auckland, New Zealand, under the supervision of Prof. Mark Billinghurst. His research revolves around emotion recognition in VR using physiological and contextual information.
Prior to this, he worked as a UX Researcher at Google and as UX Designer at a startup in India, for a total of around 5 years of industry experience. He obtained a master's degree in HCI from HITLab NZ supervised by Prof Billinghurst. He conducted some of the first research into the use of eye-gaze to enhance remote collaboration in wearable AR systems.
Yuewei Zhang  Yuewei Zhang is an XR developer and enthusiast who has been creating commercial VR games since 2016. He is currently studying at the University of Auckland as a 2nd-year undergraduate Software Engineering student. Yuewei aims to be at the forefront of developing virtual reality applications. He enjoys experimenting with creating interactive media only possible in XR, whether that be art, games, or research, and their empathic outcome. Areas he is working on at the moment include finding novel ways of incorporating storytelling, music, and creative programming into extended reality.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design. He obtained his Bachelor's Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan, and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand. His research interest is the effects of VR/AR/MR towards human behavior, perception, and learning using physiological signals and artificial intelligence
Mark Billinghurst  Mark Billinghurst is Director of the Empathic Computing Laboratory, and Professor at the University of South Australia in Adelaide, Australia, and at the University of Auckland in Auckland, New Zealand. He earned a PhD in 2002 from the University of Washington and conducts research on how virtual and real worlds can be merged, publishing over 600 papers on Augmented Reality, Virtual Reality, Empathic Computing, and related topics. In 2013 he was elected as a Fellow of the Royal Society of New Zealand, and in 2019 was given the ISMAR Career Impact Award for lifetime contribution to AR research and commercialization.
Abstract AbstractWe demonstrate WizardOfVR, a personalized emotion-adaptive virtual reality (VR) Wizard akin to the Harry Potter experience, highlighting a use-case scenario of a real-time biofeedback loop between the user's emotional state and adaptive VR environments (VREs) using off-the-shelf physiological sensors. 10am: X-Wing: Propeller-Based Force Feedback to Head in a Virtual Environment Koki Watanabe, Fumihiko Nakamura, Kuniharu Sakurada, Theophilus Teo, and Maki Sugimoto (Keio University) Abstract AbstractThis research introduces X-Wing, a haptic device using ducted fans attached to VR Head Mounted Display (HMD). It enables a VR user to receive force feedback based on different wind power converted into impulsive force for a unique VR experience such as virtual aerial simulation. 10am: Dementia Eyes: Perceiving Dementia with Augmented Reality Ximing Shen and Yun Suen Pai (Keio University Graduate School of Media Design); Dai Kiuchi, Kehan Bao, Tomomi Aoki, and Kanoko Oishi (Mediva Inc.); and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesXiming Shen  Ximing Shen is currently a research assistant at Embodied Media Project, Keio University Graduate School of Media Design.
She pursued her bachelor's degree at the University of Manchester, and master's degree at Keio University, Graduate School of Media Design. Her research interest is data science, accessibility and inclusive design, and human-computer interaction.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design.
He obtained his Bachelors Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand.
His research interest is the effects of VR/AR/MR towards human behavior, perception and learning using physiological signals and artificial intelligence.
Dai Kiuchi  Dai graduated with a Bachelor’s degree from Kyoto University, Japan and a
Master’s degree in Physiotherapy from the Robert Gordon University, UK. He has nearly 10 years of clinical experience as a physiotherapist in the UK. Since
he returned to his native Japan in 2014, he has joined Mediva Inc., a consulting
and operations company specialised in healthcare. He has been involved with
projects such as clinic management, market research and healthcare service
setting up. He has also been leading projects to introduce and implement
dementia-friendly design into public buildings, hospital wards, residential and
nursing homes.
Kehan Bao  Bao graduated from East China University of Science and Technology, China as a social worker, and a Master’s degree in Social Welfare from Japan Women's University. She also holds a MBA from Nagoya University of Commerce & Business. She has joined Mediva Inc., a consulting and operations company specialised in healthcare since 2015. She has experiences in market research, setting up and operational improvement of healthcare and elderly care services and dementia-friendly design implementation both domestically and internationally. She has a keen interest in the improvement of elderly care systems in China.
Tomomi Aoki  Tomomi graduated from the Faculty of Nursing at Kitasato University and obtained a nursing qualification. She gained clinical experiences at university hospitals and then was involved in the management of the long-term care business. she has joined Mediva Inc., a consulting and operations company specialised in healthcare since 2011. She has been involved in projects related to the operations and management of long-term care business and healthcare services.
Kanoko Oishi  Kanoko graduated from Osaka University School of Law valedictorian and holds an MBA from Harvard Business School.
She is a founder and the CEO of Mediva Inc., a consulting company specialized in healthcare and the COO of Medical Corporation Platanus, a healthcare provider arm of Mediva. She previously worked as a partner at McKinsey & Company in Japan and the US.
She has served on numerous governmental committees, and is on the boards of directors including Shiseido Japan and Santen Pharmaceutical, and a member of the Japan Advisory Board at Harvard Business School and the Management Council at Osaka University.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractDementia Eyes is a mobile AR experience simulating visual symptoms of senile dementia based on pathology and medical workers' experience with patients. The application was validated by professional medical workers in Japan, and the result advocates for the efficacy of the empathy we intended to bring to the medical workers. 10am: GIBSON: AR/VR synchronized city walking system Seiichiro Takeuchi, Yuki Homma, Kyoko Hashiguchi, and Kent Kajitani (MESON, Inc.) and Shingo Meguro (Hakuhodo DY Holdings) Abstract AbstractGIBSON is a cross-AR/VR city walking system that allows VR user in remote location and AR user in reality to walk together as if they are sharing the same space. The VR space is created with 3D city model, and the positions of users are synchronized with Visual Positioning System. 10am: World of Hiroshige Alex Weight, Daniel Flood, and Dylan Neill (UTS Animal Logic Academy) Abstract AbstractStep into the beautiful paintings of the Japanese artist Utagawa Hiroshige. This immersive virtual reality experience invites the participant to interact within the atmospheric world of Hiroshige’s delicate and moving artworks. The project offers a unique way of engaging with the artist’s work and the Ukiyo-e genre of Japanese art. 10am: Indefinately:Indefinately Chenxin Zhang and Lesi Hu (Beihang University) Biographies BiographiesChenxin Zhang  From Beijing University of Aeronautics and Astronautics, she entered the School of New Media Art and Design in 2018 and is a fourth-year college student this year. The research direction is digital media and virtual reality, and he is the chief designer of Indefinately
Lesi Hu  From Beijing University of Aeronautics and Astronautics, she entered the School of New Media Art and Design in 2018 and is a fourth-year college student this year. The research direction is digital media and virtual reality, and he is the chief designer of Indefinately
Abstract AbstractThe work "Indefinitely" tells the epitome of the pollution of the earth and the future city. In the contemporary society, high walls have been built between people, and people living in the city are essentially replicas. 10am: Meet the Deer King Jing Zhang, Guangwen Zou, and Guangzheng Zhang (Beihang University, New Media Art and Design School) Abstract Abstractthe "splash-ink" interaction mechanism which comes from Chinese traditional painting style, and its application in different scenes. 10am: Cyberdream: An Interactive Rave Music Visualisation in Virtual Reality Jonathan Weinel (University of Greenwich) Biography BiographyJonathan Weinel  Jon Weinel is a London based artist/researcher whose main expertise is in electronic music and computer art. In 2012 he completed his AHRC-funded PhD in Music at Keele University regarding the use of altered states of consciousness as a basis for composing electroacoustic music. His electronic music and audio-visual projects have been presented internationally, and in 2018 his book Inner Sound: Altered States of Consciousness in Electronic Music and Audio-Visual Media was published by Oxford University Press. He has held academic posts in the UK and Denmark, and currently lectures at the University of Greenwich.
Abstract AbstractCyberdream, is a prototype virtual reality application, which provides a journey through audio-visual environments based on the aesthetics of 1990s rave music. The project provides three audiovisual 'sound toys', which allow the user to interactively 'paint with sound'. 10am: Dislocation Veljko Popovic and Milivoj Popovic (Prime Render Studios)   Biographies BiographiesVeljko Popovic  Veljko Popovic (1979) graduated from the Academy of Fine Arts in Zagreb, Department of Painting, in 2003. He has worked in computer graphics since 1998 and co-founded Lemonade3d, a CG and animation studio that later became Prime Render Studios. Since 2012, he teaches animation at the Arts Academy in Split. His films have been screened and awarded at numerous film festivals worldwide. He was a jury member at several film festivals.
Filmography: Dislocation - VR (2020), Cyclists (2018), Planemo (2016), Father (2012, co-director), Dove sei, amor mio (2011), My Way (2010, co-director), She Who Measures (2008)
Milivoj Popovic  Milivoj Popovic (1979) graduated from the Arts Academy in Split, Department of Sculpting, in 2014. He is an external associate at the Arts Academy, where he teaches Digital Sculpting. He co-founded Lemonade3d, a CG and animation studio that later became Prime Render Studios, where he works as director and producer. He worked as producer and 3D artist on short animated films that received over 70 international awards, including the awards at Aspen and Annecy.
Abstract AbstractThe VR experience Dislocation takes a look at an absurd moment of disbelief and fear. It examines the internal processes that develop and offers a visual depiction of a person forced into extreme circumstances – a moment of dislocation. 10am: “Bodyreath”: An Interactive VR Installation to Experience and Understand People with Autism Huifeng Zhang (School of New Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University)   Biographies BiographiesHuifeng Zhang  My name is Huifeng Zhang. I am a student of Beihang University, in Beijing, China, majoring in digital media art design.
In the process of learning, I have used processing and arduino to do interactive installation works, studied web design, and loved animation creation. My animation works won the first prize in the 8th National College Digital Art Design Competition, but I prefer XR creation and have done VR and AR projects. I hope to study the application of AI and VR in the future and uphold the concept of "combination of art and technology", Contribute to the research results.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract Abstract"Bodyreath" is an interactive VR installation for understanding people with autism. It is divided into two parts, the external projection and the internal VR scenarios. It helps the audience to appreciate the innocence of autistic people in different way and to understand them artistically. 10am: Nachtalb: A multisensory Neurofeedback VR-Interface Paul Morat, Aaron Schwerdtfeger, and Frank Heidmann (Interaction Design Lab, Fachhochschule Potsdam) Abstract AbstractNachtalb is an immersive interface that enables brain-to-brain interaction using multisensory feedback. With the help of a BCI, brain-activity data is measured and visually, tactilely and auditorily translated in VR. This intends to create a feedback-loop that turns brain-activity from data-input into sensory output which directly influences the data-input again. 10am: Beat Keisuke Itoh (Independent), Hiroko Fujioka (WOWOW INC.), Katsutoshi Machiba (Supership Inc.), and Tetsuya Ohashi (CinemaLeap Inc.) Biography BiographyKeisuke Itoh  VR animation director. Graduated from Tama Art University, Department of Graphic Design. After working as a graphic designer for a manufacturing company, he became a freelance CGI artist in 2012. In 2020/2021, Beat was nominated for the competition section of the 77th Venice International Film Festival and Cannes XR. In 2019, Feather was premiered at the 76th Venice International Film Festival in a Biennale College Selection as the first Japanese film in the VR category. In addition, his works have been screened at numerous film festivals, including the Berlin International Film Festival, Busan International Film Festival,Kaohsiung Film Festival, and SIGGRAPH.
Abstract Abstract“Beat” is a story elaborated from your “Heart”. Viewers experience the work with their hearts in their hands. Viewers encounter a rusted robot without a “heart” to move. Viewers can grant him a new heart by putting theirs on the robot. “Heart” becomes the key to move the story forward. 10am: Exploration of Visuo-haptic Interactions to Support Learning Leopold’s Maneuvers Process in Virtual Reality Soo Wan Chun, Jinsil Hwaryoung Seo, Caleb Kicklighter, Elizabeth Wells-Beede, Jack Greene, and Tomas Arguello (Texas A&M University) Abstract AbstractLeopold’s Maneuvers VR is a virtual reality application that enables students to experience Leopold's Maneuvers assessment process with realistic visual and haptic feedback in a highly interactive and immersive environment. 10am: A Walk Alone: A Virtual Reality Simulation Triggering Fear and Stimulating Empathy to Raise Awareness about the Dangers Women Face when Walking Alone at Night Eman Al-Zubeidi, Jinsil Hwaryoung Seo, Julia DeLaney, Dominic Nguyen, Jonathan Konderla, and Jaime Diaz (Texas A&M University) Abstract AbstractA Walk Alone is a virtual reality experience that simulates what it feels like to walk alone at night as a woman. The concept is inspired by the kidnapping and murder of Sarah Everard, a 33-year-old woman whose tragedy reignited an international conversation about women’s safety in March 2021. 10am: Virtual Whiskers: Cheek Haptic-Based Spatial Directional Guidance in a Virtual Space Fumihiko Nakamura, Adrien Verhulst, Kuniharu Sakurada, Masaaki Fukuoka, and Maki Sugimoto (Keio University) Abstract AbstractThis paper presents Virtual Whiskers, a spatial directional guidance technique using cheek haptics in a virtual space. We provide haptic stimulation on a cheek using two robot arms attached to a Head-Mounted Display. The robot arms touch a point that corresponds to directional information to present the target's directional cues. 10am: "Once": Multi-perspective and Interactive VR Narrative Film Zixiao Liu and Lutong Li (School of Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University) Biographies BiographiesZixiao Liu  Liu Zixiao is an undergraduate student from Beihang University, School of Media Art and Design, majoring in digital media art and minoring the economics. Her research direction is about virtual reality.
Lutong Li  My name is Lutong Li. I'm a student major in digital media in the School of New Media Art and Design of Beihang University. I'm now living in Beijing.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract Abstract“Once” is an interactive virtual reality narration film based on post-war experience, which is set after a continuous war period between two countries. Through the three innovative points, we create this VR narrative film, which tells common people's experience after the war as clues to express the trauma it brings. 10am: Marco & Polo Go Round Benjamin Steiger Levine (Item 7) Biography BiographyBenjamin Steiger Levine  Benjamin Steiger Levine portrays experience through unexpected stories that are both touching and unsettling. This balance between charm and discomfort, humanity and visual-wonder is the heart of his work. Ben’s favorite stories come from a personal place that get expressed in unexpected visual ways.
Abstract AbstractMarco & Polo Go Round is a comedic love story with a very surreal twist. A couple confronts the difficulties in their relationship as gravity turns on its head and their world literally falls apart around them. 10am: “Flower and the Youth”: Virtual Narrative and Creative Methods of Oral Performance in China Intangible Cultural Heritage Yu Lu, Zixiao Liu, and Xuning Yan (School of New Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University) Biographies BiographiesYu Lu  Yu Lu is an undergraduate student studying in the School of New Media Arts & Design, Beihang University, Beijing, China. Her undergraduate major is digital media and her research direction is about interactive desigh and virtual reality.
Zixiao Liu  Liu Zixiao is an undergraduate student from Beihang University, School of Media Art and Design, majoring in digital media art and minoring the economics. Her research direction is about virtual reality.
Xuning Yan  Xuning Yan is studying for a master's degree in the School of New Media Arts & Design, Beihang University, Beijing, China, Beihang University. Her work aims to explore the interactive design and audience experience of virtual reality performances.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract AbstractBased on technology of virtual reality (VR) and gesture recognition, we create the VR performance, "Flower and the Youth". Our work provides universal design approaches to the creation of content for future intangible cultural heritage performances. 10am: Ethereal Phenomena Silvana Malaver (Keio University Graduate School of Media Design); Natalia Barragán Nieto (Universidad de los Andes); Igor Igorevich Segrovets (Tokyo Institute of Technology); Carlos Rizzi (Sabana Records); and George Chernyshov, Christopher Changmok Kim, and Kai Kunze (Keio University Graduate School of Media Design) Biographies BiographiesSilvana Malaver  Silvana Malaver is a multidisciplinary artist and Ph.D student at the Graduate School of Media Design, Keio University, Yokohama, Japan. Her research and creative process mainly focus on exploring how to produce altered states of consciousness through diverse media artworks, from poetry and essay-films to interactive installations. She Majored in Literature at Universidad de Los Andes, Bogota, Colombia, and obtained a Master in Japanese Culture at the Graduate School of Humanities and Social Sciences, Saitama University, Saitama, Japan, where she specialized in Buddhism and Media Art. At Keio Media Design she is part of the project "Geist" ("mind" or "spirit" in German) that works on augmenting human capacities by combining cognitive science, psychology, and technology.
Natalia Barragán Nieto  Natalia Barragán Nieto. 1994. Gemini. Bogota, Colombia. Languages: SP_ENG_FR. Spirituality and esoterism. Tea and bubbles. Plants. Where things come from. Electronic music. Intuitively rational. Rationally intuitive. Communications designer, aesthete.
I don’t believe in coincidences. I believe in the alignment of specific factors at a specific moment: synchronicity. I believe that life is the result of a constant decision-making process, which is done both consciously and unconsciously. It is an eternal quest in order to achieve equilibrium and equanimity. I believe in what I create, consisting of a dialog between the analog and the digital, between reality and fiction, between images, sounds and words.
Igor Igorevich Segrovets  Igor Segrovets joined the Ethereal Phenomena project in the role of programmer and was responsible for curating the installation to be engaging, seamless and aesthetically pleasing. Igor’s contribution included technically realising the vision of a gamified, live and interactive meditation experience. This is Igor’s first contribution to human-computer interaction. In the past, while dreaming of becoming a rocket scientist, Igor completed his Bachelor degrees in Aerospace Engineering and Physics from The University of Queensland in Brisbane, Australia. During this time, Igor designed projects for teams researching photo-computing at The University of Queensland and quantum-sensing at Australian National University. Currently, Igor is completing a Masters degree in Mechanical Engineering at the Tokyo Institute of Technology, Tokyo, Japan. There, Igor's project with Onishi Laboratory simulates the turbulent dynamics of wind around city trees with the aim of realising real-time micro-scale weather prediction.
Carlos Rizzi  Carlos Rizzi is an electronic music producer, performer and multi instrumentalist from Bogotá, Colombia. He studied classical composition at the Pontificia Universidad Javeriana in Bogotá and Electronic Music Production and Performance at Catalyst Berlin. His work is based on the exploration of soundscapes and sound design in conjunction with IDM inspired beats, moody sequences and extreme sample manipulation.
He has released an album (Now Here Nowhere) and two EP’s (Tank! and Vestigial).
In 2020, during the Covid-19 pandemic, he and fellow collaborator Mateo Walschburger created Sabana Records, an independent record label focused on promoting left field electronica and avant garde electronic music from Colombia and Latin America.
Carlos Rizzi is currently working as a music producer to a wide variety of projects from artists from Colombia as well as some personal projects such as a sound installation in Bogotá’s National Library, various remixes and a couple of EP’s.
George Chernyshov  George Chernyshov. Postdoctoral at the Graduate School of Media Design, Keio University, Japan.
Your ad could go here.
Christopher Changmok Kim  Christopher Kim, more commonly referred to as Chris by pretty much everyone around him for obvious reasons of convenience, received his bachelor’s degree in Technological Systems Management at Stony Brook University located in Long Island, New York. He also minored in Engineering and Technology Entrepreneurship. He worked as the student database manager and admissions officer of his alma mater for three years before starting graduate school. His main interests lie in the realm of measuring the physiological reactions of people reading works of fiction using unintrusive sensing equipment. He is also interested in working to eliminate technological alienation, and is a big advocate of modular design of technology.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Abstract Abstract“Ethereal Phenomena” is an interactive experience for the expansion of consciousness. The user meditates in front of an illustration based on Tibetan thangka art that reacts to the way they breathe. Through the breathing process, the image becomes an extension of the user’s body and a reflection of their mind. 10am: Aerobanquets RMX Mattia Casalegno (Aerobanquets RMX)  Biography BiographyMattia Casalegno  Mattia Casalegno is an Italian artist known for his sculptures and his immersive, relational, and participatory installations. He often deploys emerging technologies to investigate themes of phenomenology, ecology and cybernetics.
Nominated for the New Technological Art Awards in 2014 and artist-in-residence at Eyebeam in 2015, he received various grants and fellowships from, among others, NEW INC, the Center for Cultural Innovation, Young Italian Artists Network, NYFA, the Elizabeth Foundation for the Arts and the Asia Culture Center in South Korea. In 2018 he was recipient of a Lumen Prize Award.
Casalegno has exhibited in such museums and institutions as MACRO Museum and Auditorium, Italy; Mutek Festival, Canada; Kuandu Museum of Fine Arts, Taiwan; ISEA in S.Korea; Chronus Art Center, China; Cimatics festival and Nuit Blanche in Belgium; Optronica in the UK; Le Cube Museum in France; OFFF in Spain, LACMA, YAA Museum and Satellite Art Fair in the US.
Abstract AbstractAerobanquets RMX is an immersive, multi-sensorial culinary experience focused on taste perception. Aerobanquets RMX is about reframing our perceptions and changing the way we experience food. It is not only a life changing experience, but, in a sense, a tool to reprogram all our perceptive expectations. 10am: The Tides Within Us Barnaby Churchill Steel (Marshmallow Laser Feast); Kate Farrell (York Mediale, York Museums Trust); and Bianka Hofmann (Fraunhofer Institute for Digital Medicine MEVIS) Biographies BiographiesBarnaby Churchill Steel  Marshmallow Laser Feast (MLF) create immersive experiences, expanding perception and exploring our connection with the natural world. Fusing architectural tools, contemporary imaging techniques and performance with tactile forms, MLF sculpt spaces that lay dormant until animated by curiosity and exploration. Informed as much by playfulness as research, MLF break the boundaries to worlds beyond our senses.
MLF’s work has been exhibited in the UK and internationally including at the Saatchi Gallery, NXT Museum, Lisbon Triennial, Istanbul Design Biennial, the Sundance Film Festival, and the V&A and Design Museum.
Kate Farrell  York Mediale is an independent arts charity, originally founded in 2016 that works year-round to deliver new commissions, live events and artistic development
Through incorporating technologies into their work, the artists we work with bridge the gap between the new and the traditional, to challenge and inspire. We work alongside artists, building trust through our actions, not just our words, to create lasting relationships, collaborations and partnerships with those who share and champion our values.
Bianka Hofmann  Embedded in a worldwide network of clinical and academic partners, Fraunhofer MEVIS develops real-world software solutions for image and data-supported early detection, diagnosis, and therapy. Strong focus is placed on cancer and the circulatory system, brain, breast, liver, and lung diseases. The goal is to detect diseases earlier and more reliably, tailor treatments to each individual, and make therapeutic success more measurable.
The Institute is committed to raising awareness about how digital transformation influences health care by opening up its R&D and integrating the arts and humanities. The focus is on life-long learning, collaborative production, and scientifically inspired art. Laypersons and experts are invited to get involved, exchange ideas, and disseminate innovative R&D eye-to-eye with the researchers and developers.
Abstract AbstractA cross-sectoral project utilizing high-end MR research results, 'The Tides Within Us' -created by Marshmallow Laser Feast (MLF) and Fraunhofer Institute for Digital Medicine MEVIS-is an ongoing exploration into the world beyond the limits of our senses at the intersection of art, science and technology. 10am: Iris Yamin Xu (Bowling Green State University) Biography BiographyYamin Xu  Yamin Xu is an artist and electronics geek, working on the edge that blurs animation, coding, and electronics with an emphasis on the exploration of emerging technology and art. He strives to create and define new things, which have not been clearly perceived as art. This motivation is sustained by his rigorous art/engineering practice, which is informed by the convergence of divergent spheres of study: religion and science, privacy and surveillance, the robotic and organic. The result is an innovation - feedback to affect and expand his understanding and definition of art.
Before he earned his MFA in the United States researching computer vision, he obtained a BA in art and design. His experience includes being a VFX artist at CCTV, an instructor at Peking University, and a researcher at Argonne National Laboratory. Currently, he is an Assistant Professor in the Digital Arts program at Bowling Green State University.
Abstract AbstractAs an experiment of "bring on-screen animation closer to physical", the iris is given independent perception and temperament. By measuring physiological signals of the wearer, its mood is affected by the wearer. Depending on itself and the wearer's feeling, iris performs different responses, which affects interpersonal interactions and relationships. 10am: Mixed Reality Ulysses (or MR Ulysses) Neill O'Dwyer, Gareth W. Young, Aljosa Smolic, and Matthew Moynihan (Trinity College, Dublin; V-SENSE) and Paul O'Hanrahan (Balloonatics Theatre Company) Biographies BiographiesNeill O'Dwyer  Neill O'Dwyer is a Senior Postdoctoral Research Fellow in V-SENSE at Trinity College Dublin (TCD). He is an adjunct lecturer of the School of Creative Arts, where he teaches Performance and Technology. He is an awardee of the prestigious Irish Research Council (IRC) Government of Ireland Research Fellowship (2017 – 2019). He is the sole author of Digital Scenography: 30 years of experimentation and innovation in performance and interactive media (2021). His research focuses on the impact of technology on artistic processes.
Gareth W. Young  Gareth W. Young is a postdoctoral research fellow on the V-SENSE project at Trinity College Dublin. His current research focuses on the evaluation of creative uses for extended-reality technology. This approach includes studying the design and use of XR technology in innovative practices, focusing on the interface between users and the XR platform. Gareth’s role is to observe and record how users interact with XR and design new methods to interact with XR in innovative and novel ways.
Aljosa Smolic  Aljosa Smolic is Professor of Creative Technologies at Trinity College Dublin. His research group V-SENSE focuses on immersive XR and deep learning for visual computing by combining computer vision, computer graphics, and media technology. He was Senior Research Scientist for Disney Research Zurich and Head of the Advanced Video Technology group. With Fraunhofer Heinrich-Hertz-Institut (HHI) Berlin, he headed a research group as Scientific Project Manager. He has published over 250 peer-reviewed papers and filed over 40 patents.
Matthew Moynihan  Matthew Moynihan is a PhD Candidate in the V-SENSE project at Trinity College Dublin. His research involves the development and refinement of Volumetric Video and Performance Capture systems. Specifically, this research aims to leverage temporal information to improve the quality and efficiency of volumetric sequences. Matthew also holds a BSc in Physics and an MEng in Electronic systems from Dublin City University (2011-2017), where both degrees had a focus on Computer Vision. Having worked on industry-focused applications prior to his PhD, Matthew hopes to continue extending his research into more creative fields.
Paul O'Hanrahan  Dr. Paul O’Hanrahan, artistic director of Balloonatics Theatre Company, is an award-winning actor and director who specialises in the in-situ performance of Irish writers, particularly James Joyce and Samuel Beckett. He is particularly interested in place and memory studies and has a doctorate combining German and Contemporary Literature Studies from the University of Liverpool. He has Edinburgh Fringe First Awards for productions based on Joyce’s Ulysses and Finnegans Wake. In 2014 he devised the inaugural Beckett Walk for Dun Laoghaire-Rathdown Council and has led this guided tour for the last eight years.
Abstract Abstract'MR Ulysses' is an innovative performance experiment hybridizing theatre and volumetric video, enabling individuals to experience a live-action re-enactment of James Joyce's 'Ulysses' in VR. Audiences are invited to don an HMD, embody the character of Stephen Dedalus, and engage Buck Mulligan in Joyce's famous Martello tower-top scene. 10am: Siren Wenqian GAO (studio Gao Wenqian, Beijing Institute of Fashion Technology (BIFT)) Biography BiographyWenqian GAO  Gao Wenqian
Bron in ShanDong, China
Education
2009-2013 Academy of fine art of China.
2015-2019 École national supérieur des beaux-arts de paris
work and live in Beijing
Abstract AbstractIn the future, is there also the program who use disillusioned human like siren in the virtual world? 10am: Signal Chin-Hsiang Hu, Zhao-Qing Chang, Che-Wei Hsu, Kuan-Wen Chen, and Yu-Chi Fu (Peppercorns Interactive Media Art) Biographies BiographiesChin-Hsiang Hu  artist, engineer, interactive designer. Desires to focus his artwork on the creation of new media art to examine the over-development of science and technology. Each kind of creative direction expressed a different idea and required the use of different technologies. In terms of integrating technologies, the development of interactive software played a very important role in his development. and to manage the interactive devices, augmented reality, and motion sensors. By combining different artistic forms, he built his creative skills and abilities. He continuously challenged himself to create works that form a dialogue between his personal experiences and new media art. works form the assumption that though the performing arts, interactive art, and visual art are separate disciplines, their combination can give rise to a new form of technology-based performing arts. This also includes a self dialogue that results in a clash between the inner self and external factors.
Zhao-Qing Chang  I accidentally entered the interactive industry. With each project and work as an oppartunity. I saw the laughter of my big friends and children, sa that I realized the nature of 'interaction" and also found the joy of persisting in the fiald of interaction. I like to draw closer to people's relationship through the discussion, learing, sharing and teaching of "interactive tachnolagy".
Che-Wei Hsu  Che-Wei Hsu graduated fromTaiwan University of Science and Technology,Majored in Computer Science and Information Engineering.
He is a creative technologist,interactive engineer and drummer.He focuses on making new media art projects,interdisciplinary performance ,interactive advertising and interactive experiment.He creates works to avoid the boring life and breaking the limit of being human. And tries to find possibilities about hacking senses , human behaviour and acting Chūnibyō style..etc.
Kuan-Wen Chen  Kuan Wen Chen graduated from National Chiao Tung University, Master of Science in Architecture. In college, she majored in Communications Design at Shih Chien University and mainly engaged in digital arts, interactive design, and installation arts. With regard to the style and concept of design, she prefers her projects created in programming so that the works would exhibit properties of real-time and interaction. Also, as an explorer, communicator and connector of design and computer science, Kuan Wen has dedicated herself to applying innovative technology from a designer's perspective and to employing digital tools for opening the world of design to new possibilities.
Yu-Chi Fu  Yu Chi, Fu, a Visual designer based in Taipei, Taiwan.
Recently been focusing on merging human emotions, relationships with various formats, such as 3d art, video art, digital graphics.
Education:
Bachelor of Visual Design, She-Te University, 2018
Experince
Visual Designer / Designer at Peppercorns Interactive Media art
Abstract AbstractAwaiting for light in the darkness(covid-19) is similar to searching for hope(normal life).
The artwork combined with the space, projection, laser, smoke, represent as "Cyber Sea".
The way to interact with the work can be from the data of people’s mobile phone, or the audience who walks into the artwork. 10am: Microbiospheric Engineering Kevin Blackistone (Kunstuniversität Linz) and Amir Bastan (Creative Robotics)   Biographies BiographiesKevin Blackistone  Kevin Blackistone is an intermedia artist exploring uses & impacts of technology and data. He works using backgrounds in 3d animation, video, sound design and creative coding. As a intramural research fellow with the National Institute of Health, Section of Comparative Behavioral Genomics (U.S., 2012-2014) he further developed his coding and research skills and uses this knowledge to inform his present works. He has received production awards for prior works from the Johns Hopkins Saul Zaentz Innovation Fund (Who’s Watching), Ruby’s Arts Awards (Extensions of the Self), and the Baltimore Office of Promotion and the Arts (Radiant Flux).
Kevin received his degree in Intermedia and Digital Arts from the University of Maryland Baltimore County in 2000 and is currently pursuing masters in the Interface Cultures and the Post Digital Lutherie programs at Kunstuniversität Linz.
Amir Bastan  As a new media artist with a background in fine arts and philosophy, Amir explores ways of designing narratives within robotics, computer arts and creative coding. He is a member of the vvvv community as a tutor and contributor. His expertise in 3D animations and real-time interaction design forms a variety of research, artistic and commercials projects. Amir has been working as a programmer and concept developer for artists and art-based studios realizing projects for robotics, data visualisation, generative design, computer vision and physical computing.
Currently, he is a PhD candidate and a researcher at the Creative Robotics Labor UfG–Linz, where he is designing customized and purposeful tools for real-time interaction with robots, ranges from KUKA robotic arms to Spot, the Boston Dynamics quadruple robot.
Amir is teaching “Creative Coding”– a programming course for artist and “Sequence of Meaning”– a theoretical course on analytical approach to new media arts.
Abstract AbstractA merger of micro/macro considerations of our world and the biology present upon it. Microbiospheric Engineering explores human growth using industrial robotics to portray a microbial colonies as the global surface landscapes to which we are accustomed from our own environment. 10am: Goldfish Architecture: Therapeutic Urban Aquaponics Alex Orsholits (the University of Tokyo) and Zhou Li, Kritika Dhupar, Yusuke Obuchi, Chengzhe Zhu, Yusuke Komata, and Shuta Takagi (University of Tokyo) Biographies BiographiesAlex Orsholits  Holder of a Bachelor of Science from the EPFL (Switzerland), and a Master of Engineering from UTokyo, Alex Orsholits is currently a PhD candidate of Obuchi Lab at the University of
Tokyo. His work focuses on implementing new and upcoming technologies to establish functional processes of interfacing innate human perception with computer-based mathematical representations of space within the context of architecture and digital fabrication
Zhou Li  Zhou Li is a Ph.D. student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, Obuchi Laboratory. Prior to the University of Tokyo, he studied architecture at Cornell University and at the University of Southern California, where he acquired his Bachelor of Architecture Degree with honors. He has also worked in the Beijing Institute of Architectural Design and Liang Architecture Bureau+ in Los Angeles.
His work is often centered around sustainability, digital fabrication, and computational design, and ranges from kinetic sculptures to animatronics to architectural and urban design. His work has been awarded numerous honors such as the Director’s Choice Award of the RESIDE Mumbai Mixed Housing International Open Ideas Competition, First Place in the Cornell York Prize Competition, and was selected to be exhibited and collected at the Los Angeles A+D Museum.
Kritika Dhupar  Kritika graduated from the Chandigarh College of Architecture with the Pierre Jeanneret Gold medal for her undergraduate thesis. Her early interests in adaptive reuse and contextual/experiential urban interventions radically expanded with the experience gained from interning in Vienna and later working at prominent practices in New Delhi for five years. She is currently pursuing her masters at the University of Tokyo Obuchi lab, to explore advanced/alternative means of design and production and potential ways to deploy them in the unique constraints and architectural/urban traditions which she hails from.
Yusuke Obuchi  Yusuke Obuchi is an Associate Professor in Architecture at the University of Tokyo, where he has directed Obuchi Laboratory at the Department of Architecture since 2010. He is also a founding Co-director of the Advanced Design Studies Program, which consists of Digital Fabrication Lab, Sustainable Prototyping Lab, Media Initiative Lab, Design Think Tank, Design Practice Lab, Social Design Lab, and Computational Unit. Prof. Obuchi was Co-Director of the Design Research Laboratory at the Architectural Association (AA) in London from 2005 to 2010, and Course Master and Unit Master of the Architectural Association from 2003 to 2005. He studied architecture at Princeton University, Southern California Institute of Architecture, the University of Toronto, and received his Ph.D from the University of Tokyo. He has previously taught at Princeton University, Harvard University’s Graduate School of Design, University of Kentucky, and New Jersey Institute of Technology.
Chengzhe Zhu  Chengzhe Zhu is a Master student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, and a member of Obuchi Lab. He received a Master of Science in Design from the University of Pennsylvania and a Bachelor of Architecture from Tongji University. He participated in several urban regeneration projects during his internship at TJAD Original Design Studio. His academic works centered digital design, analysis and fabrication methods and he is currently exploring novel implementations of digital tools in the process of design and production to make architecture more inclusive and adaptable.
Yusuke Komata  Yusuke Komata is an architect and a researcher based in Tokyo. He graduated from University of Tsukuba Master’s Program in Art & Design, and started working from 2009 at an architects office Arata Isozaki & Associates established by Arata Isozaki, winner of the 2019 Pritzker Prize. Komata has led many projects such as university campus designs in Central Asia and Egypt, an art museum design in Russia, a movable pneumatic concert hall, and so on. After 7 years of working in Arata Isozaki’s office, he founded his own firm called Yusuke Komata New Building Office in 2016 and started designing various projects in many different regions, with in collaboration with many architects and engineers. In 2019, he joined Department of Architecture at University of Tokyo as a researcher in Obuchi Laboratory, and started working for research projects including the UAE pavilion at Venice Biennale 2021.
Shuta Takagi  Commencing his studies at the Tokyo University of Science in 2004, Shuta Takagi developed his skills as an architect and programmer until 2011, and in 2016 founded his firm Takagi Shuta Office LLC. He also works since 2016 as an academic specialist at the University of Tokyo Obuchi Laboratory and provides several lectures on digital design throughout Japan, such as the University of Tokyo, Tokyo University of Science, Kogakuin University, Nagaoka University of Art and Design, Hokkaido University, and Tama Art University.
Abstract AbstractGoldfish Architecture is a digitally augmented and functional vernacular construction that harnesses the therapeutic effects of plants and aqueous pets to propose a future for mindful and sustainable living. The pavilion serves as a prototype for a productive and captivating smart aquaponic appliance that brings together individuals and communities alike. 10am: Aurora Australis Ultimo Choro John McCormick (Wild System, Swinburne University of Technology); Adam Nash (Wild System); and Stephen Jeal and Kim Vincs (Swinburne University of Technology) Biographies BiographiesJohn McCormick  John McCormick is a technology based artist with a major interest in movement. John has collaborated on works worldwide, including at International Symposium of Electronic Art (ISEA), ZERO1SJ, SIGGRAPH, Melbourne Festival, Venice Biennale, Siggraph Asia, Ars Electronica Futurelab, Tokyo International Forum and Art Science Museum Singapore. John’s current artistic work explores human robot interaction mediated by mixed reality environments. John was an Australian Antarctic Research Fellow in 2020 supported by the Australian Antarctic Division and Australian Network for Art and Technology. John was lucky enough to travel on the last Australian Antarctic voyage of the research vessel Aurora Australis to the Antarctic continent. John is currently a lecturer and researcher in the Centre for Transformative Media Technologies at Swinburne University of Technology where he investigates artistic practice in mixed reality environments, robotics, artificial intelligence and human action.
Adam Nash  Adam Nash is a digital artist, composer, programmer, performer, teacher and writer. He is widely recognized as one of the most original artists working in virtual environments and mixed-reality technology, exploring them as sites of playable art. Working in a post-convergent idiom, he uses the web, game engines, virtual environments, generative and procedural programming, data and motion capture, artificial intelligence, synthetic evolution, audio, vision and live performance.
His work has been presented in galleries, festivals and online in Australia, Europe, Asia and The Americas, including SIGGRAPH, ISEA, 01SJ, the Venice Biennale, the National Gallery of Victoria and the National Portrait Gallery of Australia. He has been artist in residence at Ars Electronica FutureLab and was shortlisted for the National Art Award in New Media at the Queensland Gallery of Modern Art.
Stephen Jeal  Stephen Jeal is a technical artist and teacher, specializing in 3D modelling, motion capture and visual effects for both film and games. Stephen has a knack for problem-solving and an eye for artistic and technical detail which he applies to all his projects.
Kim Vincs  Kim Vincs is a leading researcher in the creative arts, with collaborations across motion capture, game development, robotics, haptics, app design, 3D stereoscopy, artificial intelligence, virtual reality, augmented reality, cognitive psychology, biomechanics, mathematics, architecture and exercise science.
She has commercial motion capture credits including the Cannes Silver Lion winning Nocturnal Migration. Kim integrates scientific, technological and artistic methodologies to deliver innovative research to digital and performing arts industries, companies and communities. Her work spans creative technology for performance, digital scenography, VR, AR and robotics applications for motion capture technology. Recent works include The Crack Up, premiered at the Merlyn Theatre, Coopers Malthouse; Multiverse, with Garry Stewart and Australian Dance Theatre and 3D digital scenography for Victorian Opera’s production The Flying Dutchman and Four Saints in Three Acts, 2016. Her works have been shortlisted for Greenroom, Australian Dance and AEAF awards. The Flying Dutchman was a finalist in Unity’s 2015 Unite.
Abstract AbstractAurora Australis Ultimo Choro depicts the final Australian voyage of the RSV Aurora Australis to the Antarctic continent. An immersive visual and sonic feast of three-dimensional VR environments and spatial sound visualising and sonifying the last grand Antarctic dance of the Aurora Australis, crew and expeditioners. 10am: From our deceased bodies flowers will grow, we are in them and that is eternity. Wade Marynowsky (University of Technology Sydney) Biography BiographyWade Marynowsky  Dr Wade Marynowsky is an artist, academic and researcher working across digital media, including robotics, immersive and interactive performance / installation, music and video.
His main body of research explores the notion of robotic performance agency by challenging traditional notions of classical spectatorship and performance. Through the use of humour, irony and a host of unnerving thematics he addresses important issues relevant to our ever increasing technological society.
Dr Marynowsky has exhibited nationally and internationally since 1998, with his work being presented in major festivals, biennales and survey exhibitions around the world. He is also a lecturer in Interactive Design, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney.
Abstract AbstractThe artist has purposely input photography of local flowers into the Portrait AI engine, forcing it to find faces where there are none. The sequence flows from machine abstraction to the representation of faces, confusing the threshold of anthropomorphism, human's innate tendency to see faces in the world around us. 10am: SeoulVibe Taeil Lee (Korea University) Biography BiographyTaeil Lee  He studied Industrial Design at KAIST in Daejon, Korea, and Institute of Design, Illinois Institute of Tech in 90's. He has been teaching mainly Industrial Design and Interaction Design for 20+ years in Universities, and working in various projects mostly on UX Design and interactive design applications. He has been interested in Open Source Development tools and environment such as Processing and Arduino along the path, and recently trying to extend the course of interest more towards artistic representation of artifacts.
Abstract AbstractSeoulVibe is an effort to literally feel the city of Seoul. The jacket with over 45 individual units that can sense sounds and convert to vibrations and lights. We experienced various streets of Seoul through the unique sounds they produce and form the city of Seoul. 10am: Volume II of Voids shaoyu su (University of Southern California) and Weidi Zhang (university of california, santa barbara)   Biographies Biographiesshaoyu su  Shaoyu Su is a new media artist, cinematographer, and curator. His artistic practices and research employ interdisciplinary methodologies from computer graphics, photography, physics, and literature, investigating concepts about deep space-time-mining: alternative projection from ancient history to the far future. His works have been shown internationally, at venues such as J.Paul Getty Museum, International Symposium on Electronic Art(ISEA), IEEE PacificVis, Today Art Museum Beijing, and Vortex Immersion Dome L.A.
Weidi Zhang  Weidi Zhang is an LA-based new media artist, visual designer, and researcher. Her current research and media art practices investigate the possibilities of semantic meanings and non-linear narrativity of assemblage art in the context of Intelligence system design, immersive media, and interactive generative art. Her works are featured at different international venues, such as the SIGGRAPH, SIGGRAPH ASIA, ISEA, Times Art Museum, IEEE VISAP, SwissNex Gallery, Japan Media Art Festival, and shortlisted in Lumen Prize. Currently, she is a Ph.D. candidate in the Media Arts and Technology Program and a researcher in Experimental Visualization Lab. She holds her MFA degree in Art + Technology at California Institute of the Arts.
Abstract AbstractVolume II of Voids is an intelligent interactive art experience that is generated based on the voids between humans. The project is realized by using volumetric capturing, real-time visualization, and machine learning algorithms. 10am: 在别处/ Escaping to another Biin Shen (Independent Artist)  Biography BiographyBiin Shen  Shen is an artist whose practice circulates between art, design, technology and social issues. She received her MA in design interactions , following her time with Professor Dunne & Raby at the Royal College of Art in London. In 2013, she was featured as the guest speaker for LondonDesignWeek to represent young Chinese creators. Her work has been exhibited in events/institutions worldwide, including European Alternatives, SALON(NL),TOKYO GALLERY+BTAP, Shanghai Expo, Beijing World Art Museum and more. In 2020, she was selected as the first and only media artist to represent China in the UNESCO Creative City project. Since 2012, she has used her creative practice to participate in debates about issues that are of increasing urgency today. Besides her installations, curation has become one of the mediums within her practice; she has also been writing for art/public media platforms to share her unique thoughts on the relationship between technology and humanity.
Abstract Abstract"Escaping to another" is a live stream installation created during the epidemic. Consists of a hanging screen in a dark space, that continuously shows Skies from different cities in real time, thus composing a mixed reality landscape between machine and the human imagination. 10am: Strands of Mind Adrian Meyer (Filmakademie Baden-Württemberg) Biography BiographyAdrian Meyer  Adrian Meyer is a multidisciplinary Digital Artist and Filmmaker from Germany. His work is focused on moving images to inspire, and spark emotional experiences; often using a surreal and dark visual language.
Initially working in the field of Audiovisual Installations and Stage Visuals, he also has a broad background in Visual Effects. He has worked on international motion pictures and commercials in Berlin and London.
Adrian graduated in Computer Animation & Visual Effects at Filmakademie Baden-Württemberg. His work was internationally screened at Annecy Animation Festival, Siggraph Electronic Theatre and many more, and received multiple nominations such as the Visual Effects Society Student Award and the Special Jury Prize VR at NewImages Festival Paris.
Abstract AbstractExplore a world beyond the bounds of our human perception. A world full of mystery, of beauty and darkness. Let yourself be taken on a trip into the woven nature of existence. 10am: Midair Haptic-Optic Display with Multi-Tactile Texture based on Presenting Vibration and Pressure Sensation by Ultrasound Tao Morisaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda (The University of Tokyo) Biographies BiographiesTao Morisaki  Tao Morisaki is a Ph.D. student with the Graduate School of Frontier Sciences, the University of Tokyo, since 2020. He received the M.S. degree from the Department of Complexity Science and Engineering from the University of Tokyo, Chiba, Japan, in 2020. His research interests include haptics, ultrasound mid-air haptics, and human-computer interaction. He is a member of VRSJ.
Masahiro Fujiwara  He is a project assistant professor in the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He received the BS degree in Engineering, the MS degree and the PhD degree in Information Science and Technology from the University of Tokyo, in 2010, 2012, and 2015, respectively. His research interests include information physics, haptics, non-contact sensing and application systems related to them. He is a member of IEEE.
Yasutoshi Makino  Yasutoshi Makino is an associate professor in the Department of Complexity Science and Engineering in the University of Tokyo. He received his PhD in Information Science and Technology from the Univ. of Tokyo in 2007. He worked as a researcher for two years in the Univ. of Tokyo and an assistant professor in Keio University from 2009 to 2013. From 2013 he moved to the Univ. of Tokyo as a lecture, and he is an associate professor from 2017. His research interest includes haptic interactive systems.
Hiroyuki Shinoda  Hiroyuki Shinoda is a Professor at the Graduate School of Frontier Sciences, the University of Tokyo. After receiving a Ph.D. in engineering from the University of Tokyo, he was an Associate Professor at Tokyo University of Agriculture and Technology from 1995 to 1999. He was a Visiting Scholar at UC Berkeley in 1999 and was an Associate Professor at the University of Tokyo from 2000 to 2012. His research interests include information physics, haptics, mid-air haptics, two-dimensional communication, and their application systems. He is a member of SICE, IEEJ, RSJ, JSME, VRSJ, IEEE and ACM.
Abstract AbstractIn this demonstration, we develop a midair haptic-optic display with multi-tactile texture using focused ultrasound. In this system, participants can touch aerial 3D images with a realistic texture without wearing any devices. The realistic textures are rendered by simultaneously presenting vibration and static pressure sensation using ultrasound. 10am: LIPSYNC.AI: A.I. Driven Lips and Tongue Animations Using Articulatory Phonetic Descriptors and FACS Blendshapes Jara Alvarez Masso, Alexandru Mihai Rogozea, Jan Medvesek, Saeid Mokaram, and Yijun Yu (Emotech Ltd) Biographies BiographiesJara Alvarez Masso  Jara has a background in Design and in Cognitive Systems and Interactive Media. She worked as a product designer for forward-thinking companies such as Twenty2b and Seam Technic, where she helped develop original concepts for innovative products in consumer electronics and wearable devices.
At Emotech she progressed in improving the relationship between humans and technology by working on a robotic personal assistant and later on developing supportive technologies which empower digital creations to look and act like a human being. She has done research in the speech and 3D theory for LIPSYNC.AI and is now managing the product.
Alexandru Mihai Rogozea  Alex has a background in Computer Science and Visual Effects. In the last few years he worked with 2D and 3D software companies, such as Foundry, on developing tools that help 3D artists express their skills as best as possible.
At Emotech he contributed on the various AI technologies which drive the in-house produced personal assistant, and then helped develop LIPSYNC.AI by implementing neural network architectures and developing procedural algorithms.
Jan Medvesek  Jan has a background in software and hardware development with an emphasis on research and development work. He's worked on developing algorithms for image processing, software and hardware for 3D glasses and spent time teaching. He's now co-founder of Emotech and is highly passionate about pushing the boundaries of AI in the day to day life.
Saeid Mokaram  Saeid is a machine learning scientist. Since completing his PhD at the University of Sheffield, he has commercial and academic experience of automatic speech recognition, natural language understanding. He is excited by the application of research to real-world problems and has contributed to LIPSYNC.AI at Emotech by applying his knowledge in speech technology and AI.
Yijun Yu  Yijun is an instinctive product designer who believes in the value of the users. Seeing design as a medium to turn dreams and imaginations into real life experiences, she is keen on the vision to design for the future.
At Emotech she worked on designing the user experience for a robotic personal assistant and later on contributed to LIPSYNC.AI through research and applications of articulation theory on the tongue and lips.
Abstract AbstractLIPSYNC.AI: A.I. Driven Lips and Tongue Animations Using Articulatory Phonetic Descriptors and FACS Blendshapes 10am: Integration of stereoscopic laser-based geometry into 3D video using DLP Link synchronisation Jayson Haebich, Christian Sandor, and Alvaro Cassinelli (City University of Hong Kong) Biographies BiographiesJayson Haebich  Jayson Haebich is an artist and researcher who is interested in the intersection of art, technology, and science. Using light he explores how space, light, and form interact to create immersive light installations. Currently working at the XR-Lab at City University of Hong Kong on interactive augmented reality projects that use light in new and exciting ways. previously he has presented work worldwide including at the Salisbury Cathedral, Bauhaus Dessau, Somerset House, British Film Institute, and in smaller galleries and institutions across Europe, Australia, and China.
Christian Sandor  Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong’s School of Creative Media, where he is co-directing the Extended Reality Lab (https://xr-lab.org) together with Associate Professor Alvaro Cassinelli. Since the year 2000, his foremost research interest is Augmented Reality, as he believes that it will have a profound impact on the future of mankind.
Alvaro Cassinelli  Alvaro Cassinelli was born in Montevideo (Uruguay) in 1972. In 1990 he earns both a French and Uruguayan B.Sc., and a grant to pursue his studies in France. He obtains a Graduate Engineering diploma from the Ecole Nationale Supérieure des Télécom (now Télécom ParisTech) in 1996, completing the same year a Doctoral Qualifying Degree (DEA/Master) in Physics (Laser & Matter Interaction) from the University of Paris-XI, Telecom and Ecole Polytechnique. In 2000 he receives a Ph.D degree from the University of Paris-XI Orsay.
Abstract AbstractIn this work, we demonstrate a laser-based display integrating stereoscopic vector graphics into a dynamic scene generated by a conventional 3d video projection system. These laser graphics are projected with a galvo-laser system which exhibits far greater brightness, contrast and acuity compared to pixelated projectors. 10am: GroundFlow: Multiple Flows Feedback for Enhancing Immersive Experience on the Floor in the Wet Scenes Tzu-Hua Wang, Tzu-Shan Lee, Jr-Pin Pan, Tzu-Yang Kuo, Hui-Yang Yong, and Ping-Hsuan Han (National Taipei University of Technology, Department of interaction design) Biographies BiographiesTzu-Hua Wang  Tzu-Hua Wang received his B.S. degree in Electronic Engineering from the National Taipei University of Technology in 2020. In addition, he is studying for M.S. at the Department of Interaction Design from the National Taipei University of Technology in 2021. From 2017 to 2019, he was an intern at the HTC Vive R&D Multimedia team. In 2013, he was a summer intern at Siemens ME Team and EE Team in Germany and Taipei. He has been on the faculty of Electronic Engineering and Electrical Engineering. His research interests include Human-Computer Interaction(HCI), Virtual Reality, and Multisensory Technology.
Tzu-Shan Lee  Lee, Tzu-Shan received her BA. in Interaction Design at the National Taipei University of Technology. Has 1 year of experience in visual and UI design and be in participated in websites and apps development projects. Her current research interests include Human-Computer Interaction (HCI), Virtual Reality (VR), and User Interface Design.
Jr-Pin Pan  Jr-Pin Pan received her BA. in Interaction Design at the National Taipei University of Technology. Her current research is Structural design and Material processing applications.
Tzu-Yang Kuo  Tzu-Yang Kuo received his BA. in Interaction Design at the National Taipei University of Technology. His current research interests include Game Development, Modeling, and Virtual Reality (VR), and he also gets exposure to 3D Printing and Laser cutting.
Hui-Yang Yong  Hui-Yang Yong majors in Interaction Design at the National Taipei University of Technology. She works at the furniture design company as an intern. Her current research interests include Virtual Reality (VR), Computer Generated Imagery (CGI), and Motion graphics design.
Ping-Hsuan Han  Ping-Hsuan Han received his Ph.D. at the Graduate Institute of Networking and Multimedia at National Taiwan University, M.S. from Master Program in Toy and Game Design, and B.S. from the Department of Digital Technology Design all at National Taipei University of Education. He is an Assitant Professor in the Department of Interaction Design at the National Taipei University of Technology. His current research interests include Human-Computer Interaction (HCI), Virtual Reality (VR), Mixed Reality (MR), and Multisensory Technology, and he also focuses on Creativity in Engineering Education.
Abstract AbstractWe present GroundFlow, a water recirculation system that provides multiple flows feedback on the floor in immersive virtual reality. Our demonstration also implemented a virtual excursion that allows users to experience different water flows and their corresponding wet scenes. 10am: Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances Yan He, George Chernyshov, Dingding Zheng, Jiawen Han, Ragnar Thomsen, Danny Hynds, Yuehui Yang, Yun Suen Pai, Kai Kunze, and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesYan He  Background in Digital Media Technology and Art.
Graduated from Keio University of Media Design Graduate School.
Interested in media art, interaction design.
George Chernyshov  Postdoc at grad shool of Media Design, Keio University, Japan.
Dingding Zheng  PhD. student at Keio University Graduate school of Media Design
Jiawen Han  PhD. student at Keio University Graduate school of Media Design
Ragnar Thomsen  Experienced game designer and researcher. Currently PhD student at Keio University Graduate School of Media Design.
Danny Hynds  Danny Hynds is a composer, creative technologist, and visual artist from the US. His work explores the ways in which sound can be used as an emotional and affective tool in responsive public artworks. He also produces electronic music as Spectral Violet.
Yuehui Yang  Institution: Keio University Graduate School of Media Design
Yuehui Yang is a versatile composer and multi-instrumentalist in concert, film and electronic media. Focusing on film scoring and music interaction, Yuehui had collaborated with many talented young filmmakers, animators and designers.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design. He obtained his Bachelors Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand. His research interest is the effects of VR/AR/MR towards human behavior, perception and learning using physiological signals and artificial intelligence.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractFrisson is a mental experience of body reactions such as shivers, tingling skin, and goosebumps. However, this sensation is not shareable with others and is rarely used in live performances. We propose Frisson Waves, a real-time system to detect, trigger and share frisson in a wave-like pattern during music performances. 10am: Real-time Image-based Virtual Try-on with Measurement Garment Toby Chong, I-Chao Shen, Yinfei Qian, Nobuyuki Umetani, and Takeo Igarashi (University of Tokyo) Biographies BiographiesToby Chong  PhD student at The University of Tokyo
I-Chao Shen  Postdoc at The University of Tokyo
Yinfei Qian  Master student at The University of Tokyo
Nobuyuki Umetani  Associate professor at The University of Tokyo
Takeo Igarashi  Professor at The University of Tokyo
Abstract AbstractWe propose a robust real-time Image-based virtual try-on system. We formulate the problem as a supervised image-to-image translation problem using a measurement garment, and we capture the training data with a custom actuated mannequin. The user only needs to wear a measurement garment to try on many different target garments. 10am: Self-Shape-Sensing Device with Flexible Mechanical Axes for Deformable Input Interface Hideki Mori, Yoshihisa Takahashi, Koichi Shiono, Hirofumi Kaneko, Hiroya Matsugami, and Masaomi Nishidate (Sony Interactive Entertainment Inc.) Biographies BiographiesHideki Mori  Hideki Mori is a senior UX researcher at Sony Interactive Entertainment. He is responsible for R&D of new UX/UI for games and interactive media since 2016.
He also has experience as a researcher of signal processing algorithms and a product planner in charge of entire UX.
Based on his expertise both in business and technology fields, now he has a passion for developing new UX based on unique technology.
2016–current Senior Researcher, UX/UI. Sony Interactive Entertainment
2008–2016 Product Planner/Manager, New category and home entertainment products. Sony Corporation
2002–2008 Researcher, Video signal processing by machine learning. Sony Corporation
Yoshihisa Takahashi  Yoshihisa Takahashi is a software engineer working for the Future Technology Group at Sony Interactive Entertainment Inc.
His research interests include 3D interaction, physical computing and tangible UI.
Koichi Shiono  Senior Researcher (Hardware/Image Sensor), Sony Interactive Entertainment
Hirofumi Kaneko  Hirofumi Kaneko is a researcher and software engineer of Sony Interactive Entertainment, and currently working on developing an interactive device system. He obtained a master's degree in engineering from Tokyo Metropolitan University in 2019. His research interests in master's course included the development of electrical haptic displays, virtual reality and ultra reality.
Hiroya Matsugami  Hiroya Matsugami is a software engineer at Sony Interactive Entertainment.
He has been developing video games at SCE and SIE since 2000.
Masaomi Nishidate  2020-current Artist/Director of R&D team: Sony Interactive Entertainment
1999-2020 Artist/Technical Solution Section Manager: Sony Interactive Entertainment WorldWide Studios Japan Studio
Abstract AbstractA novel device that is capable of sensing its own shape, structured around a flexible mechanical axis that allows for its deformation within a wider degree of freedom and enables its tangible control by hand. Users can interact with volumetric images on spatial display intuitively by changing device shape. 10am: Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display Jun Momose, Yuta Koda, Hideki Mori, Morio Kakiuchi, Kotaro Imamura, and Makoto Wakabayashi (Sony Interactive Entertainment) Biographies BiographiesJun Momose  Jun Momose worked as electrical engineer at Sony Corporation and Sony Interactive Entertainment from 1992 to design handheld game console and portable audio player. Now he has been engaged in Project Leader in research and development division.
Yuta Koda  Yuta Koda worked as a mechanical engineer at Sony Corporation and Sony Mobile Communications from 2007-2016 to design and manufacture digital cameras and smart phones. After moving to Sony Interactive Entertainment in 2016, he has been mainly engaged in the development of actuators for user interfaces and study of haptics technology.
Hideki Mori  Hideki Mori is a senior UX researcher at Sony Interactive Entertainment. He is responsible for R&D of new UX/UI for games and interactive media since 2016.
He also has experience as a researcher of signal processing algorithms and a product planner in charge of entire UX.
Based on his expertise both in business and technology fields, now he has a passion for developing new UX based on unique technology.
2016–Current Senior Researcher, UX/UI. Sony Interactive Entertainment
2008–2016 Product Planner/Manager, New category and home entertainment products. Sony Corporation
2002–2008 Researcher, Video signal processing by machine learning. Sony Corporation
Morio Kakiuchi  Morio Kakiuchi
Sony Interactive Entertainment Inc., Tokyo
Electrical engineer in Research and Development division for game entertainment.
Kotaro Imamura  Kotaro Imamura
Sony Interactive Entertainment
Software Engineer
Makoto Wakabayashi  Makoto Wakabayashi
1997-2021 Sony Interactive Entertainment World Wide Studio Japan Studio
Develop of game titles
2021-present Sony Interactive Entertainment UXRD Tokyo
Research of Future Input
Abstract AbstractPen shaped interface capable of providing the following multimodal feedbacks from virtual object (1) Linear feedback to express contact pressure
(2) Rotational feedback to simulate friction of rubbing virtual surface
(3) Vibrotactile feedback
(4) Auditory feedback to express contact information
MR interaction system with pen shaped interface and Spatial Display. 10am: Collaborative Avatar Platform for Collecting Human Expertise Takayoshi Hagiwara (Keio University Graduate School of Media Design); Takumi Katagiri, Hikari Yukawa, Itsuki Ogura, Ryohei Tanada, Takumi Nishimura, and Yoshihiro Tanaka (Nagoya Institute of Technology); and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesTakayoshi Hagiwara  Graduated from the Department of Electrical & Electronices Engineering, National Institute of Technology, Numazu College in 2017. Graduated from the Department of Computer Science and Engineering, Toyohashi University of Technology in 2019 and received master degree in Engineering in 2021.
Entered Graduate School of Media Design, Keio University in the same year.
Research Assistant, Cybernetic being Project, JST Moonshot R&D Program.
Takumi Katagiri  Takumi Katagiri received the BS degree in Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan, in 2020. Currently, he is a master student in the same university. His research interests include body integration through a robotic avatar by multiple people. To achieve sensory and motor control in body fusion, he is investigating the presentation of the operator's movement information by sharing the sense of touch.
Hikari Yukawa  Hikari Yukawa received the Ph.D. (Human Centered Engineering) degree from Nara Women’s University, Japan, in 2021. Currently, she is working at the Nagoya Institute of Technology, Japan, as a project based assistant professor of JST Moonshot R&D program. Her research interests include haptic and olfactory perception, illusion of bodily sensation, and human-human cooperation shared with sensations.
Itsuki Ogura  Itsuki Ogura is an undergraduate student of Creative Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include cooperation between human-human/robot that share the sense of touch with each other. Currently, he is working on division of the avatar robot's operation and improving the camera for working smoothly of avatar robot.
Ryohei Tanada  Ryohei Tanada is an undergraduate student of Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include body fusion via avatar robots. He is investigating the effect of sensory sharing on workability and body awareness during body fusion by feeding back the motion information of others and tactile information from the robot.
Takumi Nishimura  Takumi Nishimura is an undergraduate student of Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include body fusion by sharing a robot avatar with multiple people. To achieve sensory and motion control in body fusion, he is investigating a method to present each other's haptic and motion information as vibration between operators.
Yoshihiro Tanaka  Yoshihiro TANAKA, received his Ph.D. (Eng.) from Tohoku University in 2006. He was a Research Fellow of the Japan Society for the Promotion of Science in 2005. In 2006, he was a Research Associate with Nagoya Institute of Technology and is working as a Professor since 2021. He was a Visiting Researcher at Utrecht University (2011) and a PRESTO Researcher of the Japan Science and Technology Agency (2014-2018). His research interests include haptic perception, tactile interfaces, tactile design, and human-human/robot cooperation with shared haptic perception. He also serves as an Associate Editor of the IEEE Transactions on Haptics from 2020.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractWe present a system that mixes two people into one robot arm and collaborates together.
There are two ways of control (division of roles and mixing in adjustable ratio), and we found that it allows us to perform movements that are impossible by alone and stabilizes the movement. 10am: Simultaneous Augmentation of Textures and Deformation Based on Dynamic Projection Mapping Leo Miyashita, Kentaro Fukamizu, and Masatoshi Ishikawa (The University of Tokyo) Biographies BiographiesLeo Miyashita  Leo Miyashita researches how to create realistic digital visualizations that are mapped onto real-world objects. He is Research Manager of the System Vision Design Research Group at The University of Tokyo (Japan), where he also obtained his award-winning Ph.D.
Kentaro Fukamizu  Kentaro Fukamizu researches high-speed computer graphics with optical illusions. He studied at The University of Tokyo (Japan) and now works at sony.
Masatoshi Ishikawa  Masatoshi Ishikawa researches massively parallel high-speed vision, high-speed Intelligent robots, dynamic Interaction, optics in computing. He is a project professor at The University of Tokyo.
Abstract AbstractWe exploit human perception characteristics and dynamic projection mapping techniques and realize simultaneous overwriting of both textures and deformation of a real object.
With the developed 1000fps low-latency projector-camera system, we demonstrate that a plaster figure turns into a colorful and flabby object by the projection. 10am: HoloBurner: Mixed reality equipment for learning flame color reaction by using aerial imaging display Toshikazu Ohshima and Kai Nishimoto (Ritsumeikan University, College of Image Arts and Sciences) Biographies BiographiesToshikazu Ohshima  Toshikazu Ohshima is a professor at Ritsumeikan University since 2006. He received a Doctorate from University of Tsukuba, Graduate School of Engineering. Then he joined in Canon Inc. and served as a researcher for research and development of virtual reality since 1991. He worked as a senior researcher in a national project at Mixed Reality Laboratory Inc. since 1997. He served as a section chief at MR R&D section in Canon Inc. since 2001. His research interests are mixed reality technologies and its deployment in education, medical and art field.
Kai Nishimoto  Kai Nishimoto was a student at College of Image Arts and Sciences, Ritsumeikan University, where he received his B.A. in 2019. He works at Bandai Namco Entertainment, Inc. since 2019.
Abstract AbstractThe HoloBurner system is a mixed reality instrument for chemistry experiments to learn about the color reaction of flames. The system consists of a real Bunsen burner and an aerial image display that shows a holographic image of a flame at the tip of the burner. 10am: The Aromatic Garden, Exploring new ways to interactively interpret narratives combining olfaction and vision including temporal change of scents using olfactory display Saya Onai (Tokyo Institute of Technology), Nathan Cohen (The University of Arts London), and Takamichi Nakamoto (Tokyo Institute of Technology) Biographies BiographiesSaya Onai  Saya Onai received the B.E. degree and pursuing the M.E. degree in information and computer engineering with the Tokyo Institute of Technology, Tokyo, Japan.
Nathan Cohen  Nathan Cohen - Interests: Art, science, technology and well-being, olfaction, perception, interactive installation, transdisciplinary collaboration.
An artist and educator engaged in transdisciplinary research in collaboration with scientists, including olfaction, memory and visual perception, with recent collaborative projects in Japan including: Olfactory Art, Science and Well-Being Research (Tokyo Institute of Technology, WRHI Visiting Professor) and Retro-Reflective Projection interactive installation (Tachi Lab @ Tokyo University; Keio University, Visiting Researcher).
The painted constructions and installations exhibited internationally explore ambiguities in interpretation of space, including site specific artworks that challenge spatial perception in architectural environments.
Takamichi Nakamoto  Takamichi Nakamoto received his B.E. and M.E. degrees in 1982 and 1984, respectively, and his Ph.D. degree in electrical and electronic engineering from Tokyo Institute of Technology, Tokyo, Japan. He worked for Hitachi from 1984 to 1987. In 1987, he joined Tokyo Institute of Technology as a Research Associate. In 1993, he became an Associate Professor with the Department of Electrical and Electronics Engineering, Tokyo Institute of Technology. From 1996 to 1997, he was a Visiting Scientist at Pacific Northwest Laboratories, Richland, WA, USA. He is currently a Professor with Institute of Innovative Research, Tokyo Institute of Technology.
Abstract AbstractNakamoto Laboratory (Tokyo Institute of Technology) present a multi-sensory olfactory game, ‘The Aromatic Garden’, offering a unique user experience through the combination of new olfactory technology and art. Players must use their sense of smell to navigate and collect scents, presenting an engaging and challenging experience. 10am: Weighted Walking: Propeller-based On-leg Force Simulation of Walking in Fluid Materials in VR Pingchuan Ke, Shaoyu Cai, and Lantian Xu (School of Creative Media, City University of Hong Kong) and Kening Zhu (City University of Hong Kong) Biographies BiographiesPingchuan Ke  Ke Pingchuan (Patrick) is a PhD student under the supervision of Dr. Kening Zhu at School of Creative Media, City University of Hong Kong. His current projects focus on Virtual and Augmented Reality(VR/AR), User Interface(UI) and other areas of Human-Computer Interaction (HCI). At the same time, he is also interested in research areas of new media art, interaction design, game and animation design.
Shaoyu Cai  Shaoyu Cai is a PhD student under the supervision of Dr. Kening Zhu at the School of Creative Media, City University of Hong Kong. His research interest lies in the field of Human-Computer Interaction (HCI), especially for Cross-modal Learning (e.g., from vision to touch) and Multi-modal Interaction through Deep Learning methods.
Lantian Xu  Lantian Xu (Alston) is currently a first year Ph.D. student under the supervision of Dr. Alvaro Cassinelli and Dr. Kening Zhu at School of Creative Media, City University of Hong Kong where he also obtained his BSc degree in 2020. His current research focuses on remote collaboration and sense of presence in mixed reality.
Kening Zhu  Kening Zhu is an Associate Professor at the School of Creative Media, and jointly appointed by the Department of Computer Science, City University of Hong Kong. He leads the Multimodal and Embodied Interaction Lab (MEI Lab). He received his PhD degree from the National University of Singapore, and his bachelor degree on Computer Science from Huazhong University of Science and Technology, China.
Abstract AbstractWeighted Walking is a wearable device with ducted fans on the user's calf. The fans can generate powerful thrust to simulate the forces caused by the user's lower limbs moving in different fluid materials. It can also simulate the walking experience in different gravity conditions, such as in another planet. 10am: Parallel Ping-Pong: Demonstrating Parallel Interaction through Multiple Bodies by a Single User Kazuma Takada (Sony Computer Science Laboratories, Inc.; Meiji University); Midori Kawaguchi (Keio University Graduate School of Media Design); Yukiya Nakanishi (Sony Computer Science Laboratories, Inc.; Keio University); Akira Uehara (Sony Computer Science Laboratories, Inc.); Mark Armstrong (Sony Computer Science Laboratories, Inc.; Keio University Graduate School of Media Design); Adrien Verhulst (Sony Computer Science Laboratories, Inc.); Kouta Minamizawa (Keio University Graduate School of Media Design); and Shunichi Kasahara (Sony Computer Science Laboratories, Inc.) Biographies BiographiesKazuma Takada  Kazuma Takada is a research assistant at Sony Computer Science Laboratories, Inc. He is also a master's candidate at the Frontier Media Science Program of Meiji University. His research focuses on the elucidation of "Self" and its augmentation using computers from the perspective of Human-Computer Interaction and Embodied Cognitive Science.
Midori Kawaguchi  Midori Kawaguchi, Ph.D., researcher at the Keio University Graduate School of Media Design. Received her Ph.D. in Information and Communications Engineering from the University of Tokyo Institute of Technology in 2020. Her research focuses on human augmentation.
Yukiya Nakanishi  Yukiya Nakanishi is a graduate student at the Keio University Faculty of science and technology. His research focuses on human interaction, sensing system. He recently researches about human-robot interaction, integration and parallel embodiment. He is also a research assistant at Sony Computer Science Laboratories Inc.
Akira Uehara  Akira Uehara, Ph.D., Adjunct researcher at Sony Computer Science Laboratories, inc. Interaction designer at Sony Group Corporation. Received his Ph.D. in Engineering from the University of Tsukuba in 2020. His research focuses on interaction with autonomous system such as AI and robots utilized Cybernics that enhance, strengthen, and support physical and cognitive functions of human beings, based on the fusion of human, machine, and information systems. His research has been awarded in the academic fields of biomedical engineering and systems integration.
Mark Armstrong  Mark Armstrong is a PhD Student at the Keio University Graduate School of Media Design. A creative technologist, he has developed spatial augmentation systems that promote physical and virtual environmental coexistence through holographic projection interfaces as a member of the Embodied Media Project. His research focuses on the use of emerging technologies to achieve human multi-presence, avatarization, and parallel embodiment. Mark recently served as a research assistant at Sony Computer Science Laboratories Inc., and in his spare time, he also teaches coding, robotics, digital arts, and music production to international students aged 4-17.
Adrien Verhulst  Adrien Verhulst received a PhD in Computer Science at the École Centrale de Nantes in 2018. He then worked as a project researcher at the University of Tokyo. He is now working at Sony Computer Science Laboratories. His research interest focuses on Embodiment in Virtual Reality.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
Shunichi Kasahara  Shunichi Kasahara Ph.D. Researcher, Group leader at Sony Computer Science Laboratories, Inc. Received his Ph.D. in Interdisciplinary Information Studies from the University of Tokyo in 2017. He is leading “Superception” research: computational extension of human perception and investigation of the self in human-computer integration. The result of his research has been presented at the major international conferences in the fields of computer graphics, human-computer interaction, and media technology festivals. He also conducts interactive exhibitions and social implementation.
Abstract AbstractParallel Ping-Pong is a Parallel Interaction with multiple bodies (here 2 robots arms) controlled by a single user. To reduce the user workload when controlling multiple bodies, we added (1) an automatic view transition between the bodies' viewpoints, and (2) an autonomous body motion integrating the user motion. 10am: DroneStick: Flying Joystick as a Novel Type of Interface Evgeny Tsykunov, Aleksey Fedoseev, Ekaterina Dorzhieva, Ruslan Agishev, and Roman Ibrahimov (Skolkovo Institute of Science and Technology); Derek Vasquez (Brigham Young University); and Luiza Labazanova and Dzmitry Tsetserukou (Skolkovo Institute of Science and Technology) Biographies BiographiesEvgeny Tsykunov  Evgeny Tsykunov received the Ph.D. degree in Engineering Systems from the Skolkovo Institute of Science and Technology, Moscow, Russian Federation, in 2021. His research interests include swarm of drones, haptics, and computer vision.
Aleksey Fedoseev  Aleksey Fedoseev received the M.Sс. degree in Space and Engineering Systems from Skolkovo Institute of Science and Technology, Moscow, Russia, in 2020. In addition, he completed a personnel exchange Monodukuri Engineer Human Resource Program in Kindai University, Japan. He is currently working towards the Ph.D. degree in the Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology. His research interests include human-robot interaction and haptic devices.
Ekaterina Dorzhieva  Ekaterina Dorzhieva is currently a MS student in the Department of Space and Engineering Systems, Skolkovo Institute of Science and Technology (Skoltech). She received the Bachelor Degree in Automation Engineering from the Bauman Moscow State Technical University in 2020. Ekaterina's research interests include robotics, haptics, and swarm of drones.
Ruslan Agishev  Ruslan Agishev is currently a researcher at Czech Technical University in Prague. He received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2020. His research interests include drone control, mobile robotics, path planning, and collision avoidance.
Roman Ibrahimov  Roman Ibrahimov is currently a PhD student at Purdue University. He received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2020. His research interests include multi-agent systems, flying robots, and Machine Learning.
Derek Vasquez  Derek Vasquez is a Ph.D. student in mechanical engineering at Florida State University in Tallahassee, Florida. He received a B.S. (2020) in mechanical engineering from Brigham Young University. Derek is interested in robotics, control, and biologically inspired design, and he is currently researching mode transitions for multi-modal legged robots.
Luiza Labazanova  Luiza Labazanova is currently a PhD student at Hong Kong Polytechnic University. She received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2019. Her research interest includes swarm of drones, soft robotics, and haptics.
Dzmitry Tsetserukou  Dzmitry Tsetserukou received the Ph.D. degree in Information Science and Technology from the University of Tokyo, Japan, in 2007. From 2007 to 2009, he was a JSPS Post-Doctoral Fellow at the University of Tokyo. He worked as Assistant Professor at the Electronics-Inspired Interdisciplinary Research Institute, Toyohashi University of Technology from 2010 to 2014.
He is currently working as Associate Professor at Skoltech. He received such prestigious Awards as Best Demonstration Award (Honorable Mentions, ACM SIGGRAPH Asia 2019), Best Demonstration Award (Bronze Prize AsiaHaptics 2018), Laval Virtual Awards (ACM SIGGRAPH 2016), and a Best Paper Award (ACM Augmented Human 2010).
Abstract AbstractDroneStick is a novel hands-free method for smooth interaction between a human and a robotic system via one of its agents. A flying joystick (DroneStick) being a part of a multi-robot system is composed of a flying drone and coiled wire with a vibration motor. 10am: VWind: Virtual Wind Sensation to the Ear by Cross-Modal Effects of Audio-Visual, Thermal, and Vibrotactile Stimuli Juro Hosoi, Yuki Ban, Kenichi Ito, and Shin'ichi Warisawa (The University of Tokyo) Biographies BiographiesJuro Hosoi  Juro Hosoi received his bachelor of engineering degree from the Faculty of Engineering, the University of Tokyo in 2021. He is a master course student of the Graduate School of Frontier Sciences, the University of Tokyo now. His research interest is improving a sense of presence in virtual reality by presenting feelings of various winds.
Yuki Ban  Yuki Ban received the M.S. degree and the Ph.D. degree in Information Science and Technology from the University of Tokyo, Tokyo, Japan, in 2013 and 2016, respectively. He was a researcher at Xcoo inc. research from 2016 to 2017. He is currently an Assistant Professor of Graduate School of Frontier Sciences at the University of Tokyo. His current research interests focus on modifying spatial perception using the visuo-haptic interaction.
Kenichi Ito  Kenichi Ito received a Master of Environmental Studies degree from the Graduate School of Frontier Sciences, the University of Tokyo in 2021.
He is a doctoral student of the Graduate School of Frontier Sciences, the University of Tokyo now.
His research interest is improving presence and immersion of virtual reality by presenting the feelings of wind.
Shin'ichi Warisawa  Prof. Warisawa is a professor of Department of Human and Engineered Environmental Studies at the University of Tokyo. From April of 1994 to March of 2000, he served as an Assistant Professor of Tokyo Institute of Technology, from April of 2000 has been working at the University of Tokyo. He was a visiting researcher at Massachusetts Institute of Technology from 2010 to 2011, and a visiting professor at Université Jean Monnet in 2016. His current research focuses on wearable/ambient human health monitoring. Research cores are nano/micro sensing devices fabrication and sensing information technology application for human well-being.
Abstract AbstractWe propose to present virtual wind sensation by cross-modal effects. We developed VWind, a wearable headphone-type device to give vibrotactile and thermal stimuli in addition to visual scenarios and binaural sounds. We prepared the demonstrations as if users were blown to the ear or exposed to freezing winds. 10am: Depth-Aware Dynamic Projection Mapping using High-speed RGB and IR Projectors Sora Hisaichi (Tokyo Institute of Technology); Kiwamu Sumino, Kunihiro Ueda, Hidenori Kasebe, Tohru Yamashita, and Takeshi Yuasa (Tokyo Electron Device); Uwe Lippmann (Fraunhofer Institute for Applied Optics and Precision Engineering); Petra Aswendt and Roland Höfling (Vialux GmbH); and Yoshihiro Watanabe (Tokyo Institute of Technology) Biographies BiographiesSora Hisaichi  Sora Hisaichi is a Master student at Tokyo Institute of Technology. He received his Bachelor’s degree from the same university in 2020. He is interested in the research fields of augmented reality.
Kiwamu Sumino  He works at Tokyo Electron Device.
Kunihiro Ueda  He works at Tokyo Electron Device.
Hidenori Kasebe  He works at Tokyo Electron Device.
Tohru Yamashita  He works at Tokyo Electron Device.
Takeshi Yuasa  He works at Tokyo Electron Device.
Uwe Lippmann  He works at Fraunhofer Institute for Applied Optics and Precision Engineering.
Petra Aswendt  She works at Vialux GmbH.
Roland Höfling  He works at Vialux GmbH.
Yoshihiro Watanabe  Yoshihiro Watanabe is an Associate Professor at Tokyo Institute of Technology. He received his Ph.D. degree from University of Tokyo in 2007. He is the leader of the Latent Sense Lab, a research group exploring the possibilities to invoke a new sense of reality based on the advanced technology centering on visual sensing. His group invents a new type of augmented reality based on dynamic projection mapping by fusing the special high-speed vision and projection technologies.
Abstract AbstractWe report a new system combining a camera, an RGB projector, and a newly developed high-speed IR projector. Moreover, we realize a 0.4-ms markerless 3D tracking by leveraging a small inter-frame motion. Based on these technologies, we demonstrate flexible, depth-aware dynamic projection mapping on the entire scene with 8-ms latency. 10am: Recognition of Gestures over Textiles with Acoustic Signatures Pui Chung Wong and Christian Sandor (City University of Hong Kong) and Alvaro Cassinelli (School of Creative Media, City University) Biographies BiographiesPui Chung Wong  Pui Chung Wong is a researcher interested in Human-Computer Interaction (HCI) and novel input methods. He completed his PhD in Creative Media, advised by Hongbo Fu and Kening Zhu. After his studies, he became a postdoc in Alvaro Cassinelli’s Augmented Materiality Lab. His work focuses on different topics in HCI, designing, building, and evaluating novel input and interaction for wearables and mobile devices. He believes that by exploring the parameters of different interaction methods more natural interaction can be developed that will improve daily living.
Christian Sandor  Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong's School of Creative Media, where he is directing the Augmented Reality Lab. In October 2020, he was appointed Augmented Reality Evangelist at the Guangzhou Greater Bay Area Virtual Reality Research Institute. Since 2000, his foremost research interest is Augmented Reality, a`s he believes it has a profound impact on the future of mankind. He serves as editorial board member for Computers & Graphics and Transactions on Visualization and Computer Graphics and as a steering committee member for ACM Symposium Spatial User Interaction and IEEE ISMAR.
Alvaro Cassinelli  Alvaro Cassinelli (UY, IT), obtained an Engineering Degree and a PhD in Physics in France. He lead the Meta-Perception group at the Ishikawa-Oku Laboratory, University of Tokyo, specialized on interfaces to enhance human expression, expanding the vocabulary of HCI and the New Media before becoming Associate Professor and director of the Augmented Materiality lab at the School of Creative Media (HK). Awards includes a Grand Prize (9th Japan Media Art Festival), the Excellence Prize (13th Japan Media Art Festival), an Honorary Mention (Ars Electronica), the NISSAN Innovative Award (2010), Jury Grand Prize at Laval Virtual (2011) among others.
Abstract AbstractWe demonstrate a method capable of turning a textured surface into an opportunistic input interface using a machine learning model pre-trained on the acoustic signal generated while scratching different types of fabric. A single and brief audio recording then suffices to characterize both the texture and the gesture that originates. 10am: "Amazing Sketchbook the Ride": Driving a Cart in a 3DCG Scene Created from a Hand-Drawn Sketch Mayu Asakura and Shinji Mizuno (Aichi Institute of Technology) Biographies BiographiesMayu Asakura  Mayu Asakura graduated from Aichi Institute of Technology in 2020 and is master course student at Aichi Institute of Technology. Her research interests are in computer graphics and human computer interaction.
Shinji Mizuno  Shinji Mizuno is currently a professor at Faculty of Information Science, Aichi Institute of Technology. He received the Ph.D degree from Nagoya University in 1999. He was a Research Associate at Toyohashi University of Technology from 2000 to 2009. His research interests include computer graphics, image processing, virtual reality, and human computer interaction.
Abstract AbstractWe introduce an interactive content "Amazing Sketchbook the Ride", which allows users to drive an actual cart and move freely in a 3DCG scene as if they were immersed in it. The users can create the 3DCG scene for driving by themselves by drawing a sketch of the scene. Thursday 10:00am-5:00pm 東京都現代美術館(MOT) 〒135-0022 東京都江東区三好4丁目1−1 Art Gallery · Full Access, Onsite Experience, Onsite Student Access, Onsite, Japanese LanguageArt Gallery x MADD. Award によるスペシャルプログラム上映 Abstract Abstract次世代映像アワードMADD. Award 2021「超高精細8K大型映像」カテゴリー応募作品の上映会。
現代アートの殿堂で、300インチ大型スクリーンに投影された8K映像作品による全く新しい映像体験を提供。
会場:東京都現代美術館 B2F講堂
東京都江東区三好4丁目1−1
https://www.mot-art-museum.jp/
会期:2021/12/16(木)17(金)
10:00~17:00(約50分の作品を繰り返し上映)
入場:無料(入退場自由) Thursday 10:00am-6:00pm Hall E, Experience Hall (B2F, E Block) Art Gallery, Emerging Technologies, XR · Full Access, Onsite Experience, Onsite Student Access, OnsiteExperience Hall 10am: Room Tilt Stick Kousuke Motohashi, Koyo Mori, and Kenri Kodaka (Nagoya City University) Biographies BiographiesKousuke Motohashi  Motohashi Kosa is a graduate student in the Graduate School of Design and Architecture, Nagoya City University. He is interested in distorting subjective gravity using HMD technology based on the physical interaction.
Koyo Mori  Koyo Mori is a researcher in the Graduate School of Design and Architecture, Nagoya City University. He is interested in using HMD technology to induce the sensation of stretching and contracting the body.
Kenri Kodaka  Kerni Kodaka is an associate professor in the Graduate School of Design and Architecture, Nagoya City University. His special interest is distorting the body-image using natural materials or virtual-reality techniques, in the framework of cognitive psychology.
Abstract AbstractRoom Tilt Stick provides an illusory experience of tilting a room using a stick and of walking on an acutely inclined slope, accomplished by correlating the tilting velocity of a three-dimensional modeled room in HMD with the degree of force transferred to the wall or ground with a special stick. 10am: Indefinately:Indefinately Chenxin Zhang and Lesi Hu (Beihang University) Biographies BiographiesChenxin Zhang  From Beijing University of Aeronautics and Astronautics, she entered the School of New Media Art and Design in 2018 and is a fourth-year college student this year. The research direction is digital media and virtual reality, and he is the chief designer of Indefinately
Lesi Hu  From Beijing University of Aeronautics and Astronautics, she entered the School of New Media Art and Design in 2018 and is a fourth-year college student this year. The research direction is digital media and virtual reality, and he is the chief designer of Indefinately
Abstract AbstractThe work "Indefinitely" tells the epitome of the pollution of the earth and the future city. In the contemporary society, high walls have been built between people, and people living in the city are essentially replicas. 10am: Dislocation Veljko Popovic and Milivoj Popovic (Prime Render Studios)   Biographies BiographiesVeljko Popovic  Veljko Popovic (1979) graduated from the Academy of Fine Arts in Zagreb, Department of Painting, in 2003. He has worked in computer graphics since 1998 and co-founded Lemonade3d, a CG and animation studio that later became Prime Render Studios. Since 2012, he teaches animation at the Arts Academy in Split. His films have been screened and awarded at numerous film festivals worldwide. He was a jury member at several film festivals.
Filmography: Dislocation - VR (2020), Cyclists (2018), Planemo (2016), Father (2012, co-director), Dove sei, amor mio (2011), My Way (2010, co-director), She Who Measures (2008)
Milivoj Popovic  Milivoj Popovic (1979) graduated from the Arts Academy in Split, Department of Sculpting, in 2014. He is an external associate at the Arts Academy, where he teaches Digital Sculpting. He co-founded Lemonade3d, a CG and animation studio that later became Prime Render Studios, where he works as director and producer. He worked as producer and 3D artist on short animated films that received over 70 international awards, including the awards at Aspen and Annecy.
Abstract AbstractThe VR experience Dislocation takes a look at an absurd moment of disbelief and fear. It examines the internal processes that develop and offers a visual depiction of a person forced into extreme circumstances – a moment of dislocation. 10am: World of Hiroshige Alex Weight, Daniel Flood, and Dylan Neill (UTS Animal Logic Academy) Abstract AbstractStep into the beautiful paintings of the Japanese artist Utagawa Hiroshige. This immersive virtual reality experience invites the participant to interact within the atmospheric world of Hiroshige’s delicate and moving artworks. The project offers a unique way of engaging with the artist’s work and the Ukiyo-e genre of Japanese art. 10am: Meet the Deer King Jing Zhang, Guangwen Zou, and Guangzheng Zhang (Beihang University, New Media Art and Design School) Abstract Abstractthe "splash-ink" interaction mechanism which comes from Chinese traditional painting style, and its application in different scenes. 10am: Exploration of Visuo-haptic Interactions to Support Learning Leopold’s Maneuvers Process in Virtual Reality Soo Wan Chun, Jinsil Hwaryoung Seo, Caleb Kicklighter, Elizabeth Wells-Beede, Jack Greene, and Tomas Arguello (Texas A&M University) Abstract AbstractLeopold’s Maneuvers VR is a virtual reality application that enables students to experience Leopold's Maneuvers assessment process with realistic visual and haptic feedback in a highly interactive and immersive environment. 10am: “Bodyreath”: An Interactive VR Installation to Experience and Understand People with Autism Huifeng Zhang (School of New Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University)   Biographies BiographiesHuifeng Zhang  My name is Huifeng Zhang. I am a student of Beihang University, in Beijing, China, majoring in digital media art design.
In the process of learning, I have used processing and arduino to do interactive installation works, studied web design, and loved animation creation. My animation works won the first prize in the 8th National College Digital Art Design Competition, but I prefer XR creation and have done VR and AR projects. I hope to study the application of AI and VR in the future and uphold the concept of "combination of art and technology", Contribute to the research results.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract Abstract"Bodyreath" is an interactive VR installation for understanding people with autism. It is divided into two parts, the external projection and the internal VR scenarios. It helps the audience to appreciate the innocence of autistic people in different way and to understand them artistically. 10am: GIBSON: AR/VR synchronized city walking system Seiichiro Takeuchi, Yuki Homma, Kyoko Hashiguchi, and Kent Kajitani (MESON, Inc.) and Shingo Meguro (Hakuhodo DY Holdings) Abstract AbstractGIBSON is a cross-AR/VR city walking system that allows VR user in remote location and AR user in reality to walk together as if they are sharing the same space. The VR space is created with 3D city model, and the positions of users are synchronized with Visual Positioning System. 10am: “Flower and the Youth”: Virtual Narrative and Creative Methods of Oral Performance in China Intangible Cultural Heritage Yu Lu, Zixiao Liu, and Xuning Yan (School of New Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University) Biographies BiographiesYu Lu  Yu Lu is an undergraduate student studying in the School of New Media Arts & Design, Beihang University, Beijing, China. Her undergraduate major is digital media and her research direction is about interactive desigh and virtual reality.
Zixiao Liu  Liu Zixiao is an undergraduate student from Beihang University, School of Media Art and Design, majoring in digital media art and minoring the economics. Her research direction is about virtual reality.
Xuning Yan  Xuning Yan is studying for a master's degree in the School of New Media Arts & Design, Beihang University, Beijing, China, Beihang University. Her work aims to explore the interactive design and audience experience of virtual reality performances.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract AbstractBased on technology of virtual reality (VR) and gesture recognition, we create the VR performance, "Flower and the Youth". Our work provides universal design approaches to the creation of content for future intangible cultural heritage performances. 10am: Dementia Eyes: Perceiving Dementia with Augmented Reality Ximing Shen and Yun Suen Pai (Keio University Graduate School of Media Design); Dai Kiuchi, Kehan Bao, Tomomi Aoki, and Kanoko Oishi (Mediva Inc.); and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesXiming Shen  Ximing Shen is currently a research assistant at Embodied Media Project, Keio University Graduate School of Media Design.
She pursued her bachelor's degree at the University of Manchester, and master's degree at Keio University, Graduate School of Media Design. Her research interest is data science, accessibility and inclusive design, and human-computer interaction.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design.
He obtained his Bachelors Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand.
His research interest is the effects of VR/AR/MR towards human behavior, perception and learning using physiological signals and artificial intelligence.
Dai Kiuchi  Dai graduated with a Bachelor’s degree from Kyoto University, Japan and a
Master’s degree in Physiotherapy from the Robert Gordon University, UK. He has nearly 10 years of clinical experience as a physiotherapist in the UK. Since
he returned to his native Japan in 2014, he has joined Mediva Inc., a consulting
and operations company specialised in healthcare. He has been involved with
projects such as clinic management, market research and healthcare service
setting up. He has also been leading projects to introduce and implement
dementia-friendly design into public buildings, hospital wards, residential and
nursing homes.
Kehan Bao  Bao graduated from East China University of Science and Technology, China as a social worker, and a Master’s degree in Social Welfare from Japan Women's University. She also holds a MBA from Nagoya University of Commerce & Business. She has joined Mediva Inc., a consulting and operations company specialised in healthcare since 2015. She has experiences in market research, setting up and operational improvement of healthcare and elderly care services and dementia-friendly design implementation both domestically and internationally. She has a keen interest in the improvement of elderly care systems in China.
Tomomi Aoki  Tomomi graduated from the Faculty of Nursing at Kitasato University and obtained a nursing qualification. She gained clinical experiences at university hospitals and then was involved in the management of the long-term care business. she has joined Mediva Inc., a consulting and operations company specialised in healthcare since 2011. She has been involved in projects related to the operations and management of long-term care business and healthcare services.
Kanoko Oishi  Kanoko graduated from Osaka University School of Law valedictorian and holds an MBA from Harvard Business School.
She is a founder and the CEO of Mediva Inc., a consulting company specialized in healthcare and the COO of Medical Corporation Platanus, a healthcare provider arm of Mediva. She previously worked as a partner at McKinsey & Company in Japan and the US.
She has served on numerous governmental committees, and is on the boards of directors including Shiseido Japan and Santen Pharmaceutical, and a member of the Japan Advisory Board at Harvard Business School and the Management Council at Osaka University.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractDementia Eyes is a mobile AR experience simulating visual symptoms of senile dementia based on pathology and medical workers' experience with patients. The application was validated by professional medical workers in Japan, and the result advocates for the efficacy of the empathy we intended to bring to the medical workers. 10am: WizardOfVR: Emotion-Adaptive Virtual Wizard Experience Kunal Gupta and Yuewei Zhang (University of Auckland, Empathic Computing Lab); Yun Suen Pai (Keio University Graduate School of Media Design); and Mark Billinghurst (University of Auckland, Empathic Computing Lab) Biographies BiographiesKunal Gupta  Kunal Gupta is a Ph.D. candidate at the Empathic Computing Laboratory, University of Auckland, New Zealand, under the supervision of Prof. Mark Billinghurst. His research revolves around emotion recognition in VR using physiological and contextual information.
Prior to this, he worked as a UX Researcher at Google and as UX Designer at a startup in India, for a total of around 5 years of industry experience. He obtained a master's degree in HCI from HITLab NZ supervised by Prof Billinghurst. He conducted some of the first research into the use of eye-gaze to enhance remote collaboration in wearable AR systems.
Yuewei Zhang  Yuewei Zhang is an XR developer and enthusiast who has been creating commercial VR games since 2016. He is currently studying at the University of Auckland as a 2nd-year undergraduate Software Engineering student. Yuewei aims to be at the forefront of developing virtual reality applications. He enjoys experimenting with creating interactive media only possible in XR, whether that be art, games, or research, and their empathic outcome. Areas he is working on at the moment include finding novel ways of incorporating storytelling, music, and creative programming into extended reality.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design. He obtained his Bachelor's Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan, and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand. His research interest is the effects of VR/AR/MR towards human behavior, perception, and learning using physiological signals and artificial intelligence
Mark Billinghurst  Mark Billinghurst is Director of the Empathic Computing Laboratory, and Professor at the University of South Australia in Adelaide, Australia, and at the University of Auckland in Auckland, New Zealand. He earned a PhD in 2002 from the University of Washington and conducts research on how virtual and real worlds can be merged, publishing over 600 papers on Augmented Reality, Virtual Reality, Empathic Computing, and related topics. In 2013 he was elected as a Fellow of the Royal Society of New Zealand, and in 2019 was given the ISMAR Career Impact Award for lifetime contribution to AR research and commercialization.
Abstract AbstractWe demonstrate WizardOfVR, a personalized emotion-adaptive virtual reality (VR) Wizard akin to the Harry Potter experience, highlighting a use-case scenario of a real-time biofeedback loop between the user's emotional state and adaptive VR environments (VREs) using off-the-shelf physiological sensors. 10am: Marco & Polo Go Round Benjamin Steiger Levine (Item 7) Biography BiographyBenjamin Steiger Levine  Benjamin Steiger Levine portrays experience through unexpected stories that are both touching and unsettling. This balance between charm and discomfort, humanity and visual-wonder is the heart of his work. Ben’s favorite stories come from a personal place that get expressed in unexpected visual ways.
Abstract AbstractMarco & Polo Go Round is a comedic love story with a very surreal twist. A couple confronts the difficulties in their relationship as gravity turns on its head and their world literally falls apart around them. 10am: Cyberdream: An Interactive Rave Music Visualisation in Virtual Reality Jonathan Weinel (University of Greenwich) Biography BiographyJonathan Weinel  Jon Weinel is a London based artist/researcher whose main expertise is in electronic music and computer art. In 2012 he completed his AHRC-funded PhD in Music at Keele University regarding the use of altered states of consciousness as a basis for composing electroacoustic music. His electronic music and audio-visual projects have been presented internationally, and in 2018 his book Inner Sound: Altered States of Consciousness in Electronic Music and Audio-Visual Media was published by Oxford University Press. He has held academic posts in the UK and Denmark, and currently lectures at the University of Greenwich.
Abstract AbstractCyberdream, is a prototype virtual reality application, which provides a journey through audio-visual environments based on the aesthetics of 1990s rave music. The project provides three audiovisual 'sound toys', which allow the user to interactively 'paint with sound'. 10am: A Walk Alone: A Virtual Reality Simulation Triggering Fear and Stimulating Empathy to Raise Awareness about the Dangers Women Face when Walking Alone at Night Eman Al-Zubeidi, Jinsil Hwaryoung Seo, Julia DeLaney, Dominic Nguyen, Jonathan Konderla, and Jaime Diaz (Texas A&M University) Abstract AbstractA Walk Alone is a virtual reality experience that simulates what it feels like to walk alone at night as a woman. The concept is inspired by the kidnapping and murder of Sarah Everard, a 33-year-old woman whose tragedy reignited an international conversation about women’s safety in March 2021. 10am: "Once": Multi-perspective and Interactive VR Narrative Film Zixiao Liu and Lutong Li (School of Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University) Biographies BiographiesZixiao Liu  Liu Zixiao is an undergraduate student from Beihang University, School of Media Art and Design, majoring in digital media art and minoring the economics. Her research direction is about virtual reality.
Lutong Li  My name is Lutong Li. I'm a student major in digital media in the School of New Media Art and Design of Beihang University. I'm now living in Beijing.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract Abstract“Once” is an interactive virtual reality narration film based on post-war experience, which is set after a continuous war period between two countries. Through the three innovative points, we create this VR narrative film, which tells common people's experience after the war as clues to express the trauma it brings. 10am: Virtual Whiskers: Cheek Haptic-Based Spatial Directional Guidance in a Virtual Space Fumihiko Nakamura, Adrien Verhulst, Kuniharu Sakurada, Masaaki Fukuoka, and Maki Sugimoto (Keio University) Abstract AbstractThis paper presents Virtual Whiskers, a spatial directional guidance technique using cheek haptics in a virtual space. We provide haptic stimulation on a cheek using two robot arms attached to a Head-Mounted Display. The robot arms touch a point that corresponds to directional information to present the target's directional cues. 10am: Beat Keisuke Itoh (Independent), Hiroko Fujioka (WOWOW INC.), Katsutoshi Machiba (Supership Inc.), and Tetsuya Ohashi (CinemaLeap Inc.) Biography BiographyKeisuke Itoh  VR animation director. Graduated from Tama Art University, Department of Graphic Design. After working as a graphic designer for a manufacturing company, he became a freelance CGI artist in 2012. In 2020/2021, Beat was nominated for the competition section of the 77th Venice International Film Festival and Cannes XR. In 2019, Feather was premiered at the 76th Venice International Film Festival in a Biennale College Selection as the first Japanese film in the VR category. In addition, his works have been screened at numerous film festivals, including the Berlin International Film Festival, Busan International Film Festival,Kaohsiung Film Festival, and SIGGRAPH.
Abstract Abstract“Beat” is a story elaborated from your “Heart”. Viewers experience the work with their hearts in their hands. Viewers encounter a rusted robot without a “heart” to move. Viewers can grant him a new heart by putting theirs on the robot. “Heart” becomes the key to move the story forward. 10am: X-Wing: Propeller-Based Force Feedback to Head in a Virtual Environment Koki Watanabe, Fumihiko Nakamura, Kuniharu Sakurada, Theophilus Teo, and Maki Sugimoto (Keio University) Abstract AbstractThis research introduces X-Wing, a haptic device using ducted fans attached to VR Head Mounted Display (HMD). It enables a VR user to receive force feedback based on different wind power converted into impulsive force for a unique VR experience such as virtual aerial simulation. 10am: Nachtalb: A multisensory Neurofeedback VR-Interface Paul Morat, Aaron Schwerdtfeger, and Frank Heidmann (Interaction Design Lab, Fachhochschule Potsdam) Abstract AbstractNachtalb is an immersive interface that enables brain-to-brain interaction using multisensory feedback. With the help of a BCI, brain-activity data is measured and visually, tactilely and auditorily translated in VR. This intends to create a feedback-loop that turns brain-activity from data-input into sensory output which directly influences the data-input again. 10am: Iris Yamin Xu (Bowling Green State University) Biography BiographyYamin Xu  Yamin Xu is an artist and electronics geek, working on the edge that blurs animation, coding, and electronics with an emphasis on the exploration of emerging technology and art. He strives to create and define new things, which have not been clearly perceived as art. This motivation is sustained by his rigorous art/engineering practice, which is informed by the convergence of divergent spheres of study: religion and science, privacy and surveillance, the robotic and organic. The result is an innovation - feedback to affect and expand his understanding and definition of art.
Before he earned his MFA in the United States researching computer vision, he obtained a BA in art and design. His experience includes being a VFX artist at CCTV, an instructor at Peking University, and a researcher at Argonne National Laboratory. Currently, he is an Assistant Professor in the Digital Arts program at Bowling Green State University.
Abstract AbstractAs an experiment of "bring on-screen animation closer to physical", the iris is given independent perception and temperament. By measuring physiological signals of the wearer, its mood is affected by the wearer. Depending on itself and the wearer's feeling, iris performs different responses, which affects interpersonal interactions and relationships. 10am: 在别处/ Escaping to another Biin Shen (Independent Artist)  Biography BiographyBiin Shen  Shen is an artist whose practice circulates between art, design, technology and social issues. She received her MA in design interactions , following her time with Professor Dunne & Raby at the Royal College of Art in London. In 2013, she was featured as the guest speaker for LondonDesignWeek to represent young Chinese creators. Her work has been exhibited in events/institutions worldwide, including European Alternatives, SALON(NL),TOKYO GALLERY+BTAP, Shanghai Expo, Beijing World Art Museum and more. In 2020, she was selected as the first and only media artist to represent China in the UNESCO Creative City project. Since 2012, she has used her creative practice to participate in debates about issues that are of increasing urgency today. Besides her installations, curation has become one of the mediums within her practice; she has also been writing for art/public media platforms to share her unique thoughts on the relationship between technology and humanity.
Abstract Abstract"Escaping to another" is a live stream installation created during the epidemic. Consists of a hanging screen in a dark space, that continuously shows Skies from different cities in real time, thus composing a mixed reality landscape between machine and the human imagination. 10am: Strands of Mind Adrian Meyer (Filmakademie Baden-Württemberg) Biography BiographyAdrian Meyer  Adrian Meyer is a multidisciplinary Digital Artist and Filmmaker from Germany. His work is focused on moving images to inspire, and spark emotional experiences; often using a surreal and dark visual language.
Initially working in the field of Audiovisual Installations and Stage Visuals, he also has a broad background in Visual Effects. He has worked on international motion pictures and commercials in Berlin and London.
Adrian graduated in Computer Animation & Visual Effects at Filmakademie Baden-Württemberg. His work was internationally screened at Annecy Animation Festival, Siggraph Electronic Theatre and many more, and received multiple nominations such as the Visual Effects Society Student Award and the Special Jury Prize VR at NewImages Festival Paris.
Abstract AbstractExplore a world beyond the bounds of our human perception. A world full of mystery, of beauty and darkness. Let yourself be taken on a trip into the woven nature of existence. 10am: Volume II of Voids shaoyu su (University of Southern California) and Weidi Zhang (university of california, santa barbara)   Biographies Biographiesshaoyu su  Shaoyu Su is a new media artist, cinematographer, and curator. His artistic practices and research employ interdisciplinary methodologies from computer graphics, photography, physics, and literature, investigating concepts about deep space-time-mining: alternative projection from ancient history to the far future. His works have been shown internationally, at venues such as J.Paul Getty Museum, International Symposium on Electronic Art(ISEA), IEEE PacificVis, Today Art Museum Beijing, and Vortex Immersion Dome L.A.
Weidi Zhang  Weidi Zhang is an LA-based new media artist, visual designer, and researcher. Her current research and media art practices investigate the possibilities of semantic meanings and non-linear narrativity of assemblage art in the context of Intelligence system design, immersive media, and interactive generative art. Her works are featured at different international venues, such as the SIGGRAPH, SIGGRAPH ASIA, ISEA, Times Art Museum, IEEE VISAP, SwissNex Gallery, Japan Media Art Festival, and shortlisted in Lumen Prize. Currently, she is a Ph.D. candidate in the Media Arts and Technology Program and a researcher in Experimental Visualization Lab. She holds her MFA degree in Art + Technology at California Institute of the Arts.
Abstract AbstractVolume II of Voids is an intelligent interactive art experience that is generated based on the voids between humans. The project is realized by using volumetric capturing, real-time visualization, and machine learning algorithms. 10am: Microbiospheric Engineering Kevin Blackistone (Kunstuniversität Linz) and Amir Bastan (Creative Robotics)   Biographies BiographiesKevin Blackistone  Kevin Blackistone is an intermedia artist exploring uses & impacts of technology and data. He works using backgrounds in 3d animation, video, sound design and creative coding. As a intramural research fellow with the National Institute of Health, Section of Comparative Behavioral Genomics (U.S., 2012-2014) he further developed his coding and research skills and uses this knowledge to inform his present works. He has received production awards for prior works from the Johns Hopkins Saul Zaentz Innovation Fund (Who’s Watching), Ruby’s Arts Awards (Extensions of the Self), and the Baltimore Office of Promotion and the Arts (Radiant Flux).
Kevin received his degree in Intermedia and Digital Arts from the University of Maryland Baltimore County in 2000 and is currently pursuing masters in the Interface Cultures and the Post Digital Lutherie programs at Kunstuniversität Linz.
Amir Bastan  As a new media artist with a background in fine arts and philosophy, Amir explores ways of designing narratives within robotics, computer arts and creative coding. He is a member of the vvvv community as a tutor and contributor. His expertise in 3D animations and real-time interaction design forms a variety of research, artistic and commercials projects. Amir has been working as a programmer and concept developer for artists and art-based studios realizing projects for robotics, data visualisation, generative design, computer vision and physical computing.
Currently, he is a PhD candidate and a researcher at the Creative Robotics Labor UfG–Linz, where he is designing customized and purposeful tools for real-time interaction with robots, ranges from KUKA robotic arms to Spot, the Boston Dynamics quadruple robot.
Amir is teaching “Creative Coding”– a programming course for artist and “Sequence of Meaning”– a theoretical course on analytical approach to new media arts.
Abstract AbstractA merger of micro/macro considerations of our world and the biology present upon it. Microbiospheric Engineering explores human growth using industrial robotics to portray a microbial colonies as the global surface landscapes to which we are accustomed from our own environment. 10am: Ethereal Phenomena Silvana Malaver (Keio University Graduate School of Media Design); Natalia Barragán Nieto (Universidad de los Andes); Igor Igorevich Segrovets (Tokyo Institute of Technology); Carlos Rizzi (Sabana Records); and George Chernyshov, Christopher Changmok Kim, and Kai Kunze (Keio University Graduate School of Media Design) Biographies BiographiesSilvana Malaver  Silvana Malaver is a multidisciplinary artist and Ph.D student at the Graduate School of Media Design, Keio University, Yokohama, Japan. Her research and creative process mainly focus on exploring how to produce altered states of consciousness through diverse media artworks, from poetry and essay-films to interactive installations. She Majored in Literature at Universidad de Los Andes, Bogota, Colombia, and obtained a Master in Japanese Culture at the Graduate School of Humanities and Social Sciences, Saitama University, Saitama, Japan, where she specialized in Buddhism and Media Art. At Keio Media Design she is part of the project "Geist" ("mind" or "spirit" in German) that works on augmenting human capacities by combining cognitive science, psychology, and technology.
Natalia Barragán Nieto  Natalia Barragán Nieto. 1994. Gemini. Bogota, Colombia. Languages: SP_ENG_FR. Spirituality and esoterism. Tea and bubbles. Plants. Where things come from. Electronic music. Intuitively rational. Rationally intuitive. Communications designer, aesthete.
I don’t believe in coincidences. I believe in the alignment of specific factors at a specific moment: synchronicity. I believe that life is the result of a constant decision-making process, which is done both consciously and unconsciously. It is an eternal quest in order to achieve equilibrium and equanimity. I believe in what I create, consisting of a dialog between the analog and the digital, between reality and fiction, between images, sounds and words.
Igor Igorevich Segrovets  Igor Segrovets joined the Ethereal Phenomena project in the role of programmer and was responsible for curating the installation to be engaging, seamless and aesthetically pleasing. Igor’s contribution included technically realising the vision of a gamified, live and interactive meditation experience. This is Igor’s first contribution to human-computer interaction. In the past, while dreaming of becoming a rocket scientist, Igor completed his Bachelor degrees in Aerospace Engineering and Physics from The University of Queensland in Brisbane, Australia. During this time, Igor designed projects for teams researching photo-computing at The University of Queensland and quantum-sensing at Australian National University. Currently, Igor is completing a Masters degree in Mechanical Engineering at the Tokyo Institute of Technology, Tokyo, Japan. There, Igor's project with Onishi Laboratory simulates the turbulent dynamics of wind around city trees with the aim of realising real-time micro-scale weather prediction.
Carlos Rizzi  Carlos Rizzi is an electronic music producer, performer and multi instrumentalist from Bogotá, Colombia. He studied classical composition at the Pontificia Universidad Javeriana in Bogotá and Electronic Music Production and Performance at Catalyst Berlin. His work is based on the exploration of soundscapes and sound design in conjunction with IDM inspired beats, moody sequences and extreme sample manipulation.
He has released an album (Now Here Nowhere) and two EP’s (Tank! and Vestigial).
In 2020, during the Covid-19 pandemic, he and fellow collaborator Mateo Walschburger created Sabana Records, an independent record label focused on promoting left field electronica and avant garde electronic music from Colombia and Latin America.
Carlos Rizzi is currently working as a music producer to a wide variety of projects from artists from Colombia as well as some personal projects such as a sound installation in Bogotá’s National Library, various remixes and a couple of EP’s.
George Chernyshov  George Chernyshov. Postdoctoral at the Graduate School of Media Design, Keio University, Japan.
Your ad could go here.
Christopher Changmok Kim  Christopher Kim, more commonly referred to as Chris by pretty much everyone around him for obvious reasons of convenience, received his bachelor’s degree in Technological Systems Management at Stony Brook University located in Long Island, New York. He also minored in Engineering and Technology Entrepreneurship. He worked as the student database manager and admissions officer of his alma mater for three years before starting graduate school. His main interests lie in the realm of measuring the physiological reactions of people reading works of fiction using unintrusive sensing equipment. He is also interested in working to eliminate technological alienation, and is a big advocate of modular design of technology.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Abstract Abstract“Ethereal Phenomena” is an interactive experience for the expansion of consciousness. The user meditates in front of an illustration based on Tibetan thangka art that reacts to the way they breathe. Through the breathing process, the image becomes an extension of the user’s body and a reflection of their mind. 10am: Signal Chin-Hsiang Hu, Zhao-Qing Chang, Che-Wei Hsu, Kuan-Wen Chen, and Yu-Chi Fu (Peppercorns Interactive Media Art) Biographies BiographiesChin-Hsiang Hu  artist, engineer, interactive designer. Desires to focus his artwork on the creation of new media art to examine the over-development of science and technology. Each kind of creative direction expressed a different idea and required the use of different technologies. In terms of integrating technologies, the development of interactive software played a very important role in his development. and to manage the interactive devices, augmented reality, and motion sensors. By combining different artistic forms, he built his creative skills and abilities. He continuously challenged himself to create works that form a dialogue between his personal experiences and new media art. works form the assumption that though the performing arts, interactive art, and visual art are separate disciplines, their combination can give rise to a new form of technology-based performing arts. This also includes a self dialogue that results in a clash between the inner self and external factors.
Zhao-Qing Chang  I accidentally entered the interactive industry. With each project and work as an oppartunity. I saw the laughter of my big friends and children, sa that I realized the nature of 'interaction" and also found the joy of persisting in the fiald of interaction. I like to draw closer to people's relationship through the discussion, learing, sharing and teaching of "interactive tachnolagy".
Che-Wei Hsu  Che-Wei Hsu graduated fromTaiwan University of Science and Technology,Majored in Computer Science and Information Engineering.
He is a creative technologist,interactive engineer and drummer.He focuses on making new media art projects,interdisciplinary performance ,interactive advertising and interactive experiment.He creates works to avoid the boring life and breaking the limit of being human. And tries to find possibilities about hacking senses , human behaviour and acting Chūnibyō style..etc.
Kuan-Wen Chen  Kuan Wen Chen graduated from National Chiao Tung University, Master of Science in Architecture. In college, she majored in Communications Design at Shih Chien University and mainly engaged in digital arts, interactive design, and installation arts. With regard to the style and concept of design, she prefers her projects created in programming so that the works would exhibit properties of real-time and interaction. Also, as an explorer, communicator and connector of design and computer science, Kuan Wen has dedicated herself to applying innovative technology from a designer's perspective and to employing digital tools for opening the world of design to new possibilities.
Yu-Chi Fu  Yu Chi, Fu, a Visual designer based in Taipei, Taiwan.
Recently been focusing on merging human emotions, relationships with various formats, such as 3d art, video art, digital graphics.
Education:
Bachelor of Visual Design, She-Te University, 2018
Experince
Visual Designer / Designer at Peppercorns Interactive Media art
Abstract AbstractAwaiting for light in the darkness(covid-19) is similar to searching for hope(normal life).
The artwork combined with the space, projection, laser, smoke, represent as "Cyber Sea".
The way to interact with the work can be from the data of people’s mobile phone, or the audience who walks into the artwork. 10am: Mixed Reality Ulysses (or MR Ulysses) Neill O'Dwyer, Gareth W. Young, Aljosa Smolic, and Matthew Moynihan (Trinity College, Dublin; V-SENSE) and Paul O'Hanrahan (Balloonatics Theatre Company) Biographies BiographiesNeill O'Dwyer  Neill O'Dwyer is a Senior Postdoctoral Research Fellow in V-SENSE at Trinity College Dublin (TCD). He is an adjunct lecturer of the School of Creative Arts, where he teaches Performance and Technology. He is an awardee of the prestigious Irish Research Council (IRC) Government of Ireland Research Fellowship (2017 – 2019). He is the sole author of Digital Scenography: 30 years of experimentation and innovation in performance and interactive media (2021). His research focuses on the impact of technology on artistic processes.
Gareth W. Young  Gareth W. Young is a postdoctoral research fellow on the V-SENSE project at Trinity College Dublin. His current research focuses on the evaluation of creative uses for extended-reality technology. This approach includes studying the design and use of XR technology in innovative practices, focusing on the interface between users and the XR platform. Gareth’s role is to observe and record how users interact with XR and design new methods to interact with XR in innovative and novel ways.
Aljosa Smolic  Aljosa Smolic is Professor of Creative Technologies at Trinity College Dublin. His research group V-SENSE focuses on immersive XR and deep learning for visual computing by combining computer vision, computer graphics, and media technology. He was Senior Research Scientist for Disney Research Zurich and Head of the Advanced Video Technology group. With Fraunhofer Heinrich-Hertz-Institut (HHI) Berlin, he headed a research group as Scientific Project Manager. He has published over 250 peer-reviewed papers and filed over 40 patents.
Matthew Moynihan  Matthew Moynihan is a PhD Candidate in the V-SENSE project at Trinity College Dublin. His research involves the development and refinement of Volumetric Video and Performance Capture systems. Specifically, this research aims to leverage temporal information to improve the quality and efficiency of volumetric sequences. Matthew also holds a BSc in Physics and an MEng in Electronic systems from Dublin City University (2011-2017), where both degrees had a focus on Computer Vision. Having worked on industry-focused applications prior to his PhD, Matthew hopes to continue extending his research into more creative fields.
Paul O'Hanrahan  Dr. Paul O’Hanrahan, artistic director of Balloonatics Theatre Company, is an award-winning actor and director who specialises in the in-situ performance of Irish writers, particularly James Joyce and Samuel Beckett. He is particularly interested in place and memory studies and has a doctorate combining German and Contemporary Literature Studies from the University of Liverpool. He has Edinburgh Fringe First Awards for productions based on Joyce’s Ulysses and Finnegans Wake. In 2014 he devised the inaugural Beckett Walk for Dun Laoghaire-Rathdown Council and has led this guided tour for the last eight years.
Abstract Abstract'MR Ulysses' is an innovative performance experiment hybridizing theatre and volumetric video, enabling individuals to experience a live-action re-enactment of James Joyce's 'Ulysses' in VR. Audiences are invited to don an HMD, embody the character of Stephen Dedalus, and engage Buck Mulligan in Joyce's famous Martello tower-top scene. 10am: Siren Wenqian GAO (studio Gao Wenqian, Beijing Institute of Fashion Technology (BIFT)) Biography BiographyWenqian GAO  Gao Wenqian
Bron in ShanDong, China
Education
2009-2013 Academy of fine art of China.
2015-2019 École national supérieur des beaux-arts de paris
work and live in Beijing
Abstract AbstractIn the future, is there also the program who use disillusioned human like siren in the virtual world? 10am: Aerobanquets RMX Mattia Casalegno (Aerobanquets RMX)  Biography BiographyMattia Casalegno  Mattia Casalegno is an Italian artist known for his sculptures and his immersive, relational, and participatory installations. He often deploys emerging technologies to investigate themes of phenomenology, ecology and cybernetics.
Nominated for the New Technological Art Awards in 2014 and artist-in-residence at Eyebeam in 2015, he received various grants and fellowships from, among others, NEW INC, the Center for Cultural Innovation, Young Italian Artists Network, NYFA, the Elizabeth Foundation for the Arts and the Asia Culture Center in South Korea. In 2018 he was recipient of a Lumen Prize Award.
Casalegno has exhibited in such museums and institutions as MACRO Museum and Auditorium, Italy; Mutek Festival, Canada; Kuandu Museum of Fine Arts, Taiwan; ISEA in S.Korea; Chronus Art Center, China; Cimatics festival and Nuit Blanche in Belgium; Optronica in the UK; Le Cube Museum in France; OFFF in Spain, LACMA, YAA Museum and Satellite Art Fair in the US.
Abstract AbstractAerobanquets RMX is an immersive, multi-sensorial culinary experience focused on taste perception. Aerobanquets RMX is about reframing our perceptions and changing the way we experience food. It is not only a life changing experience, but, in a sense, a tool to reprogram all our perceptive expectations. 10am: The Tides Within Us Barnaby Churchill Steel (Marshmallow Laser Feast); Kate Farrell (York Mediale, York Museums Trust); and Bianka Hofmann (Fraunhofer Institute for Digital Medicine MEVIS) Biographies BiographiesBarnaby Churchill Steel  Marshmallow Laser Feast (MLF) create immersive experiences, expanding perception and exploring our connection with the natural world. Fusing architectural tools, contemporary imaging techniques and performance with tactile forms, MLF sculpt spaces that lay dormant until animated by curiosity and exploration. Informed as much by playfulness as research, MLF break the boundaries to worlds beyond our senses.
MLF’s work has been exhibited in the UK and internationally including at the Saatchi Gallery, NXT Museum, Lisbon Triennial, Istanbul Design Biennial, the Sundance Film Festival, and the V&A and Design Museum.
Kate Farrell  York Mediale is an independent arts charity, originally founded in 2016 that works year-round to deliver new commissions, live events and artistic development
Through incorporating technologies into their work, the artists we work with bridge the gap between the new and the traditional, to challenge and inspire. We work alongside artists, building trust through our actions, not just our words, to create lasting relationships, collaborations and partnerships with those who share and champion our values.
Bianka Hofmann  Embedded in a worldwide network of clinical and academic partners, Fraunhofer MEVIS develops real-world software solutions for image and data-supported early detection, diagnosis, and therapy. Strong focus is placed on cancer and the circulatory system, brain, breast, liver, and lung diseases. The goal is to detect diseases earlier and more reliably, tailor treatments to each individual, and make therapeutic success more measurable.
The Institute is committed to raising awareness about how digital transformation influences health care by opening up its R&D and integrating the arts and humanities. The focus is on life-long learning, collaborative production, and scientifically inspired art. Laypersons and experts are invited to get involved, exchange ideas, and disseminate innovative R&D eye-to-eye with the researchers and developers.
Abstract AbstractA cross-sectoral project utilizing high-end MR research results, 'The Tides Within Us' -created by Marshmallow Laser Feast (MLF) and Fraunhofer Institute for Digital Medicine MEVIS-is an ongoing exploration into the world beyond the limits of our senses at the intersection of art, science and technology. 10am: Goldfish Architecture: Therapeutic Urban Aquaponics Alex Orsholits (the University of Tokyo) and Zhou Li, Kritika Dhupar, Yusuke Obuchi, Chengzhe Zhu, Yusuke Komata, and Shuta Takagi (University of Tokyo) Biographies BiographiesAlex Orsholits  Holder of a Bachelor of Science from the EPFL (Switzerland), and a Master of Engineering from UTokyo, Alex Orsholits is currently a PhD candidate of Obuchi Lab at the University of
Tokyo. His work focuses on implementing new and upcoming technologies to establish functional processes of interfacing innate human perception with computer-based mathematical representations of space within the context of architecture and digital fabrication
Zhou Li  Zhou Li is a Ph.D. student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, Obuchi Laboratory. Prior to the University of Tokyo, he studied architecture at Cornell University and at the University of Southern California, where he acquired his Bachelor of Architecture Degree with honors. He has also worked in the Beijing Institute of Architectural Design and Liang Architecture Bureau+ in Los Angeles.
His work is often centered around sustainability, digital fabrication, and computational design, and ranges from kinetic sculptures to animatronics to architectural and urban design. His work has been awarded numerous honors such as the Director’s Choice Award of the RESIDE Mumbai Mixed Housing International Open Ideas Competition, First Place in the Cornell York Prize Competition, and was selected to be exhibited and collected at the Los Angeles A+D Museum.
Kritika Dhupar  Kritika graduated from the Chandigarh College of Architecture with the Pierre Jeanneret Gold medal for her undergraduate thesis. Her early interests in adaptive reuse and contextual/experiential urban interventions radically expanded with the experience gained from interning in Vienna and later working at prominent practices in New Delhi for five years. She is currently pursuing her masters at the University of Tokyo Obuchi lab, to explore advanced/alternative means of design and production and potential ways to deploy them in the unique constraints and architectural/urban traditions which she hails from.
Yusuke Obuchi  Yusuke Obuchi is an Associate Professor in Architecture at the University of Tokyo, where he has directed Obuchi Laboratory at the Department of Architecture since 2010. He is also a founding Co-director of the Advanced Design Studies Program, which consists of Digital Fabrication Lab, Sustainable Prototyping Lab, Media Initiative Lab, Design Think Tank, Design Practice Lab, Social Design Lab, and Computational Unit. Prof. Obuchi was Co-Director of the Design Research Laboratory at the Architectural Association (AA) in London from 2005 to 2010, and Course Master and Unit Master of the Architectural Association from 2003 to 2005. He studied architecture at Princeton University, Southern California Institute of Architecture, the University of Toronto, and received his Ph.D from the University of Tokyo. He has previously taught at Princeton University, Harvard University’s Graduate School of Design, University of Kentucky, and New Jersey Institute of Technology.
Chengzhe Zhu  Chengzhe Zhu is a Master student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, and a member of Obuchi Lab. He received a Master of Science in Design from the University of Pennsylvania and a Bachelor of Architecture from Tongji University. He participated in several urban regeneration projects during his internship at TJAD Original Design Studio. His academic works centered digital design, analysis and fabrication methods and he is currently exploring novel implementations of digital tools in the process of design and production to make architecture more inclusive and adaptable.
Yusuke Komata  Yusuke Komata is an architect and a researcher based in Tokyo. He graduated from University of Tsukuba Master’s Program in Art & Design, and started working from 2009 at an architects office Arata Isozaki & Associates established by Arata Isozaki, winner of the 2019 Pritzker Prize. Komata has led many projects such as university campus designs in Central Asia and Egypt, an art museum design in Russia, a movable pneumatic concert hall, and so on. After 7 years of working in Arata Isozaki’s office, he founded his own firm called Yusuke Komata New Building Office in 2016 and started designing various projects in many different regions, with in collaboration with many architects and engineers. In 2019, he joined Department of Architecture at University of Tokyo as a researcher in Obuchi Laboratory, and started working for research projects including the UAE pavilion at Venice Biennale 2021.
Shuta Takagi  Commencing his studies at the Tokyo University of Science in 2004, Shuta Takagi developed his skills as an architect and programmer until 2011, and in 2016 founded his firm Takagi Shuta Office LLC. He also works since 2016 as an academic specialist at the University of Tokyo Obuchi Laboratory and provides several lectures on digital design throughout Japan, such as the University of Tokyo, Tokyo University of Science, Kogakuin University, Nagaoka University of Art and Design, Hokkaido University, and Tama Art University.
Abstract AbstractGoldfish Architecture is a digitally augmented and functional vernacular construction that harnesses the therapeutic effects of plants and aqueous pets to propose a future for mindful and sustainable living. The pavilion serves as a prototype for a productive and captivating smart aquaponic appliance that brings together individuals and communities alike. 10am: SeoulVibe Taeil Lee (Korea University) Biography BiographyTaeil Lee  He studied Industrial Design at KAIST in Daejon, Korea, and Institute of Design, Illinois Institute of Tech in 90's. He has been teaching mainly Industrial Design and Interaction Design for 20+ years in Universities, and working in various projects mostly on UX Design and interactive design applications. He has been interested in Open Source Development tools and environment such as Processing and Arduino along the path, and recently trying to extend the course of interest more towards artistic representation of artifacts.
Abstract AbstractSeoulVibe is an effort to literally feel the city of Seoul. The jacket with over 45 individual units that can sense sounds and convert to vibrations and lights. We experienced various streets of Seoul through the unique sounds they produce and form the city of Seoul. 10am: From our deceased bodies flowers will grow, we are in them and that is eternity. Wade Marynowsky (University of Technology Sydney) Biography BiographyWade Marynowsky  Dr Wade Marynowsky is an artist, academic and researcher working across digital media, including robotics, immersive and interactive performance / installation, music and video.
His main body of research explores the notion of robotic performance agency by challenging traditional notions of classical spectatorship and performance. Through the use of humour, irony and a host of unnerving thematics he addresses important issues relevant to our ever increasing technological society.
Dr Marynowsky has exhibited nationally and internationally since 1998, with his work being presented in major festivals, biennales and survey exhibitions around the world. He is also a lecturer in Interactive Design, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney.
Abstract AbstractThe artist has purposely input photography of local flowers into the Portrait AI engine, forcing it to find faces where there are none. The sequence flows from machine abstraction to the representation of faces, confusing the threshold of anthropomorphism, human's innate tendency to see faces in the world around us. 10am: Aurora Australis Ultimo Choro John McCormick (Wild System, Swinburne University of Technology); Adam Nash (Wild System); and Stephen Jeal and Kim Vincs (Swinburne University of Technology) Biographies BiographiesJohn McCormick  John McCormick is a technology based artist with a major interest in movement. John has collaborated on works worldwide, including at International Symposium of Electronic Art (ISEA), ZERO1SJ, SIGGRAPH, Melbourne Festival, Venice Biennale, Siggraph Asia, Ars Electronica Futurelab, Tokyo International Forum and Art Science Museum Singapore. John’s current artistic work explores human robot interaction mediated by mixed reality environments. John was an Australian Antarctic Research Fellow in 2020 supported by the Australian Antarctic Division and Australian Network for Art and Technology. John was lucky enough to travel on the last Australian Antarctic voyage of the research vessel Aurora Australis to the Antarctic continent. John is currently a lecturer and researcher in the Centre for Transformative Media Technologies at Swinburne University of Technology where he investigates artistic practice in mixed reality environments, robotics, artificial intelligence and human action.
Adam Nash  Adam Nash is a digital artist, composer, programmer, performer, teacher and writer. He is widely recognized as one of the most original artists working in virtual environments and mixed-reality technology, exploring them as sites of playable art. Working in a post-convergent idiom, he uses the web, game engines, virtual environments, generative and procedural programming, data and motion capture, artificial intelligence, synthetic evolution, audio, vision and live performance.
His work has been presented in galleries, festivals and online in Australia, Europe, Asia and The Americas, including SIGGRAPH, ISEA, 01SJ, the Venice Biennale, the National Gallery of Victoria and the National Portrait Gallery of Australia. He has been artist in residence at Ars Electronica FutureLab and was shortlisted for the National Art Award in New Media at the Queensland Gallery of Modern Art.
Stephen Jeal  Stephen Jeal is a technical artist and teacher, specializing in 3D modelling, motion capture and visual effects for both film and games. Stephen has a knack for problem-solving and an eye for artistic and technical detail which he applies to all his projects.
Kim Vincs  Kim Vincs is a leading researcher in the creative arts, with collaborations across motion capture, game development, robotics, haptics, app design, 3D stereoscopy, artificial intelligence, virtual reality, augmented reality, cognitive psychology, biomechanics, mathematics, architecture and exercise science.
She has commercial motion capture credits including the Cannes Silver Lion winning Nocturnal Migration. Kim integrates scientific, technological and artistic methodologies to deliver innovative research to digital and performing arts industries, companies and communities. Her work spans creative technology for performance, digital scenography, VR, AR and robotics applications for motion capture technology. Recent works include The Crack Up, premiered at the Merlyn Theatre, Coopers Malthouse; Multiverse, with Garry Stewart and Australian Dance Theatre and 3D digital scenography for Victorian Opera’s production The Flying Dutchman and Four Saints in Three Acts, 2016. Her works have been shortlisted for Greenroom, Australian Dance and AEAF awards. The Flying Dutchman was a finalist in Unity’s 2015 Unite.
Abstract AbstractAurora Australis Ultimo Choro depicts the final Australian voyage of the RSV Aurora Australis to the Antarctic continent. An immersive visual and sonic feast of three-dimensional VR environments and spatial sound visualising and sonifying the last grand Antarctic dance of the Aurora Australis, crew and expeditioners. 10am: Real-time Image-based Virtual Try-on with Measurement Garment Toby Chong, I-Chao Shen, Yinfei Qian, Nobuyuki Umetani, and Takeo Igarashi (University of Tokyo) Biographies BiographiesToby Chong  PhD student at The University of Tokyo
I-Chao Shen  Postdoc at The University of Tokyo
Yinfei Qian  Master student at The University of Tokyo
Nobuyuki Umetani  Associate professor at The University of Tokyo
Takeo Igarashi  Professor at The University of Tokyo
Abstract AbstractWe propose a robust real-time Image-based virtual try-on system. We formulate the problem as a supervised image-to-image translation problem using a measurement garment, and we capture the training data with a custom actuated mannequin. The user only needs to wear a measurement garment to try on many different target garments. 10am: Depth-Aware Dynamic Projection Mapping using High-speed RGB and IR Projectors Sora Hisaichi (Tokyo Institute of Technology); Kiwamu Sumino, Kunihiro Ueda, Hidenori Kasebe, Tohru Yamashita, and Takeshi Yuasa (Tokyo Electron Device); Uwe Lippmann (Fraunhofer Institute for Applied Optics and Precision Engineering); Petra Aswendt and Roland Höfling (Vialux GmbH); and Yoshihiro Watanabe (Tokyo Institute of Technology) Biographies BiographiesSora Hisaichi  Sora Hisaichi is a Master student at Tokyo Institute of Technology. He received his Bachelor’s degree from the same university in 2020. He is interested in the research fields of augmented reality.
Kiwamu Sumino  He works at Tokyo Electron Device.
Kunihiro Ueda  He works at Tokyo Electron Device.
Hidenori Kasebe  He works at Tokyo Electron Device.
Tohru Yamashita  He works at Tokyo Electron Device.
Takeshi Yuasa  He works at Tokyo Electron Device.
Uwe Lippmann  He works at Fraunhofer Institute for Applied Optics and Precision Engineering.
Petra Aswendt  She works at Vialux GmbH.
Roland Höfling  He works at Vialux GmbH.
Yoshihiro Watanabe  Yoshihiro Watanabe is an Associate Professor at Tokyo Institute of Technology. He received his Ph.D. degree from University of Tokyo in 2007. He is the leader of the Latent Sense Lab, a research group exploring the possibilities to invoke a new sense of reality based on the advanced technology centering on visual sensing. His group invents a new type of augmented reality based on dynamic projection mapping by fusing the special high-speed vision and projection technologies.
Abstract AbstractWe report a new system combining a camera, an RGB projector, and a newly developed high-speed IR projector. Moreover, we realize a 0.4-ms markerless 3D tracking by leveraging a small inter-frame motion. Based on these technologies, we demonstrate flexible, depth-aware dynamic projection mapping on the entire scene with 8-ms latency. 10am: Parallel Ping-Pong: Demonstrating Parallel Interaction through Multiple Bodies by a Single User Kazuma Takada (Sony Computer Science Laboratories, Inc.; Meiji University); Midori Kawaguchi (Keio University Graduate School of Media Design); Yukiya Nakanishi (Sony Computer Science Laboratories, Inc.; Keio University); Akira Uehara (Sony Computer Science Laboratories, Inc.); Mark Armstrong (Sony Computer Science Laboratories, Inc.; Keio University Graduate School of Media Design); Adrien Verhulst (Sony Computer Science Laboratories, Inc.); Kouta Minamizawa (Keio University Graduate School of Media Design); and Shunichi Kasahara (Sony Computer Science Laboratories, Inc.) Biographies BiographiesKazuma Takada  Kazuma Takada is a research assistant at Sony Computer Science Laboratories, Inc. He is also a master's candidate at the Frontier Media Science Program of Meiji University. His research focuses on the elucidation of "Self" and its augmentation using computers from the perspective of Human-Computer Interaction and Embodied Cognitive Science.
Midori Kawaguchi  Midori Kawaguchi, Ph.D., researcher at the Keio University Graduate School of Media Design. Received her Ph.D. in Information and Communications Engineering from the University of Tokyo Institute of Technology in 2020. Her research focuses on human augmentation.
Yukiya Nakanishi  Yukiya Nakanishi is a graduate student at the Keio University Faculty of science and technology. His research focuses on human interaction, sensing system. He recently researches about human-robot interaction, integration and parallel embodiment. He is also a research assistant at Sony Computer Science Laboratories Inc.
Akira Uehara  Akira Uehara, Ph.D., Adjunct researcher at Sony Computer Science Laboratories, inc. Interaction designer at Sony Group Corporation. Received his Ph.D. in Engineering from the University of Tsukuba in 2020. His research focuses on interaction with autonomous system such as AI and robots utilized Cybernics that enhance, strengthen, and support physical and cognitive functions of human beings, based on the fusion of human, machine, and information systems. His research has been awarded in the academic fields of biomedical engineering and systems integration.
Mark Armstrong  Mark Armstrong is a PhD Student at the Keio University Graduate School of Media Design. A creative technologist, he has developed spatial augmentation systems that promote physical and virtual environmental coexistence through holographic projection interfaces as a member of the Embodied Media Project. His research focuses on the use of emerging technologies to achieve human multi-presence, avatarization, and parallel embodiment. Mark recently served as a research assistant at Sony Computer Science Laboratories Inc., and in his spare time, he also teaches coding, robotics, digital arts, and music production to international students aged 4-17.
Adrien Verhulst  Adrien Verhulst received a PhD in Computer Science at the École Centrale de Nantes in 2018. He then worked as a project researcher at the University of Tokyo. He is now working at Sony Computer Science Laboratories. His research interest focuses on Embodiment in Virtual Reality.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
Shunichi Kasahara  Shunichi Kasahara Ph.D. Researcher, Group leader at Sony Computer Science Laboratories, Inc. Received his Ph.D. in Interdisciplinary Information Studies from the University of Tokyo in 2017. He is leading “Superception” research: computational extension of human perception and investigation of the self in human-computer integration. The result of his research has been presented at the major international conferences in the fields of computer graphics, human-computer interaction, and media technology festivals. He also conducts interactive exhibitions and social implementation.
Abstract AbstractParallel Ping-Pong is a Parallel Interaction with multiple bodies (here 2 robots arms) controlled by a single user. To reduce the user workload when controlling multiple bodies, we added (1) an automatic view transition between the bodies' viewpoints, and (2) an autonomous body motion integrating the user motion. 10am: The Aromatic Garden, Exploring new ways to interactively interpret narratives combining olfaction and vision including temporal change of scents using olfactory display Saya Onai (Tokyo Institute of Technology), Nathan Cohen (The University of Arts London), and Takamichi Nakamoto (Tokyo Institute of Technology) Biographies BiographiesSaya Onai  Saya Onai received the B.E. degree and pursuing the M.E. degree in information and computer engineering with the Tokyo Institute of Technology, Tokyo, Japan.
Nathan Cohen  Nathan Cohen - Interests: Art, science, technology and well-being, olfaction, perception, interactive installation, transdisciplinary collaboration.
An artist and educator engaged in transdisciplinary research in collaboration with scientists, including olfaction, memory and visual perception, with recent collaborative projects in Japan including: Olfactory Art, Science and Well-Being Research (Tokyo Institute of Technology, WRHI Visiting Professor) and Retro-Reflective Projection interactive installation (Tachi Lab @ Tokyo University; Keio University, Visiting Researcher).
The painted constructions and installations exhibited internationally explore ambiguities in interpretation of space, including site specific artworks that challenge spatial perception in architectural environments.
Takamichi Nakamoto  Takamichi Nakamoto received his B.E. and M.E. degrees in 1982 and 1984, respectively, and his Ph.D. degree in electrical and electronic engineering from Tokyo Institute of Technology, Tokyo, Japan. He worked for Hitachi from 1984 to 1987. In 1987, he joined Tokyo Institute of Technology as a Research Associate. In 1993, he became an Associate Professor with the Department of Electrical and Electronics Engineering, Tokyo Institute of Technology. From 1996 to 1997, he was a Visiting Scientist at Pacific Northwest Laboratories, Richland, WA, USA. He is currently a Professor with Institute of Innovative Research, Tokyo Institute of Technology.
Abstract AbstractNakamoto Laboratory (Tokyo Institute of Technology) present a multi-sensory olfactory game, ‘The Aromatic Garden’, offering a unique user experience through the combination of new olfactory technology and art. Players must use their sense of smell to navigate and collect scents, presenting an engaging and challenging experience. 10am: Midair Haptic-Optic Display with Multi-Tactile Texture based on Presenting Vibration and Pressure Sensation by Ultrasound Tao Morisaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda (The University of Tokyo) Biographies BiographiesTao Morisaki  Tao Morisaki is a Ph.D. student with the Graduate School of Frontier Sciences, the University of Tokyo, since 2020. He received the M.S. degree from the Department of Complexity Science and Engineering from the University of Tokyo, Chiba, Japan, in 2020. His research interests include haptics, ultrasound mid-air haptics, and human-computer interaction. He is a member of VRSJ.
Masahiro Fujiwara  He is a project assistant professor in the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He received the BS degree in Engineering, the MS degree and the PhD degree in Information Science and Technology from the University of Tokyo, in 2010, 2012, and 2015, respectively. His research interests include information physics, haptics, non-contact sensing and application systems related to them. He is a member of IEEE.
Yasutoshi Makino  Yasutoshi Makino is an associate professor in the Department of Complexity Science and Engineering in the University of Tokyo. He received his PhD in Information Science and Technology from the Univ. of Tokyo in 2007. He worked as a researcher for two years in the Univ. of Tokyo and an assistant professor in Keio University from 2009 to 2013. From 2013 he moved to the Univ. of Tokyo as a lecture, and he is an associate professor from 2017. His research interest includes haptic interactive systems.
Hiroyuki Shinoda  Hiroyuki Shinoda is a Professor at the Graduate School of Frontier Sciences, the University of Tokyo. After receiving a Ph.D. in engineering from the University of Tokyo, he was an Associate Professor at Tokyo University of Agriculture and Technology from 1995 to 1999. He was a Visiting Scholar at UC Berkeley in 1999 and was an Associate Professor at the University of Tokyo from 2000 to 2012. His research interests include information physics, haptics, mid-air haptics, two-dimensional communication, and their application systems. He is a member of SICE, IEEJ, RSJ, JSME, VRSJ, IEEE and ACM.
Abstract AbstractIn this demonstration, we develop a midair haptic-optic display with multi-tactile texture using focused ultrasound. In this system, participants can touch aerial 3D images with a realistic texture without wearing any devices. The realistic textures are rendered by simultaneously presenting vibration and static pressure sensation using ultrasound. 10am: Self-Shape-Sensing Device with Flexible Mechanical Axes for Deformable Input Interface Hideki Mori, Yoshihisa Takahashi, Koichi Shiono, Hirofumi Kaneko, Hiroya Matsugami, and Masaomi Nishidate (Sony Interactive Entertainment Inc.) Biographies BiographiesHideki Mori  Hideki Mori is a senior UX researcher at Sony Interactive Entertainment. He is responsible for R&D of new UX/UI for games and interactive media since 2016.
He also has experience as a researcher of signal processing algorithms and a product planner in charge of entire UX.
Based on his expertise both in business and technology fields, now he has a passion for developing new UX based on unique technology.
2016–current Senior Researcher, UX/UI. Sony Interactive Entertainment
2008–2016 Product Planner/Manager, New category and home entertainment products. Sony Corporation
2002–2008 Researcher, Video signal processing by machine learning. Sony Corporation
Yoshihisa Takahashi  Yoshihisa Takahashi is a software engineer working for the Future Technology Group at Sony Interactive Entertainment Inc.
His research interests include 3D interaction, physical computing and tangible UI.
Koichi Shiono  Senior Researcher (Hardware/Image Sensor), Sony Interactive Entertainment
Hirofumi Kaneko  Hirofumi Kaneko is a researcher and software engineer of Sony Interactive Entertainment, and currently working on developing an interactive device system. He obtained a master's degree in engineering from Tokyo Metropolitan University in 2019. His research interests in master's course included the development of electrical haptic displays, virtual reality and ultra reality.
Hiroya Matsugami  Hiroya Matsugami is a software engineer at Sony Interactive Entertainment.
He has been developing video games at SCE and SIE since 2000.
Masaomi Nishidate  2020-current Artist/Director of R&D team: Sony Interactive Entertainment
1999-2020 Artist/Technical Solution Section Manager: Sony Interactive Entertainment WorldWide Studios Japan Studio
Abstract AbstractA novel device that is capable of sensing its own shape, structured around a flexible mechanical axis that allows for its deformation within a wider degree of freedom and enables its tangible control by hand. Users can interact with volumetric images on spatial display intuitively by changing device shape. 10am: LIPSYNC.AI: A.I. Driven Lips and Tongue Animations Using Articulatory Phonetic Descriptors and FACS Blendshapes Jara Alvarez Masso, Alexandru Mihai Rogozea, Jan Medvesek, Saeid Mokaram, and Yijun Yu (Emotech Ltd) Biographies BiographiesJara Alvarez Masso  Jara has a background in Design and in Cognitive Systems and Interactive Media. She worked as a product designer for forward-thinking companies such as Twenty2b and Seam Technic, where she helped develop original concepts for innovative products in consumer electronics and wearable devices.
At Emotech she progressed in improving the relationship between humans and technology by working on a robotic personal assistant and later on developing supportive technologies which empower digital creations to look and act like a human being. She has done research in the speech and 3D theory for LIPSYNC.AI and is now managing the product.
Alexandru Mihai Rogozea  Alex has a background in Computer Science and Visual Effects. In the last few years he worked with 2D and 3D software companies, such as Foundry, on developing tools that help 3D artists express their skills as best as possible.
At Emotech he contributed on the various AI technologies which drive the in-house produced personal assistant, and then helped develop LIPSYNC.AI by implementing neural network architectures and developing procedural algorithms.
Jan Medvesek  Jan has a background in software and hardware development with an emphasis on research and development work. He's worked on developing algorithms for image processing, software and hardware for 3D glasses and spent time teaching. He's now co-founder of Emotech and is highly passionate about pushing the boundaries of AI in the day to day life.
Saeid Mokaram  Saeid is a machine learning scientist. Since completing his PhD at the University of Sheffield, he has commercial and academic experience of automatic speech recognition, natural language understanding. He is excited by the application of research to real-world problems and has contributed to LIPSYNC.AI at Emotech by applying his knowledge in speech technology and AI.
Yijun Yu  Yijun is an instinctive product designer who believes in the value of the users. Seeing design as a medium to turn dreams and imaginations into real life experiences, she is keen on the vision to design for the future.
At Emotech she worked on designing the user experience for a robotic personal assistant and later on contributed to LIPSYNC.AI through research and applications of articulation theory on the tongue and lips.
Abstract AbstractLIPSYNC.AI: A.I. Driven Lips and Tongue Animations Using Articulatory Phonetic Descriptors and FACS Blendshapes 10am: Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances Yan He, George Chernyshov, Dingding Zheng, Jiawen Han, Ragnar Thomsen, Danny Hynds, Yuehui Yang, Yun Suen Pai, Kai Kunze, and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesYan He  Background in Digital Media Technology and Art.
Graduated from Keio University of Media Design Graduate School.
Interested in media art, interaction design.
George Chernyshov  Postdoc at grad shool of Media Design, Keio University, Japan.
Dingding Zheng  PhD. student at Keio University Graduate school of Media Design
Jiawen Han  PhD. student at Keio University Graduate school of Media Design
Ragnar Thomsen  Experienced game designer and researcher. Currently PhD student at Keio University Graduate School of Media Design.
Danny Hynds  Danny Hynds is a composer, creative technologist, and visual artist from the US. His work explores the ways in which sound can be used as an emotional and affective tool in responsive public artworks. He also produces electronic music as Spectral Violet.
Yuehui Yang  Institution: Keio University Graduate School of Media Design
Yuehui Yang is a versatile composer and multi-instrumentalist in concert, film and electronic media. Focusing on film scoring and music interaction, Yuehui had collaborated with many talented young filmmakers, animators and designers.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design. He obtained his Bachelors Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand. His research interest is the effects of VR/AR/MR towards human behavior, perception and learning using physiological signals and artificial intelligence.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractFrisson is a mental experience of body reactions such as shivers, tingling skin, and goosebumps. However, this sensation is not shareable with others and is rarely used in live performances. We propose Frisson Waves, a real-time system to detect, trigger and share frisson in a wave-like pattern during music performances. 10am: Integration of stereoscopic laser-based geometry into 3D video using DLP Link synchronisation Jayson Haebich, Christian Sandor, and Alvaro Cassinelli (City University of Hong Kong) Biographies BiographiesJayson Haebich  Jayson Haebich is an artist and researcher who is interested in the intersection of art, technology, and science. Using light he explores how space, light, and form interact to create immersive light installations. Currently working at the XR-Lab at City University of Hong Kong on interactive augmented reality projects that use light in new and exciting ways. previously he has presented work worldwide including at the Salisbury Cathedral, Bauhaus Dessau, Somerset House, British Film Institute, and in smaller galleries and institutions across Europe, Australia, and China.
Christian Sandor  Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong’s School of Creative Media, where he is co-directing the Extended Reality Lab (https://xr-lab.org) together with Associate Professor Alvaro Cassinelli. Since the year 2000, his foremost research interest is Augmented Reality, as he believes that it will have a profound impact on the future of mankind.
Alvaro Cassinelli  Alvaro Cassinelli was born in Montevideo (Uruguay) in 1972. In 1990 he earns both a French and Uruguayan B.Sc., and a grant to pursue his studies in France. He obtains a Graduate Engineering diploma from the Ecole Nationale Supérieure des Télécom (now Télécom ParisTech) in 1996, completing the same year a Doctoral Qualifying Degree (DEA/Master) in Physics (Laser & Matter Interaction) from the University of Paris-XI, Telecom and Ecole Polytechnique. In 2000 he receives a Ph.D degree from the University of Paris-XI Orsay.
Abstract AbstractIn this work, we demonstrate a laser-based display integrating stereoscopic vector graphics into a dynamic scene generated by a conventional 3d video projection system. These laser graphics are projected with a galvo-laser system which exhibits far greater brightness, contrast and acuity compared to pixelated projectors. 10am: GroundFlow: Multiple Flows Feedback for Enhancing Immersive Experience on the Floor in the Wet Scenes Tzu-Hua Wang, Tzu-Shan Lee, Jr-Pin Pan, Tzu-Yang Kuo, Hui-Yang Yong, and Ping-Hsuan Han (National Taipei University of Technology, Department of interaction design) Biographies BiographiesTzu-Hua Wang  Tzu-Hua Wang received his B.S. degree in Electronic Engineering from the National Taipei University of Technology in 2020. In addition, he is studying for M.S. at the Department of Interaction Design from the National Taipei University of Technology in 2021. From 2017 to 2019, he was an intern at the HTC Vive R&D Multimedia team. In 2013, he was a summer intern at Siemens ME Team and EE Team in Germany and Taipei. He has been on the faculty of Electronic Engineering and Electrical Engineering. His research interests include Human-Computer Interaction(HCI), Virtual Reality, and Multisensory Technology.
Tzu-Shan Lee  Lee, Tzu-Shan received her BA. in Interaction Design at the National Taipei University of Technology. Has 1 year of experience in visual and UI design and be in participated in websites and apps development projects. Her current research interests include Human-Computer Interaction (HCI), Virtual Reality (VR), and User Interface Design.
Jr-Pin Pan  Jr-Pin Pan received her BA. in Interaction Design at the National Taipei University of Technology. Her current research is Structural design and Material processing applications.
Tzu-Yang Kuo  Tzu-Yang Kuo received his BA. in Interaction Design at the National Taipei University of Technology. His current research interests include Game Development, Modeling, and Virtual Reality (VR), and he also gets exposure to 3D Printing and Laser cutting.
Hui-Yang Yong  Hui-Yang Yong majors in Interaction Design at the National Taipei University of Technology. She works at the furniture design company as an intern. Her current research interests include Virtual Reality (VR), Computer Generated Imagery (CGI), and Motion graphics design.
Ping-Hsuan Han  Ping-Hsuan Han received his Ph.D. at the Graduate Institute of Networking and Multimedia at National Taiwan University, M.S. from Master Program in Toy and Game Design, and B.S. from the Department of Digital Technology Design all at National Taipei University of Education. He is an Assitant Professor in the Department of Interaction Design at the National Taipei University of Technology. His current research interests include Human-Computer Interaction (HCI), Virtual Reality (VR), Mixed Reality (MR), and Multisensory Technology, and he also focuses on Creativity in Engineering Education.
Abstract AbstractWe present GroundFlow, a water recirculation system that provides multiple flows feedback on the floor in immersive virtual reality. Our demonstration also implemented a virtual excursion that allows users to experience different water flows and their corresponding wet scenes. 10am: VWind: Virtual Wind Sensation to the Ear by Cross-Modal Effects of Audio-Visual, Thermal, and Vibrotactile Stimuli Juro Hosoi, Yuki Ban, Kenichi Ito, and Shin'ichi Warisawa (The University of Tokyo) Biographies BiographiesJuro Hosoi  Juro Hosoi received his bachelor of engineering degree from the Faculty of Engineering, the University of Tokyo in 2021. He is a master course student of the Graduate School of Frontier Sciences, the University of Tokyo now. His research interest is improving a sense of presence in virtual reality by presenting feelings of various winds.
Yuki Ban  Yuki Ban received the M.S. degree and the Ph.D. degree in Information Science and Technology from the University of Tokyo, Tokyo, Japan, in 2013 and 2016, respectively. He was a researcher at Xcoo inc. research from 2016 to 2017. He is currently an Assistant Professor of Graduate School of Frontier Sciences at the University of Tokyo. His current research interests focus on modifying spatial perception using the visuo-haptic interaction.
Kenichi Ito  Kenichi Ito received a Master of Environmental Studies degree from the Graduate School of Frontier Sciences, the University of Tokyo in 2021.
He is a doctoral student of the Graduate School of Frontier Sciences, the University of Tokyo now.
His research interest is improving presence and immersion of virtual reality by presenting the feelings of wind.
Shin'ichi Warisawa  Prof. Warisawa is a professor of Department of Human and Engineered Environmental Studies at the University of Tokyo. From April of 1994 to March of 2000, he served as an Assistant Professor of Tokyo Institute of Technology, from April of 2000 has been working at the University of Tokyo. He was a visiting researcher at Massachusetts Institute of Technology from 2010 to 2011, and a visiting professor at Université Jean Monnet in 2016. His current research focuses on wearable/ambient human health monitoring. Research cores are nano/micro sensing devices fabrication and sensing information technology application for human well-being.
Abstract AbstractWe propose to present virtual wind sensation by cross-modal effects. We developed VWind, a wearable headphone-type device to give vibrotactile and thermal stimuli in addition to visual scenarios and binaural sounds. We prepared the demonstrations as if users were blown to the ear or exposed to freezing winds. 10am: DroneStick: Flying Joystick as a Novel Type of Interface Evgeny Tsykunov, Aleksey Fedoseev, Ekaterina Dorzhieva, Ruslan Agishev, and Roman Ibrahimov (Skolkovo Institute of Science and Technology); Derek Vasquez (Brigham Young University); and Luiza Labazanova and Dzmitry Tsetserukou (Skolkovo Institute of Science and Technology) Biographies BiographiesEvgeny Tsykunov  Evgeny Tsykunov received the Ph.D. degree in Engineering Systems from the Skolkovo Institute of Science and Technology, Moscow, Russian Federation, in 2021. His research interests include swarm of drones, haptics, and computer vision.
Aleksey Fedoseev  Aleksey Fedoseev received the M.Sс. degree in Space and Engineering Systems from Skolkovo Institute of Science and Technology, Moscow, Russia, in 2020. In addition, he completed a personnel exchange Monodukuri Engineer Human Resource Program in Kindai University, Japan. He is currently working towards the Ph.D. degree in the Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology. His research interests include human-robot interaction and haptic devices.
Ekaterina Dorzhieva  Ekaterina Dorzhieva is currently a MS student in the Department of Space and Engineering Systems, Skolkovo Institute of Science and Technology (Skoltech). She received the Bachelor Degree in Automation Engineering from the Bauman Moscow State Technical University in 2020. Ekaterina's research interests include robotics, haptics, and swarm of drones.
Ruslan Agishev  Ruslan Agishev is currently a researcher at Czech Technical University in Prague. He received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2020. His research interests include drone control, mobile robotics, path planning, and collision avoidance.
Roman Ibrahimov  Roman Ibrahimov is currently a PhD student at Purdue University. He received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2020. His research interests include multi-agent systems, flying robots, and Machine Learning.
Derek Vasquez  Derek Vasquez is a Ph.D. student in mechanical engineering at Florida State University in Tallahassee, Florida. He received a B.S. (2020) in mechanical engineering from Brigham Young University. Derek is interested in robotics, control, and biologically inspired design, and he is currently researching mode transitions for multi-modal legged robots.
Luiza Labazanova  Luiza Labazanova is currently a PhD student at Hong Kong Polytechnic University. She received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2019. Her research interest includes swarm of drones, soft robotics, and haptics.
Dzmitry Tsetserukou  Dzmitry Tsetserukou received the Ph.D. degree in Information Science and Technology from the University of Tokyo, Japan, in 2007. From 2007 to 2009, he was a JSPS Post-Doctoral Fellow at the University of Tokyo. He worked as Assistant Professor at the Electronics-Inspired Interdisciplinary Research Institute, Toyohashi University of Technology from 2010 to 2014.
He is currently working as Associate Professor at Skoltech. He received such prestigious Awards as Best Demonstration Award (Honorable Mentions, ACM SIGGRAPH Asia 2019), Best Demonstration Award (Bronze Prize AsiaHaptics 2018), Laval Virtual Awards (ACM SIGGRAPH 2016), and a Best Paper Award (ACM Augmented Human 2010).
Abstract AbstractDroneStick is a novel hands-free method for smooth interaction between a human and a robotic system via one of its agents. A flying joystick (DroneStick) being a part of a multi-robot system is composed of a flying drone and coiled wire with a vibration motor. 10am: Collaborative Avatar Platform for Collecting Human Expertise Takayoshi Hagiwara (Keio University Graduate School of Media Design); Takumi Katagiri, Hikari Yukawa, Itsuki Ogura, Ryohei Tanada, Takumi Nishimura, and Yoshihiro Tanaka (Nagoya Institute of Technology); and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesTakayoshi Hagiwara  Graduated from the Department of Electrical & Electronices Engineering, National Institute of Technology, Numazu College in 2017. Graduated from the Department of Computer Science and Engineering, Toyohashi University of Technology in 2019 and received master degree in Engineering in 2021.
Entered Graduate School of Media Design, Keio University in the same year.
Research Assistant, Cybernetic being Project, JST Moonshot R&D Program.
Takumi Katagiri  Takumi Katagiri received the BS degree in Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan, in 2020. Currently, he is a master student in the same university. His research interests include body integration through a robotic avatar by multiple people. To achieve sensory and motor control in body fusion, he is investigating the presentation of the operator's movement information by sharing the sense of touch.
Hikari Yukawa  Hikari Yukawa received the Ph.D. (Human Centered Engineering) degree from Nara Women’s University, Japan, in 2021. Currently, she is working at the Nagoya Institute of Technology, Japan, as a project based assistant professor of JST Moonshot R&D program. Her research interests include haptic and olfactory perception, illusion of bodily sensation, and human-human cooperation shared with sensations.
Itsuki Ogura  Itsuki Ogura is an undergraduate student of Creative Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include cooperation between human-human/robot that share the sense of touch with each other. Currently, he is working on division of the avatar robot's operation and improving the camera for working smoothly of avatar robot.
Ryohei Tanada  Ryohei Tanada is an undergraduate student of Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include body fusion via avatar robots. He is investigating the effect of sensory sharing on workability and body awareness during body fusion by feeding back the motion information of others and tactile information from the robot.
Takumi Nishimura  Takumi Nishimura is an undergraduate student of Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include body fusion by sharing a robot avatar with multiple people. To achieve sensory and motion control in body fusion, he is investigating a method to present each other's haptic and motion information as vibration between operators.
Yoshihiro Tanaka  Yoshihiro TANAKA, received his Ph.D. (Eng.) from Tohoku University in 2006. He was a Research Fellow of the Japan Society for the Promotion of Science in 2005. In 2006, he was a Research Associate with Nagoya Institute of Technology and is working as a Professor since 2021. He was a Visiting Researcher at Utrecht University (2011) and a PRESTO Researcher of the Japan Science and Technology Agency (2014-2018). His research interests include haptic perception, tactile interfaces, tactile design, and human-human/robot cooperation with shared haptic perception. He also serves as an Associate Editor of the IEEE Transactions on Haptics from 2020.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractWe present a system that mixes two people into one robot arm and collaborates together.
There are two ways of control (division of roles and mixing in adjustable ratio), and we found that it allows us to perform movements that are impossible by alone and stabilizes the movement. 10am: Weighted Walking: Propeller-based On-leg Force Simulation of Walking in Fluid Materials in VR Pingchuan Ke, Shaoyu Cai, and Lantian Xu (School of Creative Media, City University of Hong Kong) and Kening Zhu (City University of Hong Kong) Biographies BiographiesPingchuan Ke  Ke Pingchuan (Patrick) is a PhD student under the supervision of Dr. Kening Zhu at School of Creative Media, City University of Hong Kong. His current projects focus on Virtual and Augmented Reality(VR/AR), User Interface(UI) and other areas of Human-Computer Interaction (HCI). At the same time, he is also interested in research areas of new media art, interaction design, game and animation design.
Shaoyu Cai  Shaoyu Cai is a PhD student under the supervision of Dr. Kening Zhu at the School of Creative Media, City University of Hong Kong. His research interest lies in the field of Human-Computer Interaction (HCI), especially for Cross-modal Learning (e.g., from vision to touch) and Multi-modal Interaction through Deep Learning methods.
Lantian Xu  Lantian Xu (Alston) is currently a first year Ph.D. student under the supervision of Dr. Alvaro Cassinelli and Dr. Kening Zhu at School of Creative Media, City University of Hong Kong where he also obtained his BSc degree in 2020. His current research focuses on remote collaboration and sense of presence in mixed reality.
Kening Zhu  Kening Zhu is an Associate Professor at the School of Creative Media, and jointly appointed by the Department of Computer Science, City University of Hong Kong. He leads the Multimodal and Embodied Interaction Lab (MEI Lab). He received his PhD degree from the National University of Singapore, and his bachelor degree on Computer Science from Huazhong University of Science and Technology, China.
Abstract AbstractWeighted Walking is a wearable device with ducted fans on the user's calf. The fans can generate powerful thrust to simulate the forces caused by the user's lower limbs moving in different fluid materials. It can also simulate the walking experience in different gravity conditions, such as in another planet. 10am: HoloBurner: Mixed reality equipment for learning flame color reaction by using aerial imaging display Toshikazu Ohshima and Kai Nishimoto (Ritsumeikan University, College of Image Arts and Sciences) Biographies BiographiesToshikazu Ohshima  Toshikazu Ohshima is a professor at Ritsumeikan University since 2006. He received a Doctorate from University of Tsukuba, Graduate School of Engineering. Then he joined in Canon Inc. and served as a researcher for research and development of virtual reality since 1991. He worked as a senior researcher in a national project at Mixed Reality Laboratory Inc. since 1997. He served as a section chief at MR R&D section in Canon Inc. since 2001. His research interests are mixed reality technologies and its deployment in education, medical and art field.
Kai Nishimoto  Kai Nishimoto was a student at College of Image Arts and Sciences, Ritsumeikan University, where he received his B.A. in 2019. He works at Bandai Namco Entertainment, Inc. since 2019.
Abstract AbstractThe HoloBurner system is a mixed reality instrument for chemistry experiments to learn about the color reaction of flames. The system consists of a real Bunsen burner and an aerial image display that shows a holographic image of a flame at the tip of the burner. 10am: Recognition of Gestures over Textiles with Acoustic Signatures Pui Chung Wong and Christian Sandor (City University of Hong Kong) and Alvaro Cassinelli (School of Creative Media, City University) Biographies BiographiesPui Chung Wong  Pui Chung Wong is a researcher interested in Human-Computer Interaction (HCI) and novel input methods. He completed his PhD in Creative Media, advised by Hongbo Fu and Kening Zhu. After his studies, he became a postdoc in Alvaro Cassinelli’s Augmented Materiality Lab. His work focuses on different topics in HCI, designing, building, and evaluating novel input and interaction for wearables and mobile devices. He believes that by exploring the parameters of different interaction methods more natural interaction can be developed that will improve daily living.
Christian Sandor  Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong's School of Creative Media, where he is directing the Augmented Reality Lab. In October 2020, he was appointed Augmented Reality Evangelist at the Guangzhou Greater Bay Area Virtual Reality Research Institute. Since 2000, his foremost research interest is Augmented Reality, a`s he believes it has a profound impact on the future of mankind. He serves as editorial board member for Computers & Graphics and Transactions on Visualization and Computer Graphics and as a steering committee member for ACM Symposium Spatial User Interaction and IEEE ISMAR.
Alvaro Cassinelli  Alvaro Cassinelli (UY, IT), obtained an Engineering Degree and a PhD in Physics in France. He lead the Meta-Perception group at the Ishikawa-Oku Laboratory, University of Tokyo, specialized on interfaces to enhance human expression, expanding the vocabulary of HCI and the New Media before becoming Associate Professor and director of the Augmented Materiality lab at the School of Creative Media (HK). Awards includes a Grand Prize (9th Japan Media Art Festival), the Excellence Prize (13th Japan Media Art Festival), an Honorary Mention (Ars Electronica), the NISSAN Innovative Award (2010), Jury Grand Prize at Laval Virtual (2011) among others.
Abstract AbstractWe demonstrate a method capable of turning a textured surface into an opportunistic input interface using a machine learning model pre-trained on the acoustic signal generated while scratching different types of fabric. A single and brief audio recording then suffices to characterize both the texture and the gesture that originates. 10am: Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display Jun Momose, Yuta Koda, Hideki Mori, Morio Kakiuchi, Kotaro Imamura, and Makoto Wakabayashi (Sony Interactive Entertainment) Biographies BiographiesJun Momose  Jun Momose worked as electrical engineer at Sony Corporation and Sony Interactive Entertainment from 1992 to design handheld game console and portable audio player. Now he has been engaged in Project Leader in research and development division.
Yuta Koda  Yuta Koda worked as a mechanical engineer at Sony Corporation and Sony Mobile Communications from 2007-2016 to design and manufacture digital cameras and smart phones. After moving to Sony Interactive Entertainment in 2016, he has been mainly engaged in the development of actuators for user interfaces and study of haptics technology.
Hideki Mori  Hideki Mori is a senior UX researcher at Sony Interactive Entertainment. He is responsible for R&D of new UX/UI for games and interactive media since 2016.
He also has experience as a researcher of signal processing algorithms and a product planner in charge of entire UX.
Based on his expertise both in business and technology fields, now he has a passion for developing new UX based on unique technology.
2016–Current Senior Researcher, UX/UI. Sony Interactive Entertainment
2008–2016 Product Planner/Manager, New category and home entertainment products. Sony Corporation
2002–2008 Researcher, Video signal processing by machine learning. Sony Corporation
Morio Kakiuchi  Morio Kakiuchi
Sony Interactive Entertainment Inc., Tokyo
Electrical engineer in Research and Development division for game entertainment.
Kotaro Imamura  Kotaro Imamura
Sony Interactive Entertainment
Software Engineer
Makoto Wakabayashi  Makoto Wakabayashi
1997-2021 Sony Interactive Entertainment World Wide Studio Japan Studio
Develop of game titles
2021-present Sony Interactive Entertainment UXRD Tokyo
Research of Future Input
Abstract AbstractPen shaped interface capable of providing the following multimodal feedbacks from virtual object (1) Linear feedback to express contact pressure
(2) Rotational feedback to simulate friction of rubbing virtual surface
(3) Vibrotactile feedback
(4) Auditory feedback to express contact information
MR interaction system with pen shaped interface and Spatial Display. 10am: "Amazing Sketchbook the Ride": Driving a Cart in a 3DCG Scene Created from a Hand-Drawn Sketch Mayu Asakura and Shinji Mizuno (Aichi Institute of Technology) Biographies BiographiesMayu Asakura  Mayu Asakura graduated from Aichi Institute of Technology in 2020 and is master course student at Aichi Institute of Technology. Her research interests are in computer graphics and human computer interaction.
Shinji Mizuno  Shinji Mizuno is currently a professor at Faculty of Information Science, Aichi Institute of Technology. He received the Ph.D degree from Nagoya University in 1999. He was a Research Associate at Toyohashi University of Technology from 2000 to 2009. His research interests include computer graphics, image processing, virtual reality, and human computer interaction.
Abstract AbstractWe introduce an interactive content "Amazing Sketchbook the Ride", which allows users to drive an actual cart and move freely in a 3DCG scene as if they were immersed in it. The users can create the 3DCG scene for driving by themselves by drawing a sketch of the scene. 10am: Simultaneous Augmentation of Textures and Deformation Based on Dynamic Projection Mapping Leo Miyashita, Kentaro Fukamizu, and Masatoshi Ishikawa (The University of Tokyo) Biographies BiographiesLeo Miyashita  Leo Miyashita researches how to create realistic digital visualizations that are mapped onto real-world objects. He is Research Manager of the System Vision Design Research Group at The University of Tokyo (Japan), where he also obtained his award-winning Ph.D.
Kentaro Fukamizu  Kentaro Fukamizu researches high-speed computer graphics with optical illusions. He studied at The University of Tokyo (Japan) and now works at sony.
Masatoshi Ishikawa  Masatoshi Ishikawa researches massively parallel high-speed vision, high-speed Intelligent robots, dynamic Interaction, optics in computing. He is a project professor at The University of Tokyo.
Abstract AbstractWe exploit human perception characteristics and dynamic projection mapping techniques and realize simultaneous overwriting of both textures and deformation of a real object.
With the developed 1000fps low-latency projector-camera system, we demonstrate that a plaster figure turns into a colorful and flabby object by the projection. Thursday 12:00pm-1:10pm Konica Minolta Planetaria TOKYO Dome 1 (Yurakucho Marion 9F, 2-5-1 Yurakucho, Chiyoda-ku, Tokyo Art Gallery · Full Access, Onsite Experience, Onsite Student Access, Onsite, Japanese LanguageArt Gallery x MADD. Award x コニカミノルタプラネタリアTOKYO によるスペシャルプログラム上映 Abstract Abstract次世代映像アワードMADD. Award 2021「360度映像」
カテゴリー応募作品、著名アーティストによるスペシャル
プログラムの上映会を開催。
プラネタリアTOKYOでしか得られないドーム全体を包み込む
360度映像と24個のスピーカーが奏でる音が織りなす
イマーシブ体験をお楽しみいただけます。
*コンテンツの異なる2つのプログラムA・Bをご用意
会場:コニカミノルタプラネタリアTOKYO Dome1
東京都千代田区有楽町2丁目5-1 有楽町マリオン 9階
入場資格:SIGGRAPH Asia 2021参加登録パスをお持ちの方
* 事前予約なし・先着順での席のご案内となります。 Thursday 1:30pm-2:40pm Konica Minolta Planetaria TOKYO Dome 1 (Yurakucho Marion 9F, 2-5-1 Yurakucho, Chiyoda-ku, Tokyo Art Gallery · Full Access, Onsite Experience, Onsite Student Access, Onsite, Japanese LanguageArt Gallery x MADD. Award x コニカミノルタプラネタリアTOKYO によるスペシャルプログラム上映 Abstract Abstract次世代映像アワードMADD. Award 2021「360度映像」
カテゴリー応募作品、著名アーティストによるスペシャル
プログラムの上映会を開催。
プラネタリアTOKYOでしか得られないドーム全体を包み込む
360度映像と24個のスピーカーが奏でる音が織りなす
イマーシブ体験をお楽しみいただけます。
*コンテンツの異なる2つのプログラムA・Bをご用意
会場:コニカミノルタプラネタリアTOKYO Dome1
東京都千代田区有楽町2丁目5-1 有楽町マリオン 9階
入場資格:SIGGRAPH Asia 2021参加登録パスをお持ちの方
* 事前予約なし・先着順での席のご案内となります。 Thursday 3:00pm-4:10pm Konica Minolta Planetaria TOKYO Dome 1 (Yurakucho Marion 9F, 2-5-1 Yurakucho, Chiyoda-ku, Tokyo Art Gallery · Full Access, Onsite Experience, Onsite Student Access, Onsite, Japanese LanguageArt Gallery x MADD. Award x コニカミノルタプラネタリアTOKYO によるスペシャルプログラム上映 Abstract Abstract次世代映像アワードMADD. Award 2021「360度映像」
カテゴリー応募作品、著名アーティストによるスペシャル
プログラムの上映会を開催。
プラネタリアTOKYOでしか得られないドーム全体を包み込む
360度映像と24個のスピーカーが奏でる音が織りなす
イマーシブ体験をお楽しみいただけます。
*コンテンツの異なる2つのプログラムA・Bをご用意
会場:コニカミノルタプラネタリアTOKYO Dome1
東京都千代田区有楽町2丁目5-1 有楽町マリオン 9階
入場資格:SIGGRAPH Asia 2021参加登録パスをお持ちの方
* 事前予約なし・先着順での席のご案内となります。 Thursday 4:30pm-5:40pm Konica Minolta Planetaria TOKYO Dome 1 (Yurakucho Marion 9F, 2-5-1 Yurakucho, Chiyoda-ku, Tokyo Art Gallery · Full Access, Onsite Experience, Onsite Student Access, Onsite, Japanese LanguageArt Gallery x MADD. Award x コニカミノルタプラネタリアTOKYO によるスペシャルプログラム上映 Abstract Abstract次世代映像アワードMADD. Award 2021「360度映像」
カテゴリー応募作品、著名アーティストによるスペシャル
プログラムの上映会を開催。
プラネタリアTOKYOでしか得られないドーム全体を包み込む
360度映像と24個のスピーカーが奏でる音が織りなす
イマーシブ体験をお楽しみいただけます。
*コンテンツの異なる2つのプログラムA・Bをご用意
会場:コニカミノルタプラネタリアTOKYO Dome1
東京都千代田区有楽町2丁目5-1 有楽町マリオン 9階
入場資格:SIGGRAPH Asia 2021参加登録パスをお持ちの方
* 事前予約なし・先着順での席のご案内となります。 Friday 10:00am-4:00pm Hall E, Experience Hall (B2F, E Block) Art Gallery, Emerging Technologies, XR · Full Access, Onsite Experience, Onsite Student Access, OnsiteExperience Hall 10am: LIPSYNC.AI: A.I. Driven Lips and Tongue Animations Using Articulatory Phonetic Descriptors and FACS Blendshapes Jara Alvarez Masso, Alexandru Mihai Rogozea, Jan Medvesek, Saeid Mokaram, and Yijun Yu (Emotech Ltd) Biographies BiographiesJara Alvarez Masso  Jara has a background in Design and in Cognitive Systems and Interactive Media. She worked as a product designer for forward-thinking companies such as Twenty2b and Seam Technic, where she helped develop original concepts for innovative products in consumer electronics and wearable devices.
At Emotech she progressed in improving the relationship between humans and technology by working on a robotic personal assistant and later on developing supportive technologies which empower digital creations to look and act like a human being. She has done research in the speech and 3D theory for LIPSYNC.AI and is now managing the product.
Alexandru Mihai Rogozea  Alex has a background in Computer Science and Visual Effects. In the last few years he worked with 2D and 3D software companies, such as Foundry, on developing tools that help 3D artists express their skills as best as possible.
At Emotech he contributed on the various AI technologies which drive the in-house produced personal assistant, and then helped develop LIPSYNC.AI by implementing neural network architectures and developing procedural algorithms.
Jan Medvesek  Jan has a background in software and hardware development with an emphasis on research and development work. He's worked on developing algorithms for image processing, software and hardware for 3D glasses and spent time teaching. He's now co-founder of Emotech and is highly passionate about pushing the boundaries of AI in the day to day life.
Saeid Mokaram  Saeid is a machine learning scientist. Since completing his PhD at the University of Sheffield, he has commercial and academic experience of automatic speech recognition, natural language understanding. He is excited by the application of research to real-world problems and has contributed to LIPSYNC.AI at Emotech by applying his knowledge in speech technology and AI.
Yijun Yu  Yijun is an instinctive product designer who believes in the value of the users. Seeing design as a medium to turn dreams and imaginations into real life experiences, she is keen on the vision to design for the future.
At Emotech she worked on designing the user experience for a robotic personal assistant and later on contributed to LIPSYNC.AI through research and applications of articulation theory on the tongue and lips.
Abstract AbstractLIPSYNC.AI: A.I. Driven Lips and Tongue Animations Using Articulatory Phonetic Descriptors and FACS Blendshapes 10am: Collaborative Avatar Platform for Collecting Human Expertise Takayoshi Hagiwara (Keio University Graduate School of Media Design); Takumi Katagiri, Hikari Yukawa, Itsuki Ogura, Ryohei Tanada, Takumi Nishimura, and Yoshihiro Tanaka (Nagoya Institute of Technology); and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesTakayoshi Hagiwara  Graduated from the Department of Electrical & Electronices Engineering, National Institute of Technology, Numazu College in 2017. Graduated from the Department of Computer Science and Engineering, Toyohashi University of Technology in 2019 and received master degree in Engineering in 2021.
Entered Graduate School of Media Design, Keio University in the same year.
Research Assistant, Cybernetic being Project, JST Moonshot R&D Program.
Takumi Katagiri  Takumi Katagiri received the BS degree in Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan, in 2020. Currently, he is a master student in the same university. His research interests include body integration through a robotic avatar by multiple people. To achieve sensory and motor control in body fusion, he is investigating the presentation of the operator's movement information by sharing the sense of touch.
Hikari Yukawa  Hikari Yukawa received the Ph.D. (Human Centered Engineering) degree from Nara Women’s University, Japan, in 2021. Currently, she is working at the Nagoya Institute of Technology, Japan, as a project based assistant professor of JST Moonshot R&D program. Her research interests include haptic and olfactory perception, illusion of bodily sensation, and human-human cooperation shared with sensations.
Itsuki Ogura  Itsuki Ogura is an undergraduate student of Creative Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include cooperation between human-human/robot that share the sense of touch with each other. Currently, he is working on division of the avatar robot's operation and improving the camera for working smoothly of avatar robot.
Ryohei Tanada  Ryohei Tanada is an undergraduate student of Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include body fusion via avatar robots. He is investigating the effect of sensory sharing on workability and body awareness during body fusion by feeding back the motion information of others and tactile information from the robot.
Takumi Nishimura  Takumi Nishimura is an undergraduate student of Electrical and Mechanical Engineering from Nagoya Institute of Technology, Nagoya, Japan from 2018.
His research interests include body fusion by sharing a robot avatar with multiple people. To achieve sensory and motion control in body fusion, he is investigating a method to present each other's haptic and motion information as vibration between operators.
Yoshihiro Tanaka  Yoshihiro TANAKA, received his Ph.D. (Eng.) from Tohoku University in 2006. He was a Research Fellow of the Japan Society for the Promotion of Science in 2005. In 2006, he was a Research Associate with Nagoya Institute of Technology and is working as a Professor since 2021. He was a Visiting Researcher at Utrecht University (2011) and a PRESTO Researcher of the Japan Science and Technology Agency (2014-2018). His research interests include haptic perception, tactile interfaces, tactile design, and human-human/robot cooperation with shared haptic perception. He also serves as an Associate Editor of the IEEE Transactions on Haptics from 2020.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractWe present a system that mixes two people into one robot arm and collaborates together.
There are two ways of control (division of roles and mixing in adjustable ratio), and we found that it allows us to perform movements that are impossible by alone and stabilizes the movement. 10am: Midair Haptic-Optic Display with Multi-Tactile Texture based on Presenting Vibration and Pressure Sensation by Ultrasound Tao Morisaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda (The University of Tokyo) Biographies BiographiesTao Morisaki  Tao Morisaki is a Ph.D. student with the Graduate School of Frontier Sciences, the University of Tokyo, since 2020. He received the M.S. degree from the Department of Complexity Science and Engineering from the University of Tokyo, Chiba, Japan, in 2020. His research interests include haptics, ultrasound mid-air haptics, and human-computer interaction. He is a member of VRSJ.
Masahiro Fujiwara  He is a project assistant professor in the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He received the BS degree in Engineering, the MS degree and the PhD degree in Information Science and Technology from the University of Tokyo, in 2010, 2012, and 2015, respectively. His research interests include information physics, haptics, non-contact sensing and application systems related to them. He is a member of IEEE.
Yasutoshi Makino  Yasutoshi Makino is an associate professor in the Department of Complexity Science and Engineering in the University of Tokyo. He received his PhD in Information Science and Technology from the Univ. of Tokyo in 2007. He worked as a researcher for two years in the Univ. of Tokyo and an assistant professor in Keio University from 2009 to 2013. From 2013 he moved to the Univ. of Tokyo as a lecture, and he is an associate professor from 2017. His research interest includes haptic interactive systems.
Hiroyuki Shinoda  Hiroyuki Shinoda is a Professor at the Graduate School of Frontier Sciences, the University of Tokyo. After receiving a Ph.D. in engineering from the University of Tokyo, he was an Associate Professor at Tokyo University of Agriculture and Technology from 1995 to 1999. He was a Visiting Scholar at UC Berkeley in 1999 and was an Associate Professor at the University of Tokyo from 2000 to 2012. His research interests include information physics, haptics, mid-air haptics, two-dimensional communication, and their application systems. He is a member of SICE, IEEJ, RSJ, JSME, VRSJ, IEEE and ACM.
Abstract AbstractIn this demonstration, we develop a midair haptic-optic display with multi-tactile texture using focused ultrasound. In this system, participants can touch aerial 3D images with a realistic texture without wearing any devices. The realistic textures are rendered by simultaneously presenting vibration and static pressure sensation using ultrasound. 10am: Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display Jun Momose, Yuta Koda, Hideki Mori, Morio Kakiuchi, Kotaro Imamura, and Makoto Wakabayashi (Sony Interactive Entertainment) Biographies BiographiesJun Momose  Jun Momose worked as electrical engineer at Sony Corporation and Sony Interactive Entertainment from 1992 to design handheld game console and portable audio player. Now he has been engaged in Project Leader in research and development division.
Yuta Koda  Yuta Koda worked as a mechanical engineer at Sony Corporation and Sony Mobile Communications from 2007-2016 to design and manufacture digital cameras and smart phones. After moving to Sony Interactive Entertainment in 2016, he has been mainly engaged in the development of actuators for user interfaces and study of haptics technology.
Hideki Mori  Hideki Mori is a senior UX researcher at Sony Interactive Entertainment. He is responsible for R&D of new UX/UI for games and interactive media since 2016.
He also has experience as a researcher of signal processing algorithms and a product planner in charge of entire UX.
Based on his expertise both in business and technology fields, now he has a passion for developing new UX based on unique technology.
2016–Current Senior Researcher, UX/UI. Sony Interactive Entertainment
2008–2016 Product Planner/Manager, New category and home entertainment products. Sony Corporation
2002–2008 Researcher, Video signal processing by machine learning. Sony Corporation
Morio Kakiuchi  Morio Kakiuchi
Sony Interactive Entertainment Inc., Tokyo
Electrical engineer in Research and Development division for game entertainment.
Kotaro Imamura  Kotaro Imamura
Sony Interactive Entertainment
Software Engineer
Makoto Wakabayashi  Makoto Wakabayashi
1997-2021 Sony Interactive Entertainment World Wide Studio Japan Studio
Develop of game titles
2021-present Sony Interactive Entertainment UXRD Tokyo
Research of Future Input
Abstract AbstractPen shaped interface capable of providing the following multimodal feedbacks from virtual object (1) Linear feedback to express contact pressure
(2) Rotational feedback to simulate friction of rubbing virtual surface
(3) Vibrotactile feedback
(4) Auditory feedback to express contact information
MR interaction system with pen shaped interface and Spatial Display. 10am: Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances Yan He, George Chernyshov, Dingding Zheng, Jiawen Han, Ragnar Thomsen, Danny Hynds, Yuehui Yang, Yun Suen Pai, Kai Kunze, and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesYan He  Background in Digital Media Technology and Art.
Graduated from Keio University of Media Design Graduate School.
Interested in media art, interaction design.
George Chernyshov  Postdoc at grad shool of Media Design, Keio University, Japan.
Dingding Zheng  PhD. student at Keio University Graduate school of Media Design
Jiawen Han  PhD. student at Keio University Graduate school of Media Design
Ragnar Thomsen  Experienced game designer and researcher. Currently PhD student at Keio University Graduate School of Media Design.
Danny Hynds  Danny Hynds is a composer, creative technologist, and visual artist from the US. His work explores the ways in which sound can be used as an emotional and affective tool in responsive public artworks. He also produces electronic music as Spectral Violet.
Yuehui Yang  Institution: Keio University Graduate School of Media Design
Yuehui Yang is a versatile composer and multi-instrumentalist in concert, film and electronic media. Focusing on film scoring and music interaction, Yuehui had collaborated with many talented young filmmakers, animators and designers.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design. He obtained his Bachelors Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand. His research interest is the effects of VR/AR/MR towards human behavior, perception and learning using physiological signals and artificial intelligence.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
Abstract AbstractFrisson is a mental experience of body reactions such as shivers, tingling skin, and goosebumps. However, this sensation is not shareable with others and is rarely used in live performances. We propose Frisson Waves, a real-time system to detect, trigger and share frisson in a wave-like pattern during music performances. 10am: HoloBurner: Mixed reality equipment for learning flame color reaction by using aerial imaging display Toshikazu Ohshima and Kai Nishimoto (Ritsumeikan University, College of Image Arts and Sciences) Biographies BiographiesToshikazu Ohshima  Toshikazu Ohshima is a professor at Ritsumeikan University since 2006. He received a Doctorate from University of Tsukuba, Graduate School of Engineering. Then he joined in Canon Inc. and served as a researcher for research and development of virtual reality since 1991. He worked as a senior researcher in a national project at Mixed Reality Laboratory Inc. since 1997. He served as a section chief at MR R&D section in Canon Inc. since 2001. His research interests are mixed reality technologies and its deployment in education, medical and art field.
Kai Nishimoto  Kai Nishimoto was a student at College of Image Arts and Sciences, Ritsumeikan University, where he received his B.A. in 2019. He works at Bandai Namco Entertainment, Inc. since 2019.
Abstract AbstractThe HoloBurner system is a mixed reality instrument for chemistry experiments to learn about the color reaction of flames. The system consists of a real Bunsen burner and an aerial image display that shows a holographic image of a flame at the tip of the burner. 10am: "Amazing Sketchbook the Ride": Driving a Cart in a 3DCG Scene Created from a Hand-Drawn Sketch Mayu Asakura and Shinji Mizuno (Aichi Institute of Technology) Biographies BiographiesMayu Asakura  Mayu Asakura graduated from Aichi Institute of Technology in 2020 and is master course student at Aichi Institute of Technology. Her research interests are in computer graphics and human computer interaction.
Shinji Mizuno  Shinji Mizuno is currently a professor at Faculty of Information Science, Aichi Institute of Technology. He received the Ph.D degree from Nagoya University in 1999. He was a Research Associate at Toyohashi University of Technology from 2000 to 2009. His research interests include computer graphics, image processing, virtual reality, and human computer interaction.
Abstract AbstractWe introduce an interactive content "Amazing Sketchbook the Ride", which allows users to drive an actual cart and move freely in a 3DCG scene as if they were immersed in it. The users can create the 3DCG scene for driving by themselves by drawing a sketch of the scene. 10am: Recognition of Gestures over Textiles with Acoustic Signatures Pui Chung Wong and Christian Sandor (City University of Hong Kong) and Alvaro Cassinelli (School of Creative Media, City University) Biographies BiographiesPui Chung Wong  Pui Chung Wong is a researcher interested in Human-Computer Interaction (HCI) and novel input methods. He completed his PhD in Creative Media, advised by Hongbo Fu and Kening Zhu. After his studies, he became a postdoc in Alvaro Cassinelli’s Augmented Materiality Lab. His work focuses on different topics in HCI, designing, building, and evaluating novel input and interaction for wearables and mobile devices. He believes that by exploring the parameters of different interaction methods more natural interaction can be developed that will improve daily living.
Christian Sandor  Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong's School of Creative Media, where he is directing the Augmented Reality Lab. In October 2020, he was appointed Augmented Reality Evangelist at the Guangzhou Greater Bay Area Virtual Reality Research Institute. Since 2000, his foremost research interest is Augmented Reality, a`s he believes it has a profound impact on the future of mankind. He serves as editorial board member for Computers & Graphics and Transactions on Visualization and Computer Graphics and as a steering committee member for ACM Symposium Spatial User Interaction and IEEE ISMAR.
Alvaro Cassinelli  Alvaro Cassinelli (UY, IT), obtained an Engineering Degree and a PhD in Physics in France. He lead the Meta-Perception group at the Ishikawa-Oku Laboratory, University of Tokyo, specialized on interfaces to enhance human expression, expanding the vocabulary of HCI and the New Media before becoming Associate Professor and director of the Augmented Materiality lab at the School of Creative Media (HK). Awards includes a Grand Prize (9th Japan Media Art Festival), the Excellence Prize (13th Japan Media Art Festival), an Honorary Mention (Ars Electronica), the NISSAN Innovative Award (2010), Jury Grand Prize at Laval Virtual (2011) among others.
Abstract AbstractWe demonstrate a method capable of turning a textured surface into an opportunistic input interface using a machine learning model pre-trained on the acoustic signal generated while scratching different types of fabric. A single and brief audio recording then suffices to characterize both the texture and the gesture that originates. 10am: GroundFlow: Multiple Flows Feedback for Enhancing Immersive Experience on the Floor in the Wet Scenes Tzu-Hua Wang, Tzu-Shan Lee, Jr-Pin Pan, Tzu-Yang Kuo, Hui-Yang Yong, and Ping-Hsuan Han (National Taipei University of Technology, Department of interaction design) Biographies BiographiesTzu-Hua Wang  Tzu-Hua Wang received his B.S. degree in Electronic Engineering from the National Taipei University of Technology in 2020. In addition, he is studying for M.S. at the Department of Interaction Design from the National Taipei University of Technology in 2021. From 2017 to 2019, he was an intern at the HTC Vive R&D Multimedia team. In 2013, he was a summer intern at Siemens ME Team and EE Team in Germany and Taipei. He has been on the faculty of Electronic Engineering and Electrical Engineering. His research interests include Human-Computer Interaction(HCI), Virtual Reality, and Multisensory Technology.
Tzu-Shan Lee  Lee, Tzu-Shan received her BA. in Interaction Design at the National Taipei University of Technology. Has 1 year of experience in visual and UI design and be in participated in websites and apps development projects. Her current research interests include Human-Computer Interaction (HCI), Virtual Reality (VR), and User Interface Design.
Jr-Pin Pan  Jr-Pin Pan received her BA. in Interaction Design at the National Taipei University of Technology. Her current research is Structural design and Material processing applications.
Tzu-Yang Kuo  Tzu-Yang Kuo received his BA. in Interaction Design at the National Taipei University of Technology. His current research interests include Game Development, Modeling, and Virtual Reality (VR), and he also gets exposure to 3D Printing and Laser cutting.
Hui-Yang Yong  Hui-Yang Yong majors in Interaction Design at the National Taipei University of Technology. She works at the furniture design company as an intern. Her current research interests include Virtual Reality (VR), Computer Generated Imagery (CGI), and Motion graphics design.
Ping-Hsuan Han  Ping-Hsuan Han received his Ph.D. at the Graduate Institute of Networking and Multimedia at National Taiwan University, M.S. from Master Program in Toy and Game Design, and B.S. from the Department of Digital Technology Design all at National Taipei University of Education. He is an Assitant Professor in the Department of Interaction Design at the National Taipei University of Technology. His current research interests include Human-Computer Interaction (HCI), Virtual Reality (VR), Mixed Reality (MR), and Multisensory Technology, and he also focuses on Creativity in Engineering Education.
Abstract AbstractWe present GroundFlow, a water recirculation system that provides multiple flows feedback on the floor in immersive virtual reality. Our demonstration also implemented a virtual excursion that allows users to experience different water flows and their corresponding wet scenes. 10am: VWind: Virtual Wind Sensation to the Ear by Cross-Modal Effects of Audio-Visual, Thermal, and Vibrotactile Stimuli Juro Hosoi, Yuki Ban, Kenichi Ito, and Shin'ichi Warisawa (The University of Tokyo) Biographies BiographiesJuro Hosoi  Juro Hosoi received his bachelor of engineering degree from the Faculty of Engineering, the University of Tokyo in 2021. He is a master course student of the Graduate School of Frontier Sciences, the University of Tokyo now. His research interest is improving a sense of presence in virtual reality by presenting feelings of various winds.
Yuki Ban  Yuki Ban received the M.S. degree and the Ph.D. degree in Information Science and Technology from the University of Tokyo, Tokyo, Japan, in 2013 and 2016, respectively. He was a researcher at Xcoo inc. research from 2016 to 2017. He is currently an Assistant Professor of Graduate School of Frontier Sciences at the University of Tokyo. His current research interests focus on modifying spatial perception using the visuo-haptic interaction.
Kenichi Ito  Kenichi Ito received a Master of Environmental Studies degree from the Graduate School of Frontier Sciences, the University of Tokyo in 2021.
He is a doctoral student of the Graduate School of Frontier Sciences, the University of Tokyo now.
His research interest is improving presence and immersion of virtual reality by presenting the feelings of wind.
Shin'ichi Warisawa  Prof. Warisawa is a professor of Department of Human and Engineered Environmental Studies at the University of Tokyo. From April of 1994 to March of 2000, he served as an Assistant Professor of Tokyo Institute of Technology, from April of 2000 has been working at the University of Tokyo. He was a visiting researcher at Massachusetts Institute of Technology from 2010 to 2011, and a visiting professor at Université Jean Monnet in 2016. His current research focuses on wearable/ambient human health monitoring. Research cores are nano/micro sensing devices fabrication and sensing information technology application for human well-being.
Abstract AbstractWe propose to present virtual wind sensation by cross-modal effects. We developed VWind, a wearable headphone-type device to give vibrotactile and thermal stimuli in addition to visual scenarios and binaural sounds. We prepared the demonstrations as if users were blown to the ear or exposed to freezing winds. 10am: Real-time Image-based Virtual Try-on with Measurement Garment Toby Chong, I-Chao Shen, Yinfei Qian, Nobuyuki Umetani, and Takeo Igarashi (University of Tokyo) Biographies BiographiesToby Chong  PhD student at The University of Tokyo
I-Chao Shen  Postdoc at The University of Tokyo
Yinfei Qian  Master student at The University of Tokyo
Nobuyuki Umetani  Associate professor at The University of Tokyo
Takeo Igarashi  Professor at The University of Tokyo
Abstract AbstractWe propose a robust real-time Image-based virtual try-on system. We formulate the problem as a supervised image-to-image translation problem using a measurement garment, and we capture the training data with a custom actuated mannequin. The user only needs to wear a measurement garment to try on many different target garments. 10am: Depth-Aware Dynamic Projection Mapping using High-speed RGB and IR Projectors Sora Hisaichi (Tokyo Institute of Technology); Kiwamu Sumino, Kunihiro Ueda, Hidenori Kasebe, Tohru Yamashita, and Takeshi Yuasa (Tokyo Electron Device); Uwe Lippmann (Fraunhofer Institute for Applied Optics and Precision Engineering); Petra Aswendt and Roland Höfling (Vialux GmbH); and Yoshihiro Watanabe (Tokyo Institute of Technology) Biographies BiographiesSora Hisaichi  Sora Hisaichi is a Master student at Tokyo Institute of Technology. He received his Bachelor’s degree from the same university in 2020. He is interested in the research fields of augmented reality.
Kiwamu Sumino  He works at Tokyo Electron Device.
Kunihiro Ueda  He works at Tokyo Electron Device.
Hidenori Kasebe  He works at Tokyo Electron Device.
Tohru Yamashita  He works at Tokyo Electron Device.
Takeshi Yuasa  He works at Tokyo Electron Device.
Uwe Lippmann  He works at Fraunhofer Institute for Applied Optics and Precision Engineering.
Petra Aswendt  She works at Vialux GmbH.
Roland Höfling  He works at Vialux GmbH.
Yoshihiro Watanabe  Yoshihiro Watanabe is an Associate Professor at Tokyo Institute of Technology. He received his Ph.D. degree from University of Tokyo in 2007. He is the leader of the Latent Sense Lab, a research group exploring the possibilities to invoke a new sense of reality based on the advanced technology centering on visual sensing. His group invents a new type of augmented reality based on dynamic projection mapping by fusing the special high-speed vision and projection technologies.
Abstract AbstractWe report a new system combining a camera, an RGB projector, and a newly developed high-speed IR projector. Moreover, we realize a 0.4-ms markerless 3D tracking by leveraging a small inter-frame motion. Based on these technologies, we demonstrate flexible, depth-aware dynamic projection mapping on the entire scene with 8-ms latency. 10am: Simultaneous Augmentation of Textures and Deformation Based on Dynamic Projection Mapping Leo Miyashita, Kentaro Fukamizu, and Masatoshi Ishikawa (The University of Tokyo) Biographies BiographiesLeo Miyashita  Leo Miyashita researches how to create realistic digital visualizations that are mapped onto real-world objects. He is Research Manager of the System Vision Design Research Group at The University of Tokyo (Japan), where he also obtained his award-winning Ph.D.
Kentaro Fukamizu  Kentaro Fukamizu researches high-speed computer graphics with optical illusions. He studied at The University of Tokyo (Japan) and now works at sony.
Masatoshi Ishikawa  Masatoshi Ishikawa researches massively parallel high-speed vision, high-speed Intelligent robots, dynamic Interaction, optics in computing. He is a project professor at The University of Tokyo.
Abstract AbstractWe exploit human perception characteristics and dynamic projection mapping techniques and realize simultaneous overwriting of both textures and deformation of a real object.
With the developed 1000fps low-latency projector-camera system, we demonstrate that a plaster figure turns into a colorful and flabby object by the projection. 10am: The Aromatic Garden, Exploring new ways to interactively interpret narratives combining olfaction and vision including temporal change of scents using olfactory display Saya Onai (Tokyo Institute of Technology), Nathan Cohen (The University of Arts London), and Takamichi Nakamoto (Tokyo Institute of Technology) Biographies BiographiesSaya Onai  Saya Onai received the B.E. degree and pursuing the M.E. degree in information and computer engineering with the Tokyo Institute of Technology, Tokyo, Japan.
Nathan Cohen  Nathan Cohen - Interests: Art, science, technology and well-being, olfaction, perception, interactive installation, transdisciplinary collaboration.
An artist and educator engaged in transdisciplinary research in collaboration with scientists, including olfaction, memory and visual perception, with recent collaborative projects in Japan including: Olfactory Art, Science and Well-Being Research (Tokyo Institute of Technology, WRHI Visiting Professor) and Retro-Reflective Projection interactive installation (Tachi Lab @ Tokyo University; Keio University, Visiting Researcher).
The painted constructions and installations exhibited internationally explore ambiguities in interpretation of space, including site specific artworks that challenge spatial perception in architectural environments.
Takamichi Nakamoto  Takamichi Nakamoto received his B.E. and M.E. degrees in 1982 and 1984, respectively, and his Ph.D. degree in electrical and electronic engineering from Tokyo Institute of Technology, Tokyo, Japan. He worked for Hitachi from 1984 to 1987. In 1987, he joined Tokyo Institute of Technology as a Research Associate. In 1993, he became an Associate Professor with the Department of Electrical and Electronics Engineering, Tokyo Institute of Technology. From 1996 to 1997, he was a Visiting Scientist at Pacific Northwest Laboratories, Richland, WA, USA. He is currently a Professor with Institute of Innovative Research, Tokyo Institute of Technology.
Abstract AbstractNakamoto Laboratory (Tokyo Institute of Technology) present a multi-sensory olfactory game, ‘The Aromatic Garden’, offering a unique user experience through the combination of new olfactory technology and art. Players must use their sense of smell to navigate and collect scents, presenting an engaging and challenging experience. 10am: Weighted Walking: Propeller-based On-leg Force Simulation of Walking in Fluid Materials in VR Pingchuan Ke, Shaoyu Cai, and Lantian Xu (School of Creative Media, City University of Hong Kong) and Kening Zhu (City University of Hong Kong) Biographies BiographiesPingchuan Ke  Ke Pingchuan (Patrick) is a PhD student under the supervision of Dr. Kening Zhu at School of Creative Media, City University of Hong Kong. His current projects focus on Virtual and Augmented Reality(VR/AR), User Interface(UI) and other areas of Human-Computer Interaction (HCI). At the same time, he is also interested in research areas of new media art, interaction design, game and animation design.
Shaoyu Cai  Shaoyu Cai is a PhD student under the supervision of Dr. Kening Zhu at the School of Creative Media, City University of Hong Kong. His research interest lies in the field of Human-Computer Interaction (HCI), especially for Cross-modal Learning (e.g., from vision to touch) and Multi-modal Interaction through Deep Learning methods.
Lantian Xu  Lantian Xu (Alston) is currently a first year Ph.D. student under the supervision of Dr. Alvaro Cassinelli and Dr. Kening Zhu at School of Creative Media, City University of Hong Kong where he also obtained his BSc degree in 2020. His current research focuses on remote collaboration and sense of presence in mixed reality.
Kening Zhu  Kening Zhu is an Associate Professor at the School of Creative Media, and jointly appointed by the Department of Computer Science, City University of Hong Kong. He leads the Multimodal and Embodied Interaction Lab (MEI Lab). He received his PhD degree from the National University of Singapore, and his bachelor degree on Computer Science from Huazhong University of Science and Technology, China.
Abstract AbstractWeighted Walking is a wearable device with ducted fans on the user's calf. The fans can generate powerful thrust to simulate the forces caused by the user's lower limbs moving in different fluid materials. It can also simulate the walking experience in different gravity conditions, such as in another planet. 10am: Self-Shape-Sensing Device with Flexible Mechanical Axes for Deformable Input Interface Hideki Mori, Yoshihisa Takahashi, Koichi Shiono, Hirofumi Kaneko, Hiroya Matsugami, and Masaomi Nishidate (Sony Interactive Entertainment Inc.) Biographies BiographiesHideki Mori  Hideki Mori is a senior UX researcher at Sony Interactive Entertainment. He is responsible for R&D of new UX/UI for games and interactive media since 2016.
He also has experience as a researcher of signal processing algorithms and a product planner in charge of entire UX.
Based on his expertise both in business and technology fields, now he has a passion for developing new UX based on unique technology.
2016–current Senior Researcher, UX/UI. Sony Interactive Entertainment
2008–2016 Product Planner/Manager, New category and home entertainment products. Sony Corporation
2002–2008 Researcher, Video signal processing by machine learning. Sony Corporation
Yoshihisa Takahashi  Yoshihisa Takahashi is a software engineer working for the Future Technology Group at Sony Interactive Entertainment Inc.
His research interests include 3D interaction, physical computing and tangible UI.
Koichi Shiono  Senior Researcher (Hardware/Image Sensor), Sony Interactive Entertainment
Hirofumi Kaneko  Hirofumi Kaneko is a researcher and software engineer of Sony Interactive Entertainment, and currently working on developing an interactive device system. He obtained a master's degree in engineering from Tokyo Metropolitan University in 2019. His research interests in master's course included the development of electrical haptic displays, virtual reality and ultra reality.
Hiroya Matsugami  Hiroya Matsugami is a software engineer at Sony Interactive Entertainment.
He has been developing video games at SCE and SIE since 2000.
Masaomi Nishidate  2020-current Artist/Director of R&D team: Sony Interactive Entertainment
1999-2020 Artist/Technical Solution Section Manager: Sony Interactive Entertainment WorldWide Studios Japan Studio
Abstract AbstractA novel device that is capable of sensing its own shape, structured around a flexible mechanical axis that allows for its deformation within a wider degree of freedom and enables its tangible control by hand. Users can interact with volumetric images on spatial display intuitively by changing device shape. 10am: DroneStick: Flying Joystick as a Novel Type of Interface Evgeny Tsykunov, Aleksey Fedoseev, Ekaterina Dorzhieva, Ruslan Agishev, and Roman Ibrahimov (Skolkovo Institute of Science and Technology); Derek Vasquez (Brigham Young University); and Luiza Labazanova and Dzmitry Tsetserukou (Skolkovo Institute of Science and Technology) Biographies BiographiesEvgeny Tsykunov  Evgeny Tsykunov received the Ph.D. degree in Engineering Systems from the Skolkovo Institute of Science and Technology, Moscow, Russian Federation, in 2021. His research interests include swarm of drones, haptics, and computer vision.
Aleksey Fedoseev  Aleksey Fedoseev received the M.Sс. degree in Space and Engineering Systems from Skolkovo Institute of Science and Technology, Moscow, Russia, in 2020. In addition, he completed a personnel exchange Monodukuri Engineer Human Resource Program in Kindai University, Japan. He is currently working towards the Ph.D. degree in the Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology. His research interests include human-robot interaction and haptic devices.
Ekaterina Dorzhieva  Ekaterina Dorzhieva is currently a MS student in the Department of Space and Engineering Systems, Skolkovo Institute of Science and Technology (Skoltech). She received the Bachelor Degree in Automation Engineering from the Bauman Moscow State Technical University in 2020. Ekaterina's research interests include robotics, haptics, and swarm of drones.
Ruslan Agishev  Ruslan Agishev is currently a researcher at Czech Technical University in Prague. He received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2020. His research interests include drone control, mobile robotics, path planning, and collision avoidance.
Roman Ibrahimov  Roman Ibrahimov is currently a PhD student at Purdue University. He received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2020. His research interests include multi-agent systems, flying robots, and Machine Learning.
Derek Vasquez  Derek Vasquez is a Ph.D. student in mechanical engineering at Florida State University in Tallahassee, Florida. He received a B.S. (2020) in mechanical engineering from Brigham Young University. Derek is interested in robotics, control, and biologically inspired design, and he is currently researching mode transitions for multi-modal legged robots.
Luiza Labazanova  Luiza Labazanova is currently a PhD student at Hong Kong Polytechnic University. She received the M.Sc. degree from Skolkovo Institute of Science and Technology (Skoltech) in 2019. Her research interest includes swarm of drones, soft robotics, and haptics.
Dzmitry Tsetserukou  Dzmitry Tsetserukou received the Ph.D. degree in Information Science and Technology from the University of Tokyo, Japan, in 2007. From 2007 to 2009, he was a JSPS Post-Doctoral Fellow at the University of Tokyo. He worked as Assistant Professor at the Electronics-Inspired Interdisciplinary Research Institute, Toyohashi University of Technology from 2010 to 2014.
He is currently working as Associate Professor at Skoltech. He received such prestigious Awards as Best Demonstration Award (Honorable Mentions, ACM SIGGRAPH Asia 2019), Best Demonstration Award (Bronze Prize AsiaHaptics 2018), Laval Virtual Awards (ACM SIGGRAPH 2016), and a Best Paper Award (ACM Augmented Human 2010).
Abstract AbstractDroneStick is a novel hands-free method for smooth interaction between a human and a robotic system via one of its agents. A flying joystick (DroneStick) being a part of a multi-robot system is composed of a flying drone and coiled wire with a vibration motor. 10am: Parallel Ping-Pong: Demonstrating Parallel Interaction through Multiple Bodies by a Single User Kazuma Takada (Sony Computer Science Laboratories, Inc.; Meiji University); Midori Kawaguchi (Keio University Graduate School of Media Design); Yukiya Nakanishi (Sony Computer Science Laboratories, Inc.; Keio University); Akira Uehara (Sony Computer Science Laboratories, Inc.); Mark Armstrong (Sony Computer Science Laboratories, Inc.; Keio University Graduate School of Media Design); Adrien Verhulst (Sony Computer Science Laboratories, Inc.); Kouta Minamizawa (Keio University Graduate School of Media Design); and Shunichi Kasahara (Sony Computer Science Laboratories, Inc.) Biographies BiographiesKazuma Takada  Kazuma Takada is a research assistant at Sony Computer Science Laboratories, Inc. He is also a master's candidate at the Frontier Media Science Program of Meiji University. His research focuses on the elucidation of "Self" and its augmentation using computers from the perspective of Human-Computer Interaction and Embodied Cognitive Science.
Midori Kawaguchi  Midori Kawaguchi, Ph.D., researcher at the Keio University Graduate School of Media Design. Received her Ph.D. in Information and Communications Engineering from the University of Tokyo Institute of Technology in 2020. Her research focuses on human augmentation.
Yukiya Nakanishi  Yukiya Nakanishi is a graduate student at the Keio University Faculty of science and technology. His research focuses on human interaction, sensing system. He recently researches about human-robot interaction, integration and parallel embodiment. He is also a research assistant at Sony Computer Science Laboratories Inc.
Akira Uehara  Akira Uehara, Ph.D., Adjunct researcher at Sony Computer Science Laboratories, inc. Interaction designer at Sony Group Corporation. Received his Ph.D. in Engineering from the University of Tsukuba in 2020. His research focuses on interaction with autonomous system such as AI and robots utilized Cybernics that enhance, strengthen, and support physical and cognitive functions of human beings, based on the fusion of human, machine, and information systems. His research has been awarded in the academic fields of biomedical engineering and systems integration.
Mark Armstrong  Mark Armstrong is a PhD Student at the Keio University Graduate School of Media Design. A creative technologist, he has developed spatial augmentation systems that promote physical and virtual environmental coexistence through holographic projection interfaces as a member of the Embodied Media Project. His research focuses on the use of emerging technologies to achieve human multi-presence, avatarization, and parallel embodiment. Mark recently served as a research assistant at Sony Computer Science Laboratories Inc., and in his spare time, he also teaches coding, robotics, digital arts, and music production to international students aged 4-17.
Adrien Verhulst  Adrien Verhulst received a PhD in Computer Science at the École Centrale de Nantes in 2018. He then worked as a project researcher at the University of Tokyo. He is now working at Sony Computer Science Laboratories. His research interest focuses on Embodiment in Virtual Reality.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
Shunichi Kasahara  Shunichi Kasahara Ph.D. Researcher, Group leader at Sony Computer Science Laboratories, Inc. Received his Ph.D. in Interdisciplinary Information Studies from the University of Tokyo in 2017. He is leading “Superception” research: computational extension of human perception and investigation of the self in human-computer integration. The result of his research has been presented at the major international conferences in the fields of computer graphics, human-computer interaction, and media technology festivals. He also conducts interactive exhibitions and social implementation.
Abstract AbstractParallel Ping-Pong is a Parallel Interaction with multiple bodies (here 2 robots arms) controlled by a single user. To reduce the user workload when controlling multiple bodies, we added (1) an automatic view transition between the bodies' viewpoints, and (2) an autonomous body motion integrating the user motion. 10am: Integration of stereoscopic laser-based geometry into 3D video using DLP Link synchronisation Jayson Haebich, Christian Sandor, and Alvaro Cassinelli (City University of Hong Kong) Biographies BiographiesJayson Haebich  Jayson Haebich is an artist and researcher who is interested in the intersection of art, technology, and science. Using light he explores how space, light, and form interact to create immersive light installations. Currently working at the XR-Lab at City University of Hong Kong on interactive augmented reality projects that use light in new and exciting ways. previously he has presented work worldwide including at the Salisbury Cathedral, Bauhaus Dessau, Somerset House, British Film Institute, and in smaller galleries and institutions across Europe, Australia, and China.
Christian Sandor  Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong’s School of Creative Media, where he is co-directing the Extended Reality Lab (https://xr-lab.org) together with Associate Professor Alvaro Cassinelli. Since the year 2000, his foremost research interest is Augmented Reality, as he believes that it will have a profound impact on the future of mankind.
Alvaro Cassinelli  Alvaro Cassinelli was born in Montevideo (Uruguay) in 1972. In 1990 he earns both a French and Uruguayan B.Sc., and a grant to pursue his studies in France. He obtains a Graduate Engineering diploma from the Ecole Nationale Supérieure des Télécom (now Télécom ParisTech) in 1996, completing the same year a Doctoral Qualifying Degree (DEA/Master) in Physics (Laser & Matter Interaction) from the University of Paris-XI, Telecom and Ecole Polytechnique. In 2000 he receives a Ph.D degree from the University of Paris-XI Orsay.
Abstract AbstractIn this work, we demonstrate a laser-based display integrating stereoscopic vector graphics into a dynamic scene generated by a conventional 3d video projection system. These laser graphics are projected with a galvo-laser system which exhibits far greater brightness, contrast and acuity compared to pixelated projectors. 10am: From our deceased bodies flowers will grow, we are in them and that is eternity. Wade Marynowsky (University of Technology Sydney) Biography BiographyWade Marynowsky  Dr Wade Marynowsky is an artist, academic and researcher working across digital media, including robotics, immersive and interactive performance / installation, music and video.
His main body of research explores the notion of robotic performance agency by challenging traditional notions of classical spectatorship and performance. Through the use of humour, irony and a host of unnerving thematics he addresses important issues relevant to our ever increasing technological society.
Dr Marynowsky has exhibited nationally and internationally since 1998, with his work being presented in major festivals, biennales and survey exhibitions around the world. He is also a lecturer in Interactive Design, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney.
Abstract AbstractThe artist has purposely input photography of local flowers into the Portrait AI engine, forcing it to find faces where there are none. The sequence flows from machine abstraction to the representation of faces, confusing the threshold of anthropomorphism, human's innate tendency to see faces in the world around us. 10am: Aurora Australis Ultimo Choro John McCormick (Wild System, Swinburne University of Technology); Adam Nash (Wild System); and Stephen Jeal and Kim Vincs (Swinburne University of Technology) Biographies BiographiesJohn McCormick  John McCormick is a technology based artist with a major interest in movement. John has collaborated on works worldwide, including at International Symposium of Electronic Art (ISEA), ZERO1SJ, SIGGRAPH, Melbourne Festival, Venice Biennale, Siggraph Asia, Ars Electronica Futurelab, Tokyo International Forum and Art Science Museum Singapore. John’s current artistic work explores human robot interaction mediated by mixed reality environments. John was an Australian Antarctic Research Fellow in 2020 supported by the Australian Antarctic Division and Australian Network for Art and Technology. John was lucky enough to travel on the last Australian Antarctic voyage of the research vessel Aurora Australis to the Antarctic continent. John is currently a lecturer and researcher in the Centre for Transformative Media Technologies at Swinburne University of Technology where he investigates artistic practice in mixed reality environments, robotics, artificial intelligence and human action.
Adam Nash  Adam Nash is a digital artist, composer, programmer, performer, teacher and writer. He is widely recognized as one of the most original artists working in virtual environments and mixed-reality technology, exploring them as sites of playable art. Working in a post-convergent idiom, he uses the web, game engines, virtual environments, generative and procedural programming, data and motion capture, artificial intelligence, synthetic evolution, audio, vision and live performance.
His work has been presented in galleries, festivals and online in Australia, Europe, Asia and The Americas, including SIGGRAPH, ISEA, 01SJ, the Venice Biennale, the National Gallery of Victoria and the National Portrait Gallery of Australia. He has been artist in residence at Ars Electronica FutureLab and was shortlisted for the National Art Award in New Media at the Queensland Gallery of Modern Art.
Stephen Jeal  Stephen Jeal is a technical artist and teacher, specializing in 3D modelling, motion capture and visual effects for both film and games. Stephen has a knack for problem-solving and an eye for artistic and technical detail which he applies to all his projects.
Kim Vincs  Kim Vincs is a leading researcher in the creative arts, with collaborations across motion capture, game development, robotics, haptics, app design, 3D stereoscopy, artificial intelligence, virtual reality, augmented reality, cognitive psychology, biomechanics, mathematics, architecture and exercise science.
She has commercial motion capture credits including the Cannes Silver Lion winning Nocturnal Migration. Kim integrates scientific, technological and artistic methodologies to deliver innovative research to digital and performing arts industries, companies and communities. Her work spans creative technology for performance, digital scenography, VR, AR and robotics applications for motion capture technology. Recent works include The Crack Up, premiered at the Merlyn Theatre, Coopers Malthouse; Multiverse, with Garry Stewart and Australian Dance Theatre and 3D digital scenography for Victorian Opera’s production The Flying Dutchman and Four Saints in Three Acts, 2016. Her works have been shortlisted for Greenroom, Australian Dance and AEAF awards. The Flying Dutchman was a finalist in Unity’s 2015 Unite.
Abstract AbstractAurora Australis Ultimo Choro depicts the final Australian voyage of the RSV Aurora Australis to the Antarctic continent. An immersive visual and sonic feast of three-dimensional VR environments and spatial sound visualising and sonifying the last grand Antarctic dance of the Aurora Australis, crew and expeditioners. 10am: 在别处/ Escaping to another Biin Shen (Independent Artist)  Biography BiographyBiin Shen  Shen is an artist whose practice circulates between art, design, technology and social issues. She received her MA in design interactions , following her time with Professor Dunne & Raby at the Royal College of Art in London. In 2013, she was featured as the guest speaker for LondonDesignWeek to represent young Chinese creators. Her work has been exhibited in events/institutions worldwide, including European Alternatives, SALON(NL),TOKYO GALLERY+BTAP, Shanghai Expo, Beijing World Art Museum and more. In 2020, she was selected as the first and only media artist to represent China in the UNESCO Creative City project. Since 2012, she has used her creative practice to participate in debates about issues that are of increasing urgency today. Besides her installations, curation has become one of the mediums within her practice; she has also been writing for art/public media platforms to share her unique thoughts on the relationship between technology and humanity.
Abstract Abstract"Escaping to another" is a live stream installation created during the epidemic. Consists of a hanging screen in a dark space, that continuously shows Skies from different cities in real time, thus composing a mixed reality landscape between machine and the human imagination. 10am: Iris Yamin Xu (Bowling Green State University) Biography BiographyYamin Xu  Yamin Xu is an artist and electronics geek, working on the edge that blurs animation, coding, and electronics with an emphasis on the exploration of emerging technology and art. He strives to create and define new things, which have not been clearly perceived as art. This motivation is sustained by his rigorous art/engineering practice, which is informed by the convergence of divergent spheres of study: religion and science, privacy and surveillance, the robotic and organic. The result is an innovation - feedback to affect and expand his understanding and definition of art.
Before he earned his MFA in the United States researching computer vision, he obtained a BA in art and design. His experience includes being a VFX artist at CCTV, an instructor at Peking University, and a researcher at Argonne National Laboratory. Currently, he is an Assistant Professor in the Digital Arts program at Bowling Green State University.
Abstract AbstractAs an experiment of "bring on-screen animation closer to physical", the iris is given independent perception and temperament. By measuring physiological signals of the wearer, its mood is affected by the wearer. Depending on itself and the wearer's feeling, iris performs different responses, which affects interpersonal interactions and relationships. 10am: Volume II of Voids shaoyu su (University of Southern California) and Weidi Zhang (university of california, santa barbara)   Biographies Biographiesshaoyu su  Shaoyu Su is a new media artist, cinematographer, and curator. His artistic practices and research employ interdisciplinary methodologies from computer graphics, photography, physics, and literature, investigating concepts about deep space-time-mining: alternative projection from ancient history to the far future. His works have been shown internationally, at venues such as J.Paul Getty Museum, International Symposium on Electronic Art(ISEA), IEEE PacificVis, Today Art Museum Beijing, and Vortex Immersion Dome L.A.
Weidi Zhang  Weidi Zhang is an LA-based new media artist, visual designer, and researcher. Her current research and media art practices investigate the possibilities of semantic meanings and non-linear narrativity of assemblage art in the context of Intelligence system design, immersive media, and interactive generative art. Her works are featured at different international venues, such as the SIGGRAPH, SIGGRAPH ASIA, ISEA, Times Art Museum, IEEE VISAP, SwissNex Gallery, Japan Media Art Festival, and shortlisted in Lumen Prize. Currently, she is a Ph.D. candidate in the Media Arts and Technology Program and a researcher in Experimental Visualization Lab. She holds her MFA degree in Art + Technology at California Institute of the Arts.
Abstract AbstractVolume II of Voids is an intelligent interactive art experience that is generated based on the voids between humans. The project is realized by using volumetric capturing, real-time visualization, and machine learning algorithms. 10am: Siren Wenqian GAO (studio Gao Wenqian, Beijing Institute of Fashion Technology (BIFT)) Biography BiographyWenqian GAO  Gao Wenqian
Bron in ShanDong, China
Education
2009-2013 Academy of fine art of China.
2015-2019 École national supérieur des beaux-arts de paris
work and live in Beijing
Abstract AbstractIn the future, is there also the program who use disillusioned human like siren in the virtual world? 10am: SeoulVibe Taeil Lee (Korea University) Biography BiographyTaeil Lee  He studied Industrial Design at KAIST in Daejon, Korea, and Institute of Design, Illinois Institute of Tech in 90's. He has been teaching mainly Industrial Design and Interaction Design for 20+ years in Universities, and working in various projects mostly on UX Design and interactive design applications. He has been interested in Open Source Development tools and environment such as Processing and Arduino along the path, and recently trying to extend the course of interest more towards artistic representation of artifacts.
Abstract AbstractSeoulVibe is an effort to literally feel the city of Seoul. The jacket with over 45 individual units that can sense sounds and convert to vibrations and lights. We experienced various streets of Seoul through the unique sounds they produce and form the city of Seoul. 10am: The Tides Within Us Barnaby Churchill Steel (Marshmallow Laser Feast); Kate Farrell (York Mediale, York Museums Trust); and Bianka Hofmann (Fraunhofer Institute for Digital Medicine MEVIS) Biographies BiographiesBarnaby Churchill Steel  Marshmallow Laser Feast (MLF) create immersive experiences, expanding perception and exploring our connection with the natural world. Fusing architectural tools, contemporary imaging techniques and performance with tactile forms, MLF sculpt spaces that lay dormant until animated by curiosity and exploration. Informed as much by playfulness as research, MLF break the boundaries to worlds beyond our senses.
MLF’s work has been exhibited in the UK and internationally including at the Saatchi Gallery, NXT Museum, Lisbon Triennial, Istanbul Design Biennial, the Sundance Film Festival, and the V&A and Design Museum.
Kate Farrell  York Mediale is an independent arts charity, originally founded in 2016 that works year-round to deliver new commissions, live events and artistic development
Through incorporating technologies into their work, the artists we work with bridge the gap between the new and the traditional, to challenge and inspire. We work alongside artists, building trust through our actions, not just our words, to create lasting relationships, collaborations and partnerships with those who share and champion our values.
Bianka Hofmann  Embedded in a worldwide network of clinical and academic partners, Fraunhofer MEVIS develops real-world software solutions for image and data-supported early detection, diagnosis, and therapy. Strong focus is placed on cancer and the circulatory system, brain, breast, liver, and lung diseases. The goal is to detect diseases earlier and more reliably, tailor treatments to each individual, and make therapeutic success more measurable.
The Institute is committed to raising awareness about how digital transformation influences health care by opening up its R&D and integrating the arts and humanities. The focus is on life-long learning, collaborative production, and scientifically inspired art. Laypersons and experts are invited to get involved, exchange ideas, and disseminate innovative R&D eye-to-eye with the researchers and developers.
Abstract AbstractA cross-sectoral project utilizing high-end MR research results, 'The Tides Within Us' -created by Marshmallow Laser Feast (MLF) and Fraunhofer Institute for Digital Medicine MEVIS-is an ongoing exploration into the world beyond the limits of our senses at the intersection of art, science and technology. 10am: Signal Chin-Hsiang Hu, Zhao-Qing Chang, Che-Wei Hsu, Kuan-Wen Chen, and Yu-Chi Fu (Peppercorns Interactive Media Art) Biographies BiographiesChin-Hsiang Hu  artist, engineer, interactive designer. Desires to focus his artwork on the creation of new media art to examine the over-development of science and technology. Each kind of creative direction expressed a different idea and required the use of different technologies. In terms of integrating technologies, the development of interactive software played a very important role in his development. and to manage the interactive devices, augmented reality, and motion sensors. By combining different artistic forms, he built his creative skills and abilities. He continuously challenged himself to create works that form a dialogue between his personal experiences and new media art. works form the assumption that though the performing arts, interactive art, and visual art are separate disciplines, their combination can give rise to a new form of technology-based performing arts. This also includes a self dialogue that results in a clash between the inner self and external factors.
Zhao-Qing Chang  I accidentally entered the interactive industry. With each project and work as an oppartunity. I saw the laughter of my big friends and children, sa that I realized the nature of 'interaction" and also found the joy of persisting in the fiald of interaction. I like to draw closer to people's relationship through the discussion, learing, sharing and teaching of "interactive tachnolagy".
Che-Wei Hsu  Che-Wei Hsu graduated fromTaiwan University of Science and Technology,Majored in Computer Science and Information Engineering.
He is a creative technologist,interactive engineer and drummer.He focuses on making new media art projects,interdisciplinary performance ,interactive advertising and interactive experiment.He creates works to avoid the boring life and breaking the limit of being human. And tries to find possibilities about hacking senses , human behaviour and acting Chūnibyō style..etc.
Kuan-Wen Chen  Kuan Wen Chen graduated from National Chiao Tung University, Master of Science in Architecture. In college, she majored in Communications Design at Shih Chien University and mainly engaged in digital arts, interactive design, and installation arts. With regard to the style and concept of design, she prefers her projects created in programming so that the works would exhibit properties of real-time and interaction. Also, as an explorer, communicator and connector of design and computer science, Kuan Wen has dedicated herself to applying innovative technology from a designer's perspective and to employing digital tools for opening the world of design to new possibilities.
Yu-Chi Fu  Yu Chi, Fu, a Visual designer based in Taipei, Taiwan.
Recently been focusing on merging human emotions, relationships with various formats, such as 3d art, video art, digital graphics.
Education:
Bachelor of Visual Design, She-Te University, 2018
Experince
Visual Designer / Designer at Peppercorns Interactive Media art
Abstract AbstractAwaiting for light in the darkness(covid-19) is similar to searching for hope(normal life).
The artwork combined with the space, projection, laser, smoke, represent as "Cyber Sea".
The way to interact with the work can be from the data of people’s mobile phone, or the audience who walks into the artwork. 10am: Microbiospheric Engineering Kevin Blackistone (Kunstuniversität Linz) and Amir Bastan (Creative Robotics)   Biographies BiographiesKevin Blackistone  Kevin Blackistone is an intermedia artist exploring uses & impacts of technology and data. He works using backgrounds in 3d animation, video, sound design and creative coding. As a intramural research fellow with the National Institute of Health, Section of Comparative Behavioral Genomics (U.S., 2012-2014) he further developed his coding and research skills and uses this knowledge to inform his present works. He has received production awards for prior works from the Johns Hopkins Saul Zaentz Innovation Fund (Who’s Watching), Ruby’s Arts Awards (Extensions of the Self), and the Baltimore Office of Promotion and the Arts (Radiant Flux).
Kevin received his degree in Intermedia and Digital Arts from the University of Maryland Baltimore County in 2000 and is currently pursuing masters in the Interface Cultures and the Post Digital Lutherie programs at Kunstuniversität Linz.
Amir Bastan  As a new media artist with a background in fine arts and philosophy, Amir explores ways of designing narratives within robotics, computer arts and creative coding. He is a member of the vvvv community as a tutor and contributor. His expertise in 3D animations and real-time interaction design forms a variety of research, artistic and commercials projects. Amir has been working as a programmer and concept developer for artists and art-based studios realizing projects for robotics, data visualisation, generative design, computer vision and physical computing.
Currently, he is a PhD candidate and a researcher at the Creative Robotics Labor UfG–Linz, where he is designing customized and purposeful tools for real-time interaction with robots, ranges from KUKA robotic arms to Spot, the Boston Dynamics quadruple robot.
Amir is teaching “Creative Coding”– a programming course for artist and “Sequence of Meaning”– a theoretical course on analytical approach to new media arts.
Abstract AbstractA merger of micro/macro considerations of our world and the biology present upon it. Microbiospheric Engineering explores human growth using industrial robotics to portray a microbial colonies as the global surface landscapes to which we are accustomed from our own environment. 10am: Strands of Mind Adrian Meyer (Filmakademie Baden-Württemberg) Biography BiographyAdrian Meyer  Adrian Meyer is a multidisciplinary Digital Artist and Filmmaker from Germany. His work is focused on moving images to inspire, and spark emotional experiences; often using a surreal and dark visual language.
Initially working in the field of Audiovisual Installations and Stage Visuals, he also has a broad background in Visual Effects. He has worked on international motion pictures and commercials in Berlin and London.
Adrian graduated in Computer Animation & Visual Effects at Filmakademie Baden-Württemberg. His work was internationally screened at Annecy Animation Festival, Siggraph Electronic Theatre and many more, and received multiple nominations such as the Visual Effects Society Student Award and the Special Jury Prize VR at NewImages Festival Paris.
Abstract AbstractExplore a world beyond the bounds of our human perception. A world full of mystery, of beauty and darkness. Let yourself be taken on a trip into the woven nature of existence. 10am: Goldfish Architecture: Therapeutic Urban Aquaponics Alex Orsholits (the University of Tokyo) and Zhou Li, Kritika Dhupar, Yusuke Obuchi, Chengzhe Zhu, Yusuke Komata, and Shuta Takagi (University of Tokyo) Biographies BiographiesAlex Orsholits  Holder of a Bachelor of Science from the EPFL (Switzerland), and a Master of Engineering from UTokyo, Alex Orsholits is currently a PhD candidate of Obuchi Lab at the University of
Tokyo. His work focuses on implementing new and upcoming technologies to establish functional processes of interfacing innate human perception with computer-based mathematical representations of space within the context of architecture and digital fabrication
Zhou Li  Zhou Li is a Ph.D. student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, Obuchi Laboratory. Prior to the University of Tokyo, he studied architecture at Cornell University and at the University of Southern California, where he acquired his Bachelor of Architecture Degree with honors. He has also worked in the Beijing Institute of Architectural Design and Liang Architecture Bureau+ in Los Angeles.
His work is often centered around sustainability, digital fabrication, and computational design, and ranges from kinetic sculptures to animatronics to architectural and urban design. His work has been awarded numerous honors such as the Director’s Choice Award of the RESIDE Mumbai Mixed Housing International Open Ideas Competition, First Place in the Cornell York Prize Competition, and was selected to be exhibited and collected at the Los Angeles A+D Museum.
Kritika Dhupar  Kritika graduated from the Chandigarh College of Architecture with the Pierre Jeanneret Gold medal for her undergraduate thesis. Her early interests in adaptive reuse and contextual/experiential urban interventions radically expanded with the experience gained from interning in Vienna and later working at prominent practices in New Delhi for five years. She is currently pursuing her masters at the University of Tokyo Obuchi lab, to explore advanced/alternative means of design and production and potential ways to deploy them in the unique constraints and architectural/urban traditions which she hails from.
Yusuke Obuchi  Yusuke Obuchi is an Associate Professor in Architecture at the University of Tokyo, where he has directed Obuchi Laboratory at the Department of Architecture since 2010. He is also a founding Co-director of the Advanced Design Studies Program, which consists of Digital Fabrication Lab, Sustainable Prototyping Lab, Media Initiative Lab, Design Think Tank, Design Practice Lab, Social Design Lab, and Computational Unit. Prof. Obuchi was Co-Director of the Design Research Laboratory at the Architectural Association (AA) in London from 2005 to 2010, and Course Master and Unit Master of the Architectural Association from 2003 to 2005. He studied architecture at Princeton University, Southern California Institute of Architecture, the University of Toronto, and received his Ph.D from the University of Tokyo. He has previously taught at Princeton University, Harvard University’s Graduate School of Design, University of Kentucky, and New Jersey Institute of Technology.
Chengzhe Zhu  Chengzhe Zhu is a Master student at the University of Tokyo, Graduate School of Engineering, Department of Architecture, and a member of Obuchi Lab. He received a Master of Science in Design from the University of Pennsylvania and a Bachelor of Architecture from Tongji University. He participated in several urban regeneration projects during his internship at TJAD Original Design Studio. His academic works centered digital design, analysis and fabrication methods and he is currently exploring novel implementations of digital tools in the process of design and production to make architecture more inclusive and adaptable.
Yusuke Komata  Yusuke Komata is an architect and a researcher based in Tokyo. He graduated from University of Tsukuba Master’s Program in Art & Design, and started working from 2009 at an architects office Arata Isozaki & Associates established by Arata Isozaki, winner of the 2019 Pritzker Prize. Komata has led many projects such as university campus designs in Central Asia and Egypt, an art museum design in Russia, a movable pneumatic concert hall, and so on. After 7 years of working in Arata Isozaki’s office, he founded his own firm called Yusuke Komata New Building Office in 2016 and started designing various projects in many different regions, with in collaboration with many architects and engineers. In 2019, he joined Department of Architecture at University of Tokyo as a researcher in Obuchi Laboratory, and started working for research projects including the UAE pavilion at Venice Biennale 2021.
Shuta Takagi  Commencing his studies at the Tokyo University of Science in 2004, Shuta Takagi developed his skills as an architect and programmer until 2011, and in 2016 founded his firm Takagi Shuta Office LLC. He also works since 2016 as an academic specialist at the University of Tokyo Obuchi Laboratory and provides several lectures on digital design throughout Japan, such as the University of Tokyo, Tokyo University of Science, Kogakuin University, Nagaoka University of Art and Design, Hokkaido University, and Tama Art University.
Abstract AbstractGoldfish Architecture is a digitally augmented and functional vernacular construction that harnesses the therapeutic effects of plants and aqueous pets to propose a future for mindful and sustainable living. The pavilion serves as a prototype for a productive and captivating smart aquaponic appliance that brings together individuals and communities alike. 10am: Mixed Reality Ulysses (or MR Ulysses) Neill O'Dwyer, Gareth W. Young, Aljosa Smolic, and Matthew Moynihan (Trinity College, Dublin; V-SENSE) and Paul O'Hanrahan (Balloonatics Theatre Company) Biographies BiographiesNeill O'Dwyer  Neill O'Dwyer is a Senior Postdoctoral Research Fellow in V-SENSE at Trinity College Dublin (TCD). He is an adjunct lecturer of the School of Creative Arts, where he teaches Performance and Technology. He is an awardee of the prestigious Irish Research Council (IRC) Government of Ireland Research Fellowship (2017 – 2019). He is the sole author of Digital Scenography: 30 years of experimentation and innovation in performance and interactive media (2021). His research focuses on the impact of technology on artistic processes.
Gareth W. Young  Gareth W. Young is a postdoctoral research fellow on the V-SENSE project at Trinity College Dublin. His current research focuses on the evaluation of creative uses for extended-reality technology. This approach includes studying the design and use of XR technology in innovative practices, focusing on the interface between users and the XR platform. Gareth’s role is to observe and record how users interact with XR and design new methods to interact with XR in innovative and novel ways.
Aljosa Smolic  Aljosa Smolic is Professor of Creative Technologies at Trinity College Dublin. His research group V-SENSE focuses on immersive XR and deep learning for visual computing by combining computer vision, computer graphics, and media technology. He was Senior Research Scientist for Disney Research Zurich and Head of the Advanced Video Technology group. With Fraunhofer Heinrich-Hertz-Institut (HHI) Berlin, he headed a research group as Scientific Project Manager. He has published over 250 peer-reviewed papers and filed over 40 patents.
Matthew Moynihan  Matthew Moynihan is a PhD Candidate in the V-SENSE project at Trinity College Dublin. His research involves the development and refinement of Volumetric Video and Performance Capture systems. Specifically, this research aims to leverage temporal information to improve the quality and efficiency of volumetric sequences. Matthew also holds a BSc in Physics and an MEng in Electronic systems from Dublin City University (2011-2017), where both degrees had a focus on Computer Vision. Having worked on industry-focused applications prior to his PhD, Matthew hopes to continue extending his research into more creative fields.
Paul O'Hanrahan  Dr. Paul O’Hanrahan, artistic director of Balloonatics Theatre Company, is an award-winning actor and director who specialises in the in-situ performance of Irish writers, particularly James Joyce and Samuel Beckett. He is particularly interested in place and memory studies and has a doctorate combining German and Contemporary Literature Studies from the University of Liverpool. He has Edinburgh Fringe First Awards for productions based on Joyce’s Ulysses and Finnegans Wake. In 2014 he devised the inaugural Beckett Walk for Dun Laoghaire-Rathdown Council and has led this guided tour for the last eight years.
Abstract Abstract'MR Ulysses' is an innovative performance experiment hybridizing theatre and volumetric video, enabling individuals to experience a live-action re-enactment of James Joyce's 'Ulysses' in VR. Audiences are invited to don an HMD, embody the character of Stephen Dedalus, and engage Buck Mulligan in Joyce's famous Martello tower-top scene. 10am: Ethereal Phenomena Silvana Malaver (Keio University Graduate School of Media Design); Natalia Barragán Nieto (Universidad de los Andes); Igor Igorevich Segrovets (Tokyo Institute of Technology); Carlos Rizzi (Sabana Records); and George Chernyshov, Christopher Changmok Kim, and Kai Kunze (Keio University Graduate School of Media Design) Biographies BiographiesSilvana Malaver  Silvana Malaver is a multidisciplinary artist and Ph.D student at the Graduate School of Media Design, Keio University, Yokohama, Japan. Her research and creative process mainly focus on exploring how to produce altered states of consciousness through diverse media artworks, from poetry and essay-films to interactive installations. She Majored in Literature at Universidad de Los Andes, Bogota, Colombia, and obtained a Master in Japanese Culture at the Graduate School of Humanities and Social Sciences, Saitama University, Saitama, Japan, where she specialized in Buddhism and Media Art. At Keio Media Design she is part of the project "Geist" ("mind" or "spirit" in German) that works on augmenting human capacities by combining cognitive science, psychology, and technology.
Natalia Barragán Nieto  Natalia Barragán Nieto. 1994. Gemini. Bogota, Colombia. Languages: SP_ENG_FR. Spirituality and esoterism. Tea and bubbles. Plants. Where things come from. Electronic music. Intuitively rational. Rationally intuitive. Communications designer, aesthete.
I don’t believe in coincidences. I believe in the alignment of specific factors at a specific moment: synchronicity. I believe that life is the result of a constant decision-making process, which is done both consciously and unconsciously. It is an eternal quest in order to achieve equilibrium and equanimity. I believe in what I create, consisting of a dialog between the analog and the digital, between reality and fiction, between images, sounds and words.
Igor Igorevich Segrovets  Igor Segrovets joined the Ethereal Phenomena project in the role of programmer and was responsible for curating the installation to be engaging, seamless and aesthetically pleasing. Igor’s contribution included technically realising the vision of a gamified, live and interactive meditation experience. This is Igor’s first contribution to human-computer interaction. In the past, while dreaming of becoming a rocket scientist, Igor completed his Bachelor degrees in Aerospace Engineering and Physics from The University of Queensland in Brisbane, Australia. During this time, Igor designed projects for teams researching photo-computing at The University of Queensland and quantum-sensing at Australian National University. Currently, Igor is completing a Masters degree in Mechanical Engineering at the Tokyo Institute of Technology, Tokyo, Japan. There, Igor's project with Onishi Laboratory simulates the turbulent dynamics of wind around city trees with the aim of realising real-time micro-scale weather prediction.
Carlos Rizzi  Carlos Rizzi is an electronic music producer, performer and multi instrumentalist from Bogotá, Colombia. He studied classical composition at the Pontificia Universidad Javeriana in Bogotá and Electronic Music Production and Performance at Catalyst Berlin. His work is based on the exploration of soundscapes and sound design in conjunction with IDM inspired beats, moody sequences and extreme sample manipulation.
He has released an album (Now Here Nowhere) and two EP’s (Tank! and Vestigial).
In 2020, during the Covid-19 pandemic, he and fellow collaborator Mateo Walschburger created Sabana Records, an independent record label focused on promoting left field electronica and avant garde electronic music from Colombia and Latin America.
Carlos Rizzi is currently working as a music producer to a wide variety of projects from artists from Colombia as well as some personal projects such as a sound installation in Bogotá’s National Library, various remixes and a couple of EP’s.
George Chernyshov  George Chernyshov. Postdoctoral at the Graduate School of Media Design, Keio University, Japan.
Your ad could go here.
Christopher Changmok Kim  Christopher Kim, more commonly referred to as Chris by pretty much everyone around him for obvious reasons of convenience, received his bachelor’s degree in Technological Systems Management at Stony Brook University located in Long Island, New York. He also minored in Engineering and Technology Entrepreneurship. He worked as the student database manager and admissions officer of his alma mater for three years before starting graduate school. His main interests lie in the realm of measuring the physiological reactions of people reading works of fiction using unintrusive sensing equipment. He is also interested in working to eliminate technological alienation, and is a big advocate of modular design of technology.
Kai Kunze  Kai Kunze works as Professor at the Graduate School of Media Design, Keio University, Yokohama, Japan where he leads an interdisciplinary research group “Geist”, focusing on Augmented Humans and applied Wearable Computing research. Together with Prof. Thad Starner (Georgia Tech) and Prof. Kristof Van Laerhoven (Siegen University), he serves as the co-chair of the International Wearable Computing Academic Research Community.
Previously, he held an Assistant Professorship working for Prof. Koichi Kise at Osaka Prefecture University, Japan. He received his Ph.D. from Passau University, Germany.
Abstract Abstract“Ethereal Phenomena” is an interactive experience for the expansion of consciousness. The user meditates in front of an illustration based on Tibetan thangka art that reacts to the way they breathe. Through the breathing process, the image becomes an extension of the user’s body and a reflection of their mind. 10am: Aerobanquets RMX Mattia Casalegno (Aerobanquets RMX)  Biography BiographyMattia Casalegno  Mattia Casalegno is an Italian artist known for his sculptures and his immersive, relational, and participatory installations. He often deploys emerging technologies to investigate themes of phenomenology, ecology and cybernetics.
Nominated for the New Technological Art Awards in 2014 and artist-in-residence at Eyebeam in 2015, he received various grants and fellowships from, among others, NEW INC, the Center for Cultural Innovation, Young Italian Artists Network, NYFA, the Elizabeth Foundation for the Arts and the Asia Culture Center in South Korea. In 2018 he was recipient of a Lumen Prize Award.
Casalegno has exhibited in such museums and institutions as MACRO Museum and Auditorium, Italy; Mutek Festival, Canada; Kuandu Museum of Fine Arts, Taiwan; ISEA in S.Korea; Chronus Art Center, China; Cimatics festival and Nuit Blanche in Belgium; Optronica in the UK; Le Cube Museum in France; OFFF in Spain, LACMA, YAA Museum and Satellite Art Fair in the US.
Abstract AbstractAerobanquets RMX is an immersive, multi-sensorial culinary experience focused on taste perception. Aerobanquets RMX is about reframing our perceptions and changing the way we experience food. It is not only a life changing experience, but, in a sense, a tool to reprogram all our perceptive expectations. 10am: “Bodyreath”: An Interactive VR Installation to Experience and Understand People with Autism Huifeng Zhang (School of New Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University)   Biographies BiographiesHuifeng Zhang  My name is Huifeng Zhang. I am a student of Beihang University, in Beijing, China, majoring in digital media art design.
In the process of learning, I have used processing and arduino to do interactive installation works, studied web design, and loved animation creation. My animation works won the first prize in the 8th National College Digital Art Design Competition, but I prefer XR creation and have done VR and AR projects. I hope to study the application of AI and VR in the future and uphold the concept of "combination of art and technology", Contribute to the research results.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract Abstract"Bodyreath" is an interactive VR installation for understanding people with autism. It is divided into two parts, the external projection and the internal VR scenarios. It helps the audience to appreciate the innocence of autistic people in different way and to understand them artistically. 10am: World of Hiroshige Alex Weight, Daniel Flood, and Dylan Neill (UTS Animal Logic Academy) Abstract AbstractStep into the beautiful paintings of the Japanese artist Utagawa Hiroshige. This immersive virtual reality experience invites the participant to interact within the atmospheric world of Hiroshige’s delicate and moving artworks. The project offers a unique way of engaging with the artist’s work and the Ukiyo-e genre of Japanese art. 10am: Virtual Whiskers: Cheek Haptic-Based Spatial Directional Guidance in a Virtual Space Fumihiko Nakamura, Adrien Verhulst, Kuniharu Sakurada, Masaaki Fukuoka, and Maki Sugimoto (Keio University) Abstract AbstractThis paper presents Virtual Whiskers, a spatial directional guidance technique using cheek haptics in a virtual space. We provide haptic stimulation on a cheek using two robot arms attached to a Head-Mounted Display. The robot arms touch a point that corresponds to directional information to present the target's directional cues. 10am: A Walk Alone: A Virtual Reality Simulation Triggering Fear and Stimulating Empathy to Raise Awareness about the Dangers Women Face when Walking Alone at Night Eman Al-Zubeidi, Jinsil Hwaryoung Seo, Julia DeLaney, Dominic Nguyen, Jonathan Konderla, and Jaime Diaz (Texas A&M University) Abstract AbstractA Walk Alone is a virtual reality experience that simulates what it feels like to walk alone at night as a woman. The concept is inspired by the kidnapping and murder of Sarah Everard, a 33-year-old woman whose tragedy reignited an international conversation about women’s safety in March 2021. 10am: Beat Keisuke Itoh (Independent), Hiroko Fujioka (WOWOW INC.), Katsutoshi Machiba (Supership Inc.), and Tetsuya Ohashi (CinemaLeap Inc.) Biography BiographyKeisuke Itoh  VR animation director. Graduated from Tama Art University, Department of Graphic Design. After working as a graphic designer for a manufacturing company, he became a freelance CGI artist in 2012. In 2020/2021, Beat was nominated for the competition section of the 77th Venice International Film Festival and Cannes XR. In 2019, Feather was premiered at the 76th Venice International Film Festival in a Biennale College Selection as the first Japanese film in the VR category. In addition, his works have been screened at numerous film festivals, including the Berlin International Film Festival, Busan International Film Festival,Kaohsiung Film Festival, and SIGGRAPH.
Abstract Abstract“Beat” is a story elaborated from your “Heart”. Viewers experience the work with their hearts in their hands. Viewers encounter a rusted robot without a “heart” to move. Viewers can grant him a new heart by putting theirs on the robot. “Heart” becomes the key to move the story forward. 10am: Indefinately:Indefinately Chenxin Zhang and Lesi Hu (Beihang University) Biographies BiographiesChenxin Zhang  From Beijing University of Aeronautics and Astronautics, she entered the School of New Media Art and Design in 2018 and is a fourth-year college student this year. The research direction is digital media and virtual reality, and he is the chief designer of Indefinately
Lesi Hu  From Beijing University of Aeronautics and Astronautics, she entered the School of New Media Art and Design in 2018 and is a fourth-year college student this year. The research direction is digital media and virtual reality, and he is the chief designer of Indefinately
Abstract AbstractThe work "Indefinitely" tells the epitome of the pollution of the earth and the future city. In the contemporary society, high walls have been built between people, and people living in the city are essentially replicas. 10am: Nachtalb: A multisensory Neurofeedback VR-Interface Paul Morat, Aaron Schwerdtfeger, and Frank Heidmann (Interaction Design Lab, Fachhochschule Potsdam) Abstract AbstractNachtalb is an immersive interface that enables brain-to-brain interaction using multisensory feedback. With the help of a BCI, brain-activity data is measured and visually, tactilely and auditorily translated in VR. This intends to create a feedback-loop that turns brain-activity from data-input into sensory output which directly influences the data-input again. 10am: Room Tilt Stick Kousuke Motohashi, Koyo Mori, and Kenri Kodaka (Nagoya City University) Biographies BiographiesKousuke Motohashi  Motohashi Kosa is a graduate student in the Graduate School of Design and Architecture, Nagoya City University. He is interested in distorting subjective gravity using HMD technology based on the physical interaction.
Koyo Mori  Koyo Mori is a researcher in the Graduate School of Design and Architecture, Nagoya City University. He is interested in using HMD technology to induce the sensation of stretching and contracting the body.
Kenri Kodaka  Kerni Kodaka is an associate professor in the Graduate School of Design and Architecture, Nagoya City University. His special interest is distorting the body-image using natural materials or virtual-reality techniques, in the framework of cognitive psychology.
Abstract AbstractRoom Tilt Stick provides an illusory experience of tilting a room using a stick and of walking on an acutely inclined slope, accomplished by correlating the tilting velocity of a three-dimensional modeled room in HMD with the degree of force transferred to the wall or ground with a special stick. 10am: Meet the Deer King Jing Zhang, Guangwen Zou, and Guangzheng Zhang (Beihang University, New Media Art and Design School) Abstract Abstractthe "splash-ink" interaction mechanism which comes from Chinese traditional painting style, and its application in different scenes. 10am: Marco & Polo Go Round Benjamin Steiger Levine (Item 7) Biography BiographyBenjamin Steiger Levine  Benjamin Steiger Levine portrays experience through unexpected stories that are both touching and unsettling. This balance between charm and discomfort, humanity and visual-wonder is the heart of his work. Ben’s favorite stories come from a personal place that get expressed in unexpected visual ways.
Abstract AbstractMarco & Polo Go Round is a comedic love story with a very surreal twist. A couple confronts the difficulties in their relationship as gravity turns on its head and their world literally falls apart around them. 10am: WizardOfVR: Emotion-Adaptive Virtual Wizard Experience Kunal Gupta and Yuewei Zhang (University of Auckland, Empathic Computing Lab); Yun Suen Pai (Keio University Graduate School of Media Design); and Mark Billinghurst (University of Auckland, Empathic Computing Lab) Biographies BiographiesKunal Gupta  Kunal Gupta is a Ph.D. candidate at the Empathic Computing Laboratory, University of Auckland, New Zealand, under the supervision of Prof. Mark Billinghurst. His research revolves around emotion recognition in VR using physiological and contextual information.
Prior to this, he worked as a UX Researcher at Google and as UX Designer at a startup in India, for a total of around 5 years of industry experience. He obtained a master's degree in HCI from HITLab NZ supervised by Prof Billinghurst. He conducted some of the first research into the use of eye-gaze to enhance remote collaboration in wearable AR systems.
Yuewei Zhang  Yuewei Zhang is an XR developer and enthusiast who has been creating commercial VR games since 2016. He is currently studying at the University of Auckland as a 2nd-year undergraduate Software Engineering student. Yuewei aims to be at the forefront of developing virtual reality applications. He enjoys experimenting with creating interactive media only possible in XR, whether that be art, games, or research, and their empathic outcome. Areas he is working on at the moment include finding novel ways of incorporating storytelling, music, and creative programming into extended reality.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design. He obtained his Bachelor's Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan, and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand. His research interest is the effects of VR/AR/MR towards human behavior, perception, and learning using physiological signals and artificial intelligence
Mark Billinghurst  Mark Billinghurst is Director of the Empathic Computing Laboratory, and Professor at the University of South Australia in Adelaide, Australia, and at the University of Auckland in Auckland, New Zealand. He earned a PhD in 2002 from the University of Washington and conducts research on how virtual and real worlds can be merged, publishing over 600 papers on Augmented Reality, Virtual Reality, Empathic Computing, and related topics. In 2013 he was elected as a Fellow of the Royal Society of New Zealand, and in 2019 was given the ISMAR Career Impact Award for lifetime contribution to AR research and commercialization.
Abstract AbstractWe demonstrate WizardOfVR, a personalized emotion-adaptive virtual reality (VR) Wizard akin to the Harry Potter experience, highlighting a use-case scenario of a real-time biofeedback loop between the user's emotional state and adaptive VR environments (VREs) using off-the-shelf physiological sensors. 10am: “Flower and the Youth”: Virtual Narrative and Creative Methods of Oral Performance in China Intangible Cultural Heritage Yu Lu, Zixiao Liu, and Xuning Yan (School of New Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University) Biographies BiographiesYu Lu  Yu Lu is an undergraduate student studying in the School of New Media Arts & Design, Beihang University, Beijing, China. Her undergraduate major is digital media and her research direction is about interactive desigh and virtual reality.
Zixiao Liu  Liu Zixiao is an undergraduate student from Beihang University, School of Media Art and Design, majoring in digital media art and minoring the economics. Her research direction is about virtual reality.
Xuning Yan  Xuning Yan is studying for a master's degree in the School of New Media Arts & Design, Beihang University, Beijing, China, Beihang University. Her work aims to explore the interactive design and audience experience of virtual reality performances.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract AbstractBased on technology of virtual reality (VR) and gesture recognition, we create the VR performance, "Flower and the Youth". Our work provides universal design approaches to the creation of content for future intangible cultural heritage performances. 10am: "Once": Multi-perspective and Interactive VR Narrative Film Zixiao Liu and Lutong Li (School of Media Art and Design, Beihang University) and Shuo Yan (School of New Media Art and Design, Beihang University; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University) Biographies BiographiesZixiao Liu  Liu Zixiao is an undergraduate student from Beihang University, School of Media Art and Design, majoring in digital media art and minoring the economics. Her research direction is about virtual reality.
Lutong Li  My name is Lutong Li. I'm a student major in digital media in the School of New Media Art and Design of Beihang University. I'm now living in Beijing.
Shuo Yan  Shuo Yan received her PhD in Beijing Institute of Technology. She used to work as a research assistant in MIT Media Lab. Currently, she is an Associate Professor in the School of New Media Arts & Design, Beihang University, Beijing, China. Her grants, awards, and publications include over 15 scientific papers, two national funds, two patents, a national excellent doctoral dissertation award supported by China Simulation Federation, a national award for distinguished doctorates in China. Her work seeks to push the boundaries of design and technology to create innovative solutions with the power to augment human capabilities.
Abstract Abstract“Once” is an interactive virtual reality narration film based on post-war experience, which is set after a continuous war period between two countries. Through the three innovative points, we create this VR narrative film, which tells common people's experience after the war as clues to express the trauma it brings. 10am: Cyberdream: An Interactive Rave Music Visualisation in Virtual Reality Jonathan Weinel (University of Greenwich) Biography BiographyJonathan Weinel  Jon Weinel is a London based artist/researcher whose main expertise is in electronic music and computer art. In 2012 he completed his AHRC-funded PhD in Music at Keele University regarding the use of altered states of consciousness as a basis for composing electroacoustic music. His electronic music and audio-visual projects have been presented internationally, and in 2018 his book Inner Sound: Altered States of Consciousness in Electronic Music and Audio-Visual Media was published by Oxford University Press. He has held academic posts in the UK and Denmark, and currently lectures at the University of Greenwich.
Abstract AbstractCyberdream, is a prototype virtual reality application, which provides a journey through audio-visual environments based on the aesthetics of 1990s rave music. The project provides three audiovisual 'sound toys', which allow the user to interactively 'paint with sound'. 10am: GIBSON: AR/VR synchronized city walking system Seiichiro Takeuchi, Yuki Homma, Kyoko Hashiguchi, and Kent Kajitani (MESON, Inc.) and Shingo Meguro (Hakuhodo DY Holdings) Abstract AbstractGIBSON is a cross-AR/VR city walking system that allows VR user in remote location and AR user in reality to walk together as if they are sharing the same space. The VR space is created with 3D city model, and the positions of users are synchronized with Visual Positioning System. 10am: Dislocation Veljko Popovic and Milivoj Popovic (Prime Render Studios)   Biographies BiographiesVeljko Popovic  Veljko Popovic (1979) graduated from the Academy of Fine Arts in Zagreb, Department of Painting, in 2003. He has worked in computer graphics since 1998 and co-founded Lemonade3d, a CG and animation studio that later became Prime Render Studios. Since 2012, he teaches animation at the Arts Academy in Split. His films have been screened and awarded at numerous film festivals worldwide. He was a jury member at several film festivals.
Filmography: Dislocation - VR (2020), Cyclists (2018), Planemo (2016), Father (2012, co-director), Dove sei, amor mio (2011), My Way (2010, co-director), She Who Measures (2008)
Milivoj Popovic  Milivoj Popovic (1979) graduated from the Arts Academy in Split, Department of Sculpting, in 2014. He is an external associate at the Arts Academy, where he teaches Digital Sculpting. He co-founded Lemonade3d, a CG and animation studio that later became Prime Render Studios, where he works as director and producer. He worked as producer and 3D artist on short animated films that received over 70 international awards, including the awards at Aspen and Annecy.
Abstract AbstractThe VR experience Dislocation takes a look at an absurd moment of disbelief and fear. It examines the internal processes that develop and offers a visual depiction of a person forced into extreme circumstances – a moment of dislocation. 10am: X-Wing: Propeller-Based Force Feedback to Head in a Virtual Environment Koki Watanabe, Fumihiko Nakamura, Kuniharu Sakurada, Theophilus Teo, and Maki Sugimoto (Keio University) Abstract AbstractThis research introduces X-Wing, a haptic device using ducted fans attached to VR Head Mounted Display (HMD). It enables a VR user to receive force feedback based on different wind power converted into impulsive force for a unique VR experience such as virtual aerial simulation. 10am: Dementia Eyes: Perceiving Dementia with Augmented Reality Ximing Shen and Yun Suen Pai (Keio University Graduate School of Media Design); Dai Kiuchi, Kehan Bao, Tomomi Aoki, and Kanoko Oishi (Mediva Inc.); and Kouta Minamizawa (Keio University Graduate School of Media Design) Biographies BiographiesXiming Shen  Ximing Shen is currently a research assistant at Embodied Media Project, Keio University Graduate School of Media Design.
She pursued her bachelor's degree at the University of Manchester, and master's degree at Keio University, Graduate School of Media Design. Her research interest is data science, accessibility and inclusive design, and human-computer interaction.
Yun Suen Pai  Yun Suen Pai is currently an assistant professor at the Embodied Media Laboratory, Keio University Graduate School of Media Design.
He obtained his Bachelors Degree in Computer-Aided Design and Manufacturing Engineering, as well as Masters Degree in Engineering Sciences at the University of Malaya, Malaysia. Then, he proceeded to obtain his Ph.D. in Media Design at Keio University, Japan and furthered his postdoc research at the Empathic Computing Laboratory, Auckland, New Zealand.
His research interest is the effects of VR/AR/MR towards human behavior, perception and learning using physiological signals and artificial intelligence.
Dai Kiuchi  Dai graduated with a Bachelor’s degree from Kyoto University, Japan and a
Master’s degree in Physiotherapy from the Robert Gordon University, UK. He has nearly 10 years of clinical experience as a physiotherapist in the UK. Since
he returned to his native Japan in 2014, he has joined Mediva Inc., a consulting
and operations company specialised in healthcare. He has been involved with
projects such as clinic management, market research and healthcare service
setting up. He has also been leading projects to introduce and implement
dementia-friendly design into public buildings, hospital wards, residential and
nursing homes.
Kehan Bao  Bao graduated from East China University of Science and Technology, China as a social worker, and a Master’s degree in Social Welfare from Japan Women's University. She also holds a MBA from Nagoya University of Commerce & Business. She has joined Mediva Inc., a consulting and operations company specialised in healthcare since 2015. She has experiences in market research, setting up and operational improvement of healthcare and elderly care services and dementia-friendly design implementation both domestically and internationally. She has a keen interest in the improvement of elderly care systems in China.
Tomomi Aoki  Tomomi graduated from the Faculty of Nursing at Kitasato University and obtained a nursing qualification. She gained clinical experiences at university hospitals and then was involved in the management of the long-term care business. she has joined Mediva Inc., a consulting and operations company specialised in healthcare since 2011. She has been involved in projects related to the operations and management of long-term care business and healthcare services.
Kanoko Oishi  Kanoko graduated from Osaka University School of Law valedictorian and holds an MBA from Harvard Business School.
She is a founder and the CEO of Mediva Inc., a consulting company specialized in healthcare and the COO of Medical Corporation Platanus, a healthcare provider arm of Mediva. She previously worked as a partner at McKinsey & Company in Japan and the US.
She has served on numerous governmental committees, and is on the boards of directors including Shiseido Japan and Santen Pharmaceutical, and a member of the Japan Advisory Board at Harvard Business School and the Management Council at Osaka University.
Kouta Minamizawa  Kouta MINAMIZAWA, Ph.D, Professor at Keio University Graduate School of Media Design
Received his PhD in Information Science and Technology from the University of Tokyo in 2010, he directs the KMD Embodied Media Project, where conduct research on technology, design and social deployment of haptics and embodied interaction to transfer, enhance and create the human bodily experiences, and organizes research projects on Haptic Design, Superhuman Sports, and Sports Co-creation. He also serves as a Project Manager of JST Moonshot R&D Program, Executive Director of the Superhuman Sports Society, and Technical Advisor at Telexistence Inc.
http://embodiedmedia.org
http://superhuman-sports.org
http://hapticdesign.org
|