In this project, we have created a virtual environment designed for children with Autism Spectrum Disorder (ASD). This environment includes a virtual room, various virtual objects, and virtual agents (avatars) to demonstrate different movements tailored to the needs of children with ASD. The development of this environment was achieved through the utilization of Unity, C#, Blender, and VR development toolkits.
Hardware setup: VR Meta Quest headset 2, a computer, and motion controllers.
Software setup: Unity game engine, Visual Studio, Android Android platform, Blender, Meta Quest developer mode, and XR interaction packages.
Animation: The modeling and animation of the VR environment were done using Unity Assess Store, Mixamo, and the Blender 3D modeling software. Original animations from Mixamo were edited by changing bone structures and animation clips in Blender.
Programming and Interaction: The programming of the VR environment including user interface, interactable objects, VR hand-tracking and avatar animation control was done using the C# programming language and XR interaction toolkits.
Testing: The testing of the VR environment was done using the Unity playtesting tools and XR device simulator.
Deployment: The deployment of the VR environment was done using the Android platform in Unity. Tennis balls, boards, pegs, paper, tables, mats, bean bags, pens, and other virtual objects were collected from XR interaction toolkits, along with a user hand-tracking setup. Virtual avatars were implemented from the Mixamo website and Animated by using Blender. We programmed male/female avatars to demonstrate eight movement tasks (aiming, catching, inserting pegs, threading lace, walking, and hopping) in age band 2.
Scene Set up: All movement tasks and practices were placed in VR_Room for three age bands. (Threading Lace task has been developed)
Tutorial and online Courses: Blender & Unity & VR Videos, and C#
Blender FPS Rigging & Animation Tutorial - Part 14 - Importing and Setting up the Gun Rig
Low Poly FPS Arms Model - FPS Game With Unity & Blender
Deep Motion : https://www.youtube.com/watch?v=wrjW_Dv2k4Y&list=PLZB6KVNbCO39fl1uKygH_0aDpGnIW4snC
Meta Quest 2 & Unity:
Set up : https://www.youtube.com/@meetras/videos
Develop Unity VR project:
https://www.youtube.com/watch?v=YwFXQeBmxZ4&list=PLQMQNmwN3FvzN0M5IfS-k4nw4NLgNd7EC&index=1
Videos about VR development: https://www.youtube.com/watch?v=_Kc2RhjxqmE https://learn.unity.com/course/create-with-vr
Kinematic Equation: https://www.youtube.com/watch?v=IvT8hjy6q4o
How to make a body in VR: https://www.youtube.com/watch?v=tBYl-aSxUe0 Body Setup: https://www.youtube.com/watch?v=v47lmqfrQ9s
Hand Tracking (No Controllers): https://www.youtube.com/watch?v=WELSs-lPJYA https://www.youtube.com/watch?v=mJ3fygb9Aw0 https://www.youtube.com/watch?v=JR2-Qhs2vJc&list=PLwz27aQG0IIINJb3mfDb3subZ6j8VdtEA&index=11
Swap Character: https://www.youtube.com/watch?v=AO1vw-b8Qzw
Create a WhiteBoard in VR: https://www.youtube.com/watch?v=sHE5ubsP-E8&t=1522s
Create a wire in Unity: https://www.youtube.com/watch?v=-uLCjX21YZo
Fixed, Spring, Hinge, Character & Configurable Joint explained: https://www.youtube.com/watch?v=MElbAwhMvTc&list=RDCMUCdedu-nAwMACE5WbVcmp3Bg&start_radio=1&rv=MElbAwhMvTc&t=414 Latex full: https://www.youtube.com/watch?v=ydOTMQC7np0&t=923s