Abstract
Hands-on experiential learning, or “learning-by-doing”, is an effective method to enable students actively learn while also being able to reflect on their experiences, particularly for more abstract concepts. Within physical disciplines such as engineering, experiential learning plays an important role in the projects, laboratory classes or even “hands-on lectures”. However, two challenges that are still frequently encountered within engineering hands-on learning are: (1) the difficulty in visualizing and relating the abstract concept fundamentals with the practice; and (2) the lack of ability to perceive the inner-workings of a real system. A physical system typically only allows the output of the cause-effect to be observed, rather than what is happening within the system. This project aims to develop an augmented-reality (AR) framework that can aid in hands-on learning within engineering courses. AR allows additional information about the internal workings of physical systems to be visualized and can aid in showing more abstract concepts. The challenge of this project is that the AR would be used in a dynamic system, where the properties of or the physical system itself can be changing. This is unique compared with existing classroom uses of AR, where static cards are used instead of augmenting a physical real system. The proposed framework will provide a set of software components to allow AR elements for physical systems to be conveniently developed, and also integrate uReply with AR where questions will dynamically appear in real-time depending on the scene. The AR modules will be tested on both tablets and also AR glasses, and employed in four faculty of engineering subjects to demonstrate the effectiveness of the proposed project within different topic areas: robotics, electronics, bio-fluids and also bio micro-electro-mechanical systems.
Brief write-up
Project objectives
This project aims to develop an augmented-reality (AR) framework that can aid in hands-on learning within engineering courses. AR allows additional information about the internal workings of physical systems to be visualized and can aid in showing more abstract concepts. The objectives of the project are:
• Develop a software framework to allow AR elements for physical systems to be conveniently developed
• Test the AR modules on both tablets and also AR glasses
• Employed in subjects to demonstrate the effectiveness of the proposed project
Activities, process and outcomes
• Development of AR software framework with 3 embodiments: (1) AR software for hands-on learning in robotics and electronics; (2) robotics AR/MR software framework for students to easily construct a mixed reality environment for a robot arm with virtual 3D objects through a graphical user interface (GUI); (3) AR system developed for telepresence robots.
• Exploration of AR on different devices, namely on a tablet, AR glasses and also VR glasses.
• Using the developed AR software modules within courses as part of hands-on learning, creative robotics development project and telepresence visiting.
Deliverables and evaluation
Summary of deliverables:
• Developed three different embodiments software platforms for AR in teaching engineering.
• Testing of the AR software within 2 engineering subjects.
• Initial student feedback indicate that the developed teaching modules/approaches increased their motivation and enthusiasm to their learning and project, particularly demonstrated by the hands-on project environments developed by the students.
Dissemination, diffusion, impact and sharing of good practices
The project development and student learning experiences were presented at the CUHK Teaching and Learning Innovation Expo, UGC Teaching Award awardee sharing and other teaching-related sharing seminars both within and outside of CUHK.
Impact on teaching and learning
• Student’s impression to the developed AR modules were positive. The project also allowed students to develop their own mixed-reality environment, and enriched their experiential learning experiences in using AR.
• The developed AR framework form foundations for future developments for interactive hands-on learning both within engineering subjects and beyond on physical systems.
• Teleoperated robots for learning with AR will bring significant impact to allow for learning at external/remote locations.
