Advancing Machine Operating Instructions through Augmented Reality

Industrial Design Engineering Thesis & Published paper

This project explores the feasibility of using Augmented Reality (AR) to enhance machine operating instructions. Conducted as part of a Bachelor’s thesis in Industrial Design Engineering, the research aimed to improve training and safety for machine operators, focusing on the PICOMAX 20 Milling & Drilling machine at the University of Twente.

Traditional machine instructions are often communicated verbally or via static documentation, which can lead to:
- Misunderstandings and inconsistencies.
- Limited accessibility for inexperienced operators.
- Potential safety risks.

The lack of intuitive and engaging instruction methods underscores the need for innovative solutions like AR.

Engineers
Steyn Knollema
year
2023
Image

Research Approach

The project involved:

Prototype Development: Creating AR-based solutions that overlay holographic instructions on the machine to guide users step-by-step.

User Testing: Usability and quality tests conducted with students and workshop experts to evaluate effectiveness.

Stakeholder Interviews: Feedback from Health and Safety Environment (HSE) experts to ensure compliance with regulatory frameworks and enhance usability.

Key AR features:
- Holograms: Part-specific and task-specific holograms that visually direct users.
- Instruction Sequences: Steps with numerical indicators to simplify complex processes.
- Interactive Questions: Tests to verify user understanding and guide error resolution.

Image

Results and Insights

The implementation of AR for machine operation provided several key benefits:
- Heightened User Satisfaction: Improved engagement and learning experience.
- Better Comprehension:
Clear visualization of complex tasks reduced errors.
- Financial Feasibility: Cost estimation showed potential for scalable deployment.
- Enhanced Safety:
Monitoring and guided instructions reduced risks.

Cost Estimation & Ethical Reflection

A detailed cost simulation was performed using Monte Carlo Analysis, factoring in variables like:
- Number of machines.
- Development time.
- Instruction time and HoloLens costs.

Regulatory research confirmed compliance with Dutch laws, while an ethical analysis highlighted the safety-focused justification for AR use.

Future Applications

This solution has significant potential for:
Educational Use:
Integration into IDE curriculum.
Industry Training: Application in professional workshops.
Safety Monitoring:
Enhanced oversight for complex operations.

For more details, refer to the published paper:

Paper

Projects