Introduction
All organizations across the globe are striving to improve their productivity considering safety, health and environment in addition to the primary objectives of the business that is quality, cycle time and resource optimization. Over a time, Industry 4.0 tools such as IoT, Machine learning, Cloud Computing, Artificial intelligence and Augmented Reality have evolved and become great enablers in business processes. This document covers AR technology and its applications in ship building industry.
Augmented Reality (AR)
Augmented Reality is a technology which overlays digital objects into a real environment. AR lies closer to Reality in Real-Virtual continuum.
Comparison Matrix of AR, VR & MR:
| Augmented Reality (AR) | Virtual Reality (VR) | Mixed Reality (MR) |
|---|---|---|
| Real world with digital information overlay | Completely digital environment | Real and virtual intertwined |
| Real world remains central to the experience, enhanced by virtual details | Fully enclosed, synthetic experience with no sense of the real world | Interaction with and operation of both the physical and virtual environments |
Available AR Hardware in the market: Available hardware is broadly classified as: –
- HMD (Head Mount Display): They are portable with small display or projection technology integrated into eye glasses or mounted on helmet.
- (HHD (Hand Held Device): They are portable and Palm devices.
Following are few examples of HMD and HHD devices:
- Microsoft HoloLens 2 (HMD)
- Apple IPad pro (HHD)
- Apple Vision pro (HMD) – Upcoming
Brief of above devices is enumerated in succeeding paragraphs.
(a)Microsoft HoloLens-2: Microsoft HoloLens 2 is a HMD Device which is an untethered holographic computer. It is designed to provide users with an immersive experience by overlaying digital content into real world.
(b) I-Pad: I-Pad is an AR hand held device(HHD) which can handle complex design models, large data and has comparatively more processing power than Microsoft HoloLens. It is widely used in 3D Scanning applications through LIDAR (Light Detection and Ranging).
(c) Vision Pro (Apple): Apple Vision Pro is a HMD device, which blends digital content in real world and tracking is facilitated by eye/retinal movements, hand movements, and voice recognition. This device has been launched recently and will be available in the market by end 2023.
Cloud based operations have following advantages over server
- a.Collaboration
- b.Cost savings
- c.Software updates
- d. Enhanced data security
- e.Prevention of data loss
Hardware & Software Architecture
Elements of AR: Elements of AR can be broadly categorized into 03 phases (Sensing, Augmenting and Presenting) as shown below in Figure 5: –
- Sensing of AR device is through camera and sensor.
- Augmenting through Registration (Anchoring of Virtual Object in real environment) and SLAM (Simultaneous Location and Mapping). SLAM is a technique used for alignment without markers. Tracking is by movements of head, hand and eye.
- Presenting through HMD or HHD.
Alignment Processes: Basic alignment process involves Registration and Tracking and is accomplished by following systems.
- Marker based system: QR Codes are generated using a combination of error correction codes and encoding techniques. Basic components of QR code includes the finder pattern of three square markers that helps scanners to locate the code, an alignment pattern and timing pattern. These 03 black and white squares help us to align digital with real environment.
- Marker less system: Simultaneous Localization and Mapping (SLAM). This mechanism helps camera to scan the area, identify the surface and convert into mesh (encrypted). SLAM is a robust system based on spatial coordinates to align virtual object in real world.
Hardware and Software:
(a) Hardware Architecture: In order to operate the HoloLens, we need to perform gestures in line with predefined program.
(b) Software Architecture: Modelling software such as Catia, Solid works are used for designing of models. The same is to be integrated with AR software with conversion software. Function of each software is defined below
Fields of Application
Application of Augmented Reality in Ship Building Industry.
- (a) Design: Augmented Reality (AR) gained significant popularity in the field of design. It offers designers / users to overlay virtual content into the real world, creating an enhanced and immersive experience. Few AR applications as identified for Design are listed below:
- (b) Prototyping and Visualization: AR allows designers to create virtual prototypes and visualize how products will appear and visualize in real world environment. It enables designers to superimpose 3D models of their designs into physical space, allowing for better evaluation, understanding of scale, proportions and aesthetics.
- (c) Assembly of subsystems: Augmented Reality (AR) is an emerging application that leverages AR technology to assist the assembly and maintenance processes.
- (d) Digital Instructions: AR can provide step-by-step digital instructions overlaid into the physical workspace. Using AR enabled smart glasses or mobile devices, work force can see virtual visual cues, text instructions and animations directly on the objects.
- (e) Remote Collaboration: AR allows for remote collaboration between teams in site and remote location. Through AR enabled devices, experts in other location can see, understand challenge at site and provide real-time guidance or support.
- (f) Error Detection and Validation: AR can assist in error detection and validation during the assembly process. It can detect, if a component is misplaced, provide warnings or alerts for incorrect actions, and validate the correctness of each assembly step before proceeding to the next.
- (g) Operations: Previous studies have successfully blended AR heads-up display to notify CNC machining operators with process alarms, progress reports and error messages. Such AR applications are transferable to critical and dangerous manufacturing tasks in the maritime industry, where a mistake may lead to worker injuries or severe damages (in terms of cost, time) of inventory. Furthermore, in such situations, an AR solution could be used as a monitoring and diagnosis tool by capturing the information provided by control systems and sensors.
- (h) Training: A large number of skilled manufacturing workers to work with robots to assemble a variety of products and systems. AR can support training process by giving step by step instructions to complete specific tasks. It is especially useful to train workers to operate machinery, used for sequencing and assembling. This results in reduction of time, effort and easily understandable in comparison with training by reading manuals.
- (i) Quality Assurance: Main objective of AR is the automation of quality processes through use of computer vision techniques. Product modeling part of reverse engineering can be carried out using 3D cameras and reconstruction software. Deviations can be verified by superimposing developed 3D model and CAS (Computer Aided Styling) model.
References
Disclaimer: The information, statements and opinions contained in this content are of a general nature only and do not take into account your individual circumstances including any laws, policies, procedures or practices you or your employer or businesses may have or be subject to. Although the statements of fact on this page have been obtained from and are based upon sources that L&T EduTech believes to be reliable, it does not guarantee their accuracy or completeness.
