Skip to main content
Heritage Science
Download PDF
Download ePub

Noncontact restoration of missing parts of stone Buddha statue based on three-dimensional virtual modeling and assembly simulation

Heritage Science volume 8, Article number: 103 (2020) Cite this article

Abstract

Three-dimensional (3D) digital technology is an essential conservation method that complements the traditional restoration technique of cultural artifacts. In this study, 3D scanning, virtual restoration modeling, and 3D printing were used as a noncontact approach for restoring a damaged stone-seated Bodhisattva (stone Buddha statue). First, a 3D model with an average point density of 0.2 mm was created by integrating the fixed high-precision scanning of the exterior and the handheld mid-precision scanning of the interior excavated hole. Using a 3D deterioration map of the stone Buddha statue, the area of the missing parts was measured to be 400.1 cm2 (5.5% of the total area). Moreover, 257.1 cm2 (64.2% of the missing part area) of four parts, including the head, surrounding area of the Baekho, right ear, and right eye, for which symmetry was applicable for modeling or there could be ascertainable historical evidence for the total missing parts, was selected for restoration. The virtual restoration of the missing parts of the stone Buddha statue was performed using a haptic modeling system in the following order. First, the location of the three fragments detached from the head was determined. Next, a reference model was selected, and its symmetrization and modification with respect to the original model were conducted. Further, estimation modeling and outer shape description were achieved through historical research and consultation with experts. The heuristic-based assembly suitability of the created virtual restoration model (461 cm3) was verified by design mockup printing and digital–analog simulation. In particular, to address assembly interference, the interface surface was modified and reprocessed several times. Accordingly, the volume of the final design mockup decreased by 5.2% (437 cm3). Photopolymerization 3D printing technology was used for the actual restoration of the stone Buddha statue, and considering the surface roughness, the layer thickness of the material used for restoration was set at 0.10 mm. Finally, the surface of the printed output was colored to prevent yellowing and joined to the missing parts of the stone Buddha statue. This study presents a remarkable case of shifting from the traditional manual-contact method to the contactless digital method for restoring artifacts and is expected to largely contribute to increasing the usability of digital technologies in the restoration of cultural artifacts.

Introduction

Ancient monuments and artifacts are often damaged because of exposure to natural or artificial environmental factors, which can lower their historical value or significance [1,2,3,4,5,6,7,8,9]. Traditionally, functional repair and aesthetic restoration are undertaken to recover the original form of damaged monuments and artifacts [10, 11]. The Athens Charter (1931), Venice Charter (1964), and Nara Document on Authenticity (1992) have been prepared to establish restoration principles for cultural heritages, and countries around the world have restored their cultural heritages according to their own rules following international recommendation [12]. Generally, damaged artifacts can be restored only when their historical and cultural value can be retrieved through sufficient and direct historical research. Any restoration that may distort the value or cause a controversy is restricted. Fundamentally, a traditional technique and original materials are used for restoration. However, if the traditional technique is not applicable and the original materials cannot be supplied, modern technologies and materials that have been scientifically and experientially established can be used.

Recently, various conservation methods using advanced technologies and new materials have been used in the restoration process of cultural artifacts [13,14,15,16]. In particular, when a cultural artifact loses its historical value or changes its shape, the restoration effort focuses on recovering the entire or partial shape of a certain period via thorough historical research and consultation with experts [17,18,19]. The restoration of a cultural artifact is usually realized using a manual method that relies on conservators’ intuition and techniques [20, 21]. Using this method, physical contact with the material is inevitable. Moreover, if the restored parts look inappropriate, it would have to be removed. In this case, the original artifact can suffer a secondary damage either from frequent physical contact or excessive force applied during the removal of the parts.

With the advancement in digital technology, many approaches that complement traditional restoration methods have emerged. The most prominent technologies include three-dimensional (3D) scanning and printing. 3D scanning is used in areas of digital documentation [22,23,24,25], shape analysis [26], conservation evaluation [27], and digital restoration [28,29,30]. In particular, this method is actively used for digitalizing and documenting rock materials such as rock arts [31], inscribed stones [32, 33], knapped stones [34], dolmen [35], and stone pagoda [36]. Moreover, 3D printing has been employed in a wide area, including the establishment of restoration planning, supplementing the lost area, replication, and exhibition. Because of the availability of a wide variety of printing materials, 3D printing is used for the actual restoration of damaged artifacts [37,38,39,40,41,42,43,44,45].

In this study, the restoration of a stone-seated Bodhisattva (stone Buddha statue) was performed using various digital technologies. This statue is composed of zeolitic tuff, which has rarely been reported to be used as a Buddha material around the world. Thus, its unique value as a representative style of the Buddha statue has been appreciated between the seventeenth and nineteenth century in Korea. However, this statue was mostly damaged because of the missing parts. According to the ICOMOS-ISCS glossary, the missing part is defined as the empty space, obviously located in the place of some formerly existing stone part. The protruding and particularly exposed parts of sculptures are typical locations for material loss, which result in the missing parts [46]. The missing parts of the Buddha statue are attributed to the soft and weak characteristics of the material.

Therefore, noncontact restoration was realized using 3D scanning, virtual restoration modeling, and 3D printing technologies. To achieve this goal, 3D high-precision scanning was used to record the original shape of the stone Buddha statue and the missing parts were virtually restored using a haptic modeling system. Moreover, the restoration of the stone Buddha statue was completed using the 3D printed outputs of the virtual restoration model. In particular, a systematic design mockup and simulation approach as well as the convergence of digital and analog technologies were used to enhance the heuristic-based assembly suitability of the virtually restored model.

Status of the study object

Wood, clay, and metal are the commonly used materials to create a small statue because they are sufficiently easy to obtain in Korea. In particular, wood and metal have been the most commonly used universal materials since a very long time; however, clay has mostly been used after the fifteenth century. In contrast to the commonly used materials, the study object, which is a stone-seated Bodhisattva excavated in Pyeongchang, Gangwon province in the Republic of Korea, is composed of zeolitic tuff (Fig. 1).

Fig. 1
figure 1

Status of the Buddha statue

Full size image

Based on visual observation, the rock exhibits a white microcrystalline substance with a dark porphyritic texture and its rock-forming minerals include albite, biotite, and quartz [47]. This rock was traditionally used to sculpt a Buddha statue, because it is very soft and easy to handle. The statue was discovered in several fragments in 1974 and has been maintained in almost its entire form through a conservation treatment. However, four fragments that are estimated to be parts of the crown and one fragment of an ear have been separately stored without joining [48].

A huge excavated hole exists inside the statue from below the chest to the bottom, which is believed to have stored relics. Traces of coloring using mineral pigments and gold gilding are found on the exterior of the statue; however, its exact form is difficult to discern as most of them were peeled off and deteriorated. Moreover, the crown, face, and left finger are missing, and several physical damages are observed because of stone crack and exfoliation. Owing to its vulnerable conservation status, this statue has been managed in the national museum storage with stable environmental conditions for decades and has not been used for exhibition. Therefore, aesthetic and functional restoration of the damaged parts is necessary to recover its historical value and use the statue for exhibition or display.

Devices and software

The digital model of the statue was created using a fixed 3D high-precision scanner and handheld mid-precision scanner. Among these, the fixed high-precision scanner (HDI Advance R3X, LMI TECHNOLOGIES, Canada) is based on triangulation and uses white structured light and two stereo cameras (2.8 MP). In this study, scanning was performed with a field of view (FOV) of 400 mm and an accuracy of 65 μm. Furthermore, the handheld mid-precision scanner (Eva, Artec3D, Luxembourg) that uses white structured light and camera (1.3 MP) has an accuracy of 0.1 mm and a maximum point resolution of 0.5 mm. Software used for operating the scanners included FlexScan3D and Artec Studio 13, and the 3D model was edited using Geomagic Design X 2019. The high-resolution digital scanning results were used to identify the manufacturing techniques and analyze the shape of the statue.

A haptic device (Geomagic Touch X, 3D SYSTEMS, USA) and voxel-based software (Geomagic Freeform Plus, 3D SYSTEMS, USA) were used to virtually restore the missing parts. The device provides haptic feedback when a user interacts with the virtual environment. In particular, voxel-based modeling using a virtual clay material provides design flexibility. Therefore, this system was used for both 3D modeling and virtual assembly simulation, and the suitability of the 3D restoration model was evaluated.

Material extrusion and photopolymerization 3D printing technologies were used to obtain the output of the virtual restoration model. A material extrusion 3D printer (Ultimaker 3 Extended, Ultimaker) was used to verify the modeling result through the output of a design mockup, and the mockup was printed using polylactic acid (PLA) material at a resolution of 0.10–0.15 mm. Moreover, the 3D printer (ProJet 6000 HD, 3D SYSTEMS, USA) used for the final restoration employed photopolymerization that provides a very high level of surface precision. The 3D model was printed using UV-hardened plastic material with a layer thickness of 10 mm. The final printed output was used to restore the statue and its exhibition after strengthening and joining.

Methods and data processing

3D scanning

The missing parts were restored by a noncontact approach using digital technologies such as 3D scanning, modeling, and printing (Fig. 2). Fixed and handheld scanning was performed to record the 3D shape of the statue and its missing parts (Fig. 3). First, the exterior of the statue (scanned 101 times) and five fragments (scanned 34 times) were digitized using the fixed high-precision scanner based on stereo vision. The total 3D scans were performed by considering the structure and appearance of the statue, scope of survey, and degree of overlapping. However, the fixed high-precision scanner based on the binocular lens could not reach sufficient depths to record the shape of the excavated hole from below the chest to the bottom of the statue. Therefore, a handheld mid-precision scanner based on a single lens with depth-scanning capability was used to record the shape of the excavated hole.

Fig. 2
figure 2

Methods and data processing

Full size image
Fig. 3
figure 3

3D scanning process and the result of convergence modeling of the statue

Full size image

Each image acquired by on-site scanning provides only misaligned raw shape information. Therefore, the raw scans were post processed to complete a single model from the raw scan data. The processing was executed in the following order: filtering, aligning, registering, merging, filling holes, and RGB texture mapping. The reliability of a 3D model depends on the registering result based on the iterative closet point algorithm [49]. Therefore, registering, which is the most important stage in scan processing, was performed with an average overlap ratio of 66% and within an error vector of 45 μm. This error vector value was very similar to the distance accuracy of the 3D scanner, indicating high reliability of the registering results.

Moreover, high-precision scanning of the statue exterior and mid-precision scanning of the excavated hole needed to be integrated into a single model because the scanning yielded separate 3D models. Accordingly, a deviation analysis between the two scanning models to evaluate the registering error revealed that most deviations were within ± 0.1 mm and the average RMS was 0.28 mm. These values are similar to the accuracy of general precision scanners; thus, the convergence model was created based on an ICP algorithm.

Virtual modeling and simulation

The general rule of the conservation treatment and restoration of cultural artifacts states only minimum and passive intervention under inevitable conditions. Therefore, in this study, among the damaged areas, minimum scope was selected for aesthetic restoration and exhibition. The cracks are very fine, and their depths are visually conspicuous. These cracks seemingly do not cause any severe physical and structural problems. Thus, the cracks in the statue were left unattended without conservation treatment. However, the missing parts have a critical impact on the aesthetic value of the statue. Therefore, some parts that could be recreated using symmetry modeling or assured significant evidence through historic research were restored. In particular, the entire stone fragments that were stored separately were used for the restoration.

The haptic modeling system used to create a virtual model of the missing parts enables intuitive modeling because it helps recognize conflicts and interference of data. Compared with the existing method that uses a mouse, this method is considerably excellent for creating a complex shape. In particular, the system uses a voxel engine to create a model, providing a user an experience of force feedback similar to that faced in actually carving of a virtual object. This system is mainly used in the medical field, graphic design, car industry, exhibition technology, and the restoration of cultural artifacts [50,51,52,53].

In this study, the digital virtual restoration of the four selected parts was performed using a haptic modeling system. In the process of modeling, Boolean operation was used to combine several complex models into a new complete model. Boolean operation is an essential method for original-based modeling requirements such as the restoration of the cultural artifacts; therefore, the operation was mainly used for symmetrization of the missing parts. Boolean operation was performed to modify the model, matching it exactly to the original shape. Because symmetry modeling could not be applied to the center of the crown part, a statue similar to the study object was selected as a reference and estimated restoration was performed.

A design mockup helps to intuitively understand the influence of interference caused by the components and reduces the time required for completion by solving a making-related problem in advance. Preliminary verification through design mockup minimizes the unnecessary consumption of materials and time in the restoration process and maximizes the work efficiency [54]. In this study, to enhance restoration completeness using the noncontact approach, digital–analog-based assembly simulation was performed by creating a design mockup. Material extrusion 3D printing, which can minimize time, shape error, and costs, was used to create the design mockup.

Results

3D documentation and shape analysis

The converged 3D model comprises 36,556,604 polyfaces with an average point distance resolution of 0.2 mm. According to Fig. 4a, the 3D scanning result clearly revealed the complete shape of the statue and the polygon mesh and RGB texture-mapping models showed high reality effects. In particular, the final 3D scanning result exhibited a high resolution with millions of polygons, which well revealed the surface texture, manufacturing technique, and detailed shape of the damaged area.

Fig. 4
figure 4

Result of 3D scanning and shape analysis of the statue. a The 3D polygon mesh and RGB texture-mapping model. b A 3D deterioration map of the stone Buddha statue, and the mapping of the restoration ranges

Full size image

Based on the 3D scanning, the stone Buddha statue was measured to be 410-mm wide, 310-mm thick, and 580-mm high. Its calculated area and volume were 7,250 and 20,040 cm3, respectively. Moreover, the excavated hole was measured to be 188-mm wide, 155-mm thick, and 195-mm high, and its area and volume were 1,228 and 2,401 cm3, respectively. In particular, the cone-shaped excavated hole showed traces of chisels whose average sizes were 10.5 and 15.4 mm. Therefore, the excavated hole may have been carved using these two chisels.

A 3D deterioration map was created to define the scope of the conservation treatment and restoration. According to the map, cracks and missing parts were observed around the head; the body was mainly damaged owing to the cracks (Fig. 4b). Out of the total area, the deterioration rates of the missing parts were 4.8% (348.3 cm2) in the eye and head and 0.7% (52.9 cm2) in the body.

Virtual restoration modeling

For restoration, the big missing parts in the head, surrounding area of the Baekho, right ear, and right eye were selected, accounting for 64.2% (257.1 cm2) of the total surface area of the missing parts (400.1 cm2).During the examination of the virtual restoration modeling process of the missing parts in the head (Fig. 5), first, the original stone fragments were placed by referring to the shape and pattern of the stone Buddha statue. Then, a reference model for the missing parts was selected and copied using symmetry modeling. However, because the original statue was manually created, it lacked perfect symmetry.

Fig. 5
figure 5

Virtual restoration modeling process of the head of the statue

Full size image

The restoration of the right ear has aesthetic as well as functional purposes to support the original fragment. Accordingly, for virtual restoration, the original fragment was placed in the right ear and the shape of the missing parts was acquired using the symmetry of the well-preserved left ear. Next, the angle and height from the front view were adjusted to match those in the left, and completed after partial revision (Fig. 6a, b). Finally, aesthetic restoration of the surrounding area of Baekho and right ear was performed by filling the inner part and retouching the outer part. In particular, their restoration was completed after several modifications in consultation with art history experts because the overall impression of the stone Buddha statue can change owing to minor shape differences (Fig. 6c).

Fig. 6
figure 6

Result of the virtual restoration modeling of the face of the stone Buddha statue. a, b The right ear. c The surrounding area of Baekho and right eye

Full size image

Design mockup and assembly simulation

To summarize the assembly simulation process, first, an alternative model of the original statue was printed on the basis of the 3D scanning model to minimize direct physical contact with the statue. Moreover, heuristic-based assembly suitability was examined several times by printing the virtual restoration model. When an error was detected during verification, the virtual restoration model was modified and reprinted to enhance assembly completeness. However, when no error or aesthetic issue was detected, a design mockup was directly applied to the statue for further verification. After using photopolymerization 3D printing, the restoration process was completed (Fig. 7).

Fig. 7
figure 7

Heuristic-based design mockup and assembly simulation process

Full size image

When the printed virtual restoration model was applied to the mockup statue, the interference between the two surfaces was severe owing to the nonstructured form (Fig. 8a). This indicates the high quality of the virtual restoration model; however, it was insufficient for restoring the original artifact. Therefore, the area in the virtual model where interference occurs should be corrected so that the printed output fits the missing parts of the statue. In addition to the revision of the virtual model, assembly suitability to the 3D-printed mockup statue was intuitively checked and verified by directly modifying the mockup of the virtual restoration model (Fig. 8b). The 3D model, which was verified for digital–analog assembly suitability, was completed as the final design mockup through the outer design modification (Fig. 8c).

Fig. 8
figure 8

Simulation process using the design mockup. a Verifying assembly suitability using a 3D-printed alternative model. b Direct modification of the design mockup printing output. c Final design mockup after revising the joining surface. d The modification result of interface modeling. e Deviation analysis and mapping result of the virtual restoration model and final design mockup model

Full size image

In a quantitative analysis of the shape difference between the virtual restoration model and final design mockup of the head, the volume of the virtual restoration model was measured to be 461 cm3 and that of the design mockup assembled on the original stone Buddha statue was measured to be 437 cm3 (Fig. 8d). The volume reduction of 24 cm3 (5.2%) equals the amount of the removed interfering surface along the assembly interface. In the deviation analysis of the final design mockup against the virtual restoration model, the size of the removed joining surface was nearly 5.00 mm, with RMS and standard deviation of 0.67 and 0.56 mm, respectively. Approximately 66.6% of the virtual restoration model, whose tolerance range was within ± 0.1 mm, was not modified. The interfering surface of the joining interface was removed for 33.4% of the virtual restoration model (Fig. 8e). This deviation-mapping result enabled the visualization of the modification range and deviation amount of the initial virtual restoration model, providing quantitative information about the digital–analog simulation process.

Restoration of the missing parts

For restoration, 3D printing technology was used to facilitate an educational effect in exhibition and enhance aesthetic and functional completeness. The material extrusion 3D printing used to create the design mockup played a critical role in analyzing the shape of the missing parts to design the assembly planning. However, this technology uses a PLA material with relatively high surface roughness and weak physical properties to functionally support the light-weight original stone fragments [55]. To complement this, photopolymerization 3D printing technology was used to create the final restoration model.

The model was printed using opaque UV-hardened plastic whose color was similar to that of the original statue, with a layer thickness of 0.1 mm (Fig. 9a). After approximately 15 h of printing, the supporters were removed from the printed output and the surface that was in contact with the supporter was carefully smoothed using soft sandpaper with more than 3,000 mesh. Additional UV hardening was used to enhance the surface strength of the printed output (Fig. 9b).

Fig. 9
figure 9

3D printing and conservation treatment processes for the restoration of the stone Buddha statue. a 3D-printed outputs using photopolymerization. b UV hardening to enhance surface strength. c 3D-printed outputs of the four selected parts, including the head, surrounding area of the Baekho, and right ear and eye. d 3D printing output colored with acrylic painting to modify the surface texture and prevent yellowing. e The interfaces of the missing parts of the original stature strengthened using an ethyl silicate-based consolidant. f Joining of the missing parts of the statue using acrylic resin and cyanoacrylate instant adhesives

Full size image

The finished 3D-printed output exhibited a smooth and glowing surface, which was disparate with that of the original statue (Fig. 9c). The initiator used in photopolymerization can cause yellowing owing to the surrounding light. It is known that the efficiency of polymerization can influence discoloration because a higher degree of conversion corresponds to a smaller amount of residual monomers available to form the colored degraded products [56]. By observing the light source as an isolated factor, it was noted that this can alter the color of the studied composite resin [57]. Therefore, to modify the surface texture of the 3D-printed output and prevent its yellowing, the surface was colored with acrylic painting and varnished to prevent discoloration of the colored layer (Fig. 9d).

The missing parts of the stone Buddha statue were restored using the conservation treatment and 3D-printed output. As described, the Buddha statue is composed of zeolitic tuff. This material is very soft and has high absorption ratio owing to its porous structure. Accordingly, the interfaces of the missing parts of the original statue were strengthened using an ethyl silicate-based consolidant before joining the 3D-printed output (Fig. 9e). Then, the 3D-printed output was joined to the missing parts of the statue using acrylic resin and cyanoacrylate instant adhesives (Fig. 9f).

In this study, various digital data and mockup of the original statue obtained using 3D scanning and printing technologies transformed the exhibition, which comprised simple display of artifacts, into an educational exhibition focusing on the restoration process. Combined with unique storytelling, the exhibition has provided a new experience to museum visitors (Fig. 10). This is an important case, which shows that established modern technologies and materials can be used for the restoration, education, and exhibition of cultural artifacts.

Fig. 10
figure 10

Restoration of the stone Buddha statue and its use in an exhibition. a The restoration result of the missing parts. b A special exhibition on the restoration process of the stone Buddha statue

Full size image

Discussion

The stone Buddha statue, owned by the Chuncheon museum, was largely damaged and not in its original shape because many stone fragments were stored separately. The value of the stone Buddha statue has been appreciated from the perspective of art history; accordingly, the necessity of the restoration of its missing parts based on historic research has been raised. Therefore, in this study, a noncontact restoration of the stone Buddha statue was performed by converging various digital technologies, including 3D scanning, virtual restoration modeling, assembly simulation, and printing restoration.

Furthermore, 64.2% of the total missing parts were selected as the restoration scope, which was deemed necessary for the aesthetic and functional restoration. Moreover, the separately retained stone fragments were all used for the restoration. A digital virtual restoration of the missing parts was performed using the original-based symmetry modeling [45]. For the partial area in the head where symmetrization was difficult owing to damage to more than half of its part, restoration was performed through historical research and verification. In particular, throughout the modeling process, a haptic device and voxel software were used, facilitating an intuitive restoration process.

The assembly simulation using the design mockup was the most focused stage in the whole restoration process. Generally, virtual assembly simulation is widely used in medical and industrial fields to evaluate the impact of surface interference in advance [58], and virtual assembly based on various algorithms is used in the field of cultural heritage [59,60,61,62,63]. However, virtual assembly has its limitations when applied to the stone Buddha statue, the study object, whose joining surface is nonstructured and complicated.

Therefore, in this study, an alternative model for the original and virtual restoration models were 3D printed to minimize physical contact with the original stone statue. In particular, the 3D-printed alternative model was greatly useful for identifying the problems of the virtual restoration model by verifying the design mockup in real time, thus overcoming the physical constraints that did not allow assembly with the original statue. Moreover, the virtual restoration model was 3D printed and used for heuristic-based assembly simulation, thereby intuitively completing the restoration of the missing parts. This study serves as a remarkable case to shift toward the use of the noncontact digital method in restoration. It can also prevent secondary damage by minimizing physical contact with the original statue. In particular, the heuristic-based assembly simulation helped modify and improve the restoration plan and enhanced the restoration reliability, as the assembly result was intuitively reviewed and assessed.

Recently, several solutions for digital virtual assembly have been widely explored, mainly focused on the development of automatic strategies for matching fragments [64,65,66], measure of the surface profile [67], fusion of multiple features [63], and alignment using bridges [68]. Thus, state-of-the-art approaches have their weaknesses and strengths according to the application aims. The stone Buddha statue was not complex and had few fragments. In particular, most assembly parts were created through Boolean operation based on the original statue. Therefore, automatic and semiautomatic approaches for assembly are not important issues in this study. However, the development of an algorithm that could be used to modify the modeling of the interference between fractured surfaces must significantly reduce the frequency of design mockup assembly, and the whole process will be accomplished in a digital virtual environment.

Conclusions

1. In this study, digital recording of the original statue was performed using 3D scanning of the physically damaged stone Buddha statue and digital virtual restoration of the missing parts using a haptic modeling system. Moreover, the missing parts were restored using 3D printing technology after design mockup creation and assembly simulation.

2. The 3D model of the stone Buddha statue was created by converging the fixed high-precision scanning of the exterior and the handheld mid-precision scanning of the interior excavated hole. The 3D model showed a high resolution with an average point density of 0.2 mm. In particular, the 3D scanning result of the cone-shaped excavated hole revealed that two chisels, whose sizes were 10.5 and 15.4 mm on average, were used to carve the hole.

3. Using a 3D deterioration map of the stone Buddha statue, the area of the missing parts was measured to be 400.1 cm2 (5.5% of the total) of the total area (7,250 cm2). The restoration was performed only for 64.2% (257.1 cm2) of the total area of the missing parts, for which symmetry modeling was applicable or original forms could be estimated based on historical research. The restoration objects included four parts: the head, surrounding area of the Baekho, right ear, and right eye.

4. The virtual restoration of the missing parts of the stone Buddha statue was performed using a haptic modeling system: first, the location of the original fragments was determined; second, a reference model was selected and symmetry modeling was conducted; finally, the virtual restoration model was modified and improved, and estimation modeling through historical research and description of the outer shape was also used.

5. The created virtual restoration model was verified for its heuristic-based assembly suitability by design mockup printing and digital–analog simulation. Accordingly, the initial virtual restoration model decreased in volume by 5.2%. Moreover, the removed surface owing to the interference effect between the virtual restoration model and final design mockup was 33.4%, and their RMS was calculated to be 0.67 mm.

6. Photopolymerization 3D printing technology was used for the actual restoration of the stone Buddha statue, and considering the surface roughness, the material layer thickness was set at 0.10 mm. In addition, the surface of the printed output was colored to prevent yellowing, and the final restoration was completed by joining the missing parts of the statue.

7. This study serves as a remarkable case to shift from the traditional manual-contact method to the noncontact digital method in the restoration of artifacts, and heuristic-based assembly simulation helps in modifying and improving the restoration plan and enhances the restoration reliability. In the future, it is assumed that digital–analog-based restoration technology will be extensively used in the conservation of cultural artifacts.

Availability of data and materials

The datasets used and/or analysis results obtained in the current study are available from the corresponding author on request.

Abbreviations

3D:

Three-dimensional

PLA:

Polylactic acid

FOV:

Field of view

References

  1. Fitzner B. Porosity properties and weathering behavior of natural stones—methodology and examples. In Proceedings of the C.U.M. Second Course ‘Stone Materials in Monuments: Diagnosis and Conservation’, Heraklion—Crete 24–30; 1993, p. 43–54.

  2. Uchida E, Ogawa Y, Maeda N, Nakagawa T. Deterioration of stone materials in the Angkor monuments. Cambodia Eng Geol. 1999;55:101–12.

    Article  Google Scholar 

  3. Fitzner B, Heinrichs K, La Bouchardiere D. Damage index for stone monuments. In Proceedings of the 5th International Symposium on the Conservation of Monuments in the Mediterranean Basin, Sevilla, Spain, 5–8 April 2000, p 315–326.

  4. Hosono T, Uchida E, Suda C, Ueno A, Nakagawa T. Salt weathering of sandstone at the Angkor monuments, Cambodia: identification of the origins of salts using sulfur and strontium isotopes. J Archaeol Sci. 2006;33:1541–51.

    Article  Google Scholar 

  5. Jo YH, Lee CH, Chun YG. Material characteristics and deterioration evaluation for the 13th century Korean stone pagoda of Magoksa temple. Environ Earth Sci. 2012;66:915–22.

    Article  CAS  Google Scholar 

  6. Bartoli F, Municchia AC, Futagami Y, Kashiwadani H, Moon KH. Biological colonization patterns on the ruins of Angkor temples (Cambodia) in the biodeterioration vs. bioprotection debate. IntBiodeteriorBiodegrad. 2014;9:157–65.

    Google Scholar 

  7. Bonazza A, Vidorni G, Natali I, Ciantelli C, Giosuè C, Tittarelli F. Durability assessment to environmental impact of nano-structured consolidants on Carrara marble by field exposure tests. Sci Total Environ. 2017;575:23–32.

    Article  CAS  Google Scholar 

  8. Bonomo AE, Prosser G, Rizzo G, Sileo M. Degradation diagnosis on Gravina Calcarenite: classification and damage indexes on the Sassi di Matera site (Southern Italy). In Proceeding 3rd IMEKO International Conference on Metrology for Archaeology and Cultural Heritage, 23–25 October 2017; Lecce, Italy, pp 401–406.

  9. Bonomo AE, Amodio AM, Prosser G, Sileo M, Rizzo G. Evaluation of soft limestone degradation in the Sassi UNESCO site (Matera, Southern Italy): Loss of material measurement and classification. J Cult Herit. 2020;42:191–201.

    Article  Google Scholar 

  10. Machidon OM, Ivanovici M. Digital color restoration for the preservation of reversal film heritage. J Cult Herit. 2018;33:181–90.

    Article  Google Scholar 

  11. Rubeis T, Nardi I, Muttillo M, Paoletti D. The restoration of severely damaged churches–implications and opportunities on cultural heritage conservation, thermal comfort and energy efficiency. J Cult Herit. 2019;43:186–203.

    Article  Google Scholar 

  12. Yazdani S. Analysis of 19th and 20th century conservation key theories in relation to contemporary adaptive reuse of heritage buildings. Heritage. 2019;2:920.

    Article  Google Scholar 

  13. Lee CH, Jo YH, Kim J. Damage evaluation and conservation treatment of the tenth century Korean rock-carved Buddha statues. Environ Earth Sci. 2011;64:1–14.

    Article  CAS  Google Scholar 

  14. Becerra J, Mateo M, Ortiz P, Nicolas G, Zaderenko AP. Evaluation of the applicability of nano-biocide treatments on limestones used in cultural heritage. J Cult Herit. 2019;38:126–35.

    Article  Google Scholar 

  15. Gallo C, Rizzo P, Guerra G. Intercalation compounds of a smectite clay with an ammonium salt biocide and their possible use for conservation of cultural heritage. Heliyon. 2019;5:1–6.

    Google Scholar 

  16. Turk J, Pranjic AM, Hursthouse A, Turner R, Hughes JJ. Decision support criteria and the development of a decision support tool for the selection of conservation materials for the built cultural heritage. J Cult Herit. 2019;37:44–53.

    Article  Google Scholar 

  17. Sandbhor S, Botre R. A Systematic approach towards restoration of heritage buildings-a case study. Int J Res Eng Technol. 2013;2:229–38.

    Article  Google Scholar 

  18. Hou M, Yang S, Hu Y, Wu Y, Jiang L, Zhao S, Wei P. Novel method for virtual restoration of cultural relics with complex geometric structure based on multiscale spatial geometry. ISPRSInt J Geo Inf. 2018;7:1–20.

    Google Scholar 

  19. Gulotta D, Toniolo L. Conservation of the built heritage: pilot site approach to design a sustainable process. Heritage. 2019;2:797–812.

    Article  Google Scholar 

  20. Ahmed HT. Restoration of historical artifacts and made available for exhibition in museums. Life Sci J. 2015;12:183–92.

    Google Scholar 

  21. Lee SG, Jo SY, Huh IK. Manufacturing techniques and the conservation treatment of Chimi: (ridge-end tile) excavated from the Beopcheonsa Temple site, Wonju. Int J Con Sci. 2019;35:518–27.

    Google Scholar 

  22. Pavlidis G, Koutsoudis A, Arnaoutoglou F, Tsioukas V, Chamzas C. Methods for 3D digitization of cultural heritage. J Cult Herit. 2007;8:93–8.

    Article  Google Scholar 

  23. Remondino F, Rizzi A. Reality-based 3D documentation of natural and cultural heritage sites—techniques, problems, and examples. Appl Geomat. 2010;2:85–100.

    Article  Google Scholar 

  24. Remondino F. Heritage recording and 3D modeling with photogrammetry and 3D scanning. Remote Sens. 2011;3:1104–38.

    Article  Google Scholar 

  25. Jo YH, Hong S. Three-dimensional digital documentation of cultural heritage site based on the convergence of terrestrial laser scanning and unmanned aerial vehicle photogrammetry. ISPRS Int J Goe-Inf. 2019a;8:53.

    Article  Google Scholar 

  26. Lee CH, Jo YH, Kim SD. Three-dimensional image analysis deterioration evaluation and scientific conservation treatment of the Daechiri dinosaur trackways in Haman Country, Korea. J Geol Soc Kor. 2012;48:179–91.

    CAS  Google Scholar 

  27. Soler F, Melero FJ, Luzón MV. A complete 3D information system for cultural heritage documentation. J Cult Herit. 2017;23:49–57.

    Article  Google Scholar 

  28. Randhawa JS, Gupta A. Virtual restoration of artefacts using 3-D scanning system. Int J Mater Mech Manuf. 2018;6:308–12.

    Google Scholar 

  29. Merchan MJ, Merchan P, Salamanca S, Perez E, Nogales T. Digital fabrication of cultural heritage artwork replicas. In the search for resilience and socio-cultural commitment. Digi Apps Arch Cultural Heritage. 2019;15:1–11.

    Google Scholar 

  30. Nishanbaev I. A web repository for geo-located 3D digital cultural heritage models. Digi Apps Arch Cultural Heritage. 2020;16:1–9.

    Google Scholar 

  31. Davis A, Belton D, Helmholz P, Bourke P, McDonald J. Pilbara rock art: laser scanning, photogrammetry and 3D photographic reconstruction as heritage management tools. Herit Sci. 2017;5:1–16.

    Article  CAS  Google Scholar 

  32. Pan R, Tang Z, Da W. Digital stone rubbing from 3D models. J Cult Herit. 2019;37:44–53.

    Article  Google Scholar 

  33. Lerma JL, Muir C. Evaluating the 3D documentation of an early Christian upright stone with carvings from Scotland with multiples images. J Archaeol Sci. 2014;46:311–8.

    Article  Google Scholar 

  34. Delpiano D, Peresani M, Pastoors A. The contribution of 3D visual technology to the study of Palaeolithic knapped stones based on refitting. Digi Apps Arch Cultural Heritage. 2017;4:28–38.

    Google Scholar 

  35. Siebke I, Campana L, Ramstein M, Furtwängler A, Hafner A, Lösch S. The application of different 3D-scan-systems and photogrammetry at an excavation—A Neolithic dolmen from Switzerland. Digi Apps Arch Cultural Heritage. 2018;e00078:1–11.

    Google Scholar 

  36. Jo YH, Lee CH. Displacement analysis of five-story stone pagoda in Geumgolsan Mountain, Jindo, using terrestrial laser scanning. Indian J Sci Techno. 2016;9:1–6.

    Google Scholar 

  37. Zhang F, Campblee RI, Graham IJ. Application of additive manufacturing to the digital restoration of archaeological artifacts. Proc Technol. 2015;20:249–57.

    Article  Google Scholar 

  38. Balletti C, Ballarian M, Guerra F. 3D printing: state of the art and future perspectives. J Cult Herit. 2017;26:172–82.

    Article  Google Scholar 

  39. Segreto T, Bottillo A, Teti R, Galantucci LM, Lavecchia F, Galantucci MB. Non-contact reverse engineering modeling for additive manufacturing of down scaled cultural artefacts. CIRP Encyclopedia Production Eng. 2017;62:481–6.

    Google Scholar 

  40. Turner H, Resch G, Southwick D, Mcewen R, Dube AK, Record I. Using 3D printing to enhance understanding and engagement with young audiences: lessons from workshops in a museum. Curator Museum J. 2017;60:311–33.

    Article  Google Scholar 

  41. Wilson PF, Stott J, Warnet JM, Attridge A, Smith MP, Williams MA. Evaluation of touchable 3D-printed replicas in museums. Curator Museum J. 2017;60:446–65.

    Article  Google Scholar 

  42. Xu J, Ding L, Love PED. Digital reproduction of historical building ornamental components: from 3D scanning to 3D printing. Autom Constr. 2017;76:85–96.

    Article  Google Scholar 

  43. Vranich A. Reconstructing ancient architecture at Tiwanaku, Bolivia: the potential and promise of 3D printing. Herit Sci. 2018;6(65):1–20.

    Google Scholar 

  44. Ford S, Minshall T. Invited review article: where and how 3D printing is used in teaching and education. Addit Manuf. 2019;25:131–50.

    Google Scholar 

  45. Jo YH, Hong S. Application of three-dimensional scanning, haptic modeling, and printing technologies for restoring damaged artifacts. J Conserv Sci. 2019b;35:71–80.

    Article  Google Scholar 

  46. ICOMOS-ISCS. Illustrated glossary on stone deterioration patterns. Champigny/Marne France. 2008.

  47. Jo Y. A Study on the conservation of the Seated Stone Buddha and its scientific characteristics. Conserv Sci Muse. 2011;12:1–7.

    Google Scholar 

  48. Jo S, Kwon Y, Choi B. Conservation treatment of the Seated Stone Bodhisattva discovered in Pyeongchang and restoration of the statue using 3D digital technologies. Conserv Sci Muse. 2019;20:77–92.

    Google Scholar 

  49. Yang J, Li K, Li K, Lai YK. Sparse non-rigid registration of 3D shapes. Comput Graph Forum. 2015;34:89–99.

    Article  Google Scholar 

  50. Abidi MH, Ahmad A. Haptics assisted virtual assembly. IFAC-PapersOnLine. 2015;48:100–5.

    Article  Google Scholar 

  51. Wu W, Cen Y, Hong Y, Keeling A, Khambay B. A pilot study to assess the feasibility and accuracy of using haptic technology to occlude digital dental models. J Dent. 2016;46:54–60.

    Article  Google Scholar 

  52. Corrêa CG, Nunes FLS, Ranzini E, Nakamura R, Tori R. Haptic interaction for needle insertion training in medical applications: the state-of-the-art. Med Eng Phys. 2019;63:6–25.

    Article  Google Scholar 

  53. Rastogi N, Srivastava AK. Control system design for tokamak remote maintenance operations using assisted virtual reality and haptic feedback. Fusion Eng Des. 2019;139:47–54.

    Article  CAS  Google Scholar 

  54. Peavey EK, Zoss J. Simulation and mock-up research methods to enhance design decision making. HERD–Health Env Res. 2012;5:133–44.

    Google Scholar 

  55. Farah S, Anderson DG, Langer R. Physical and mechanical properties of PLA, and their functions in widespread applications—a comprehensive review. Adv Drug Deliver Rev. 2016;107:367–92.

    Article  CAS  Google Scholar 

  56. Samra APB, Pereira SK, Delgado LC, Borges CP. Color stability evaluation of aesthetic restorative materials. Braz Oral Res. 2008;22:205–10.

    Article  Google Scholar 

  57. Domingos PAS, Garcia PPNS, Oliveria ALBM, Palma-Dibb RG. Composite resin color stability: influence of light sources and immersion media. J Appl Oral Sci. 2011;19:204–11.

    Article  Google Scholar 

  58. Jurda M, Urbanova P, Chmelik J. Digital restoration of fragmentary human skeletal remains: testing the feasibility of virtual reality. J Forensic Leg Med. 2019;66:50–7.

    Article  Google Scholar 

  59. Papaodysseus C, Arabadjis D, Exarhos M, Rousopoulos P, Zannos S, Panagopoulos M, Manioudaki LP. Efficient solution to the 3D problem of automatic wall paintings reassembly. Comput Math Appl. 2012;64:2712–34.

    Article  Google Scholar 

  60. Oxholm G, Nishino K. A flexible approach to reassembling thin artifacts of unknown geometry. J Cult Herit. 2013;14:51–61.

    Article  Google Scholar 

  61. Schäfer A, Bock G, Sanday J, Leitte H. Virtually reassembling Angkor-style Khmer temples. Digi Apps Arch Cult Herit. 2015;2:2–11.

    Google Scholar 

  62. Tsiafaki D, Koutsoudis A, Arnaoutoglou F, Michailidou N. Virtual reassembly and completion of a fragmentary drinking vessel. Virt Arch Rev. 2016;7:67–76.

    Article  Google Scholar 

  63. Zhang Y, Li K, Chen X, Zhang S, Geng G. A multi feature fusion method for reassembly of 3D cultural heritage artifacts. J Cult Herit. 2018;33:191–200.

    Article  Google Scholar 

  64. Papaioannou G, Karabassi E. On the automatic assemblage of arbitrary broken solid artefacts. Image Vision Comput. 2003;21:401–12.

    Article  Google Scholar 

  65. Mellado N, Reuter P, Schlick S. Semi-automatic geometry-drive reassembly of fractured archaeological objects. Int Conf Virtual Reality Archaeol Cult Heritage. 2010. https://doi.org/10.2312/VAST/VAST10/033-038.

    Article  Google Scholar 

  66. Papaodysseus C, Arabadjis D, Exarhos M, Rousopoulos P, Zannos S, Panagopoulos M, Papazoglou-Manioudaki L. Efficient solution to the 3D problem of automatic wall paintings reassembly. Comput Math Appl. 2012;64:2712–34.

    Article  Google Scholar 

  67. Marie I, Qasrawi H. Virtual assembly of pottery fragments using moiré surface profile measurements. J Archaeol Sci. 2005;32:1527–33.

    Article  Google Scholar 

  68. Arbace L, Sonnino E, Callieri M, Dellepiane M, Fabbri M, Idelson AI, Scopigno R. Innovative uses of 3D digital technologies to assist the restoration of a fragmented terracotta statue. J Cult Herit. 2013;14:332–45.

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT, and Future Planning (NRF-2016R1C1B2010883). The authors would like to thank Chuncheon National Museum for their support of this paper.

Funding

This work was financially supported by the Chuncheon National Museum and the Ministry of Science, ICT, and Future Planning.

Author information

Authors and Affiliations

  1. Department of Cultural Heritage Conservation Sciences, Kongju National University, Gongju, 32588, Republic of Korea

    Young Hoon Jo & Seonghyuk Hong

  2. Conservation Science Laboratory, Chuncheon National Museum, Chuncheon, 24325, Republic of Korea

    Seong Yeon Jo & Yoon Mi Kwon

Authors
  1. Young Hoon Jo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seonghyuk Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seong Yeon Jo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yoon Mi Kwon
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the planning and design of this article. YHJ and SH performed the data acquisition and data analysis. SYJ and YMK performed the conservation treatment. YHJ wrote the manuscript and all authors revised it critically. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Young Hoon Jo.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jo, Y.H., Hong, S., Jo, S.Y. et al. Noncontact restoration of missing parts of stone Buddha statue based on three-dimensional virtual modeling and assembly simulation. Herit Sci 8, 103 (2020). https://doi.org/10.1186/s40494-020-00450-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40494-020-00450-8

Keywords

  • Three-dimensional scanning
  • Three-dimensional printing
  • Haptic modeling system
  • Digital virtual restoration
  • Design mockup
  • Assembly simulation
  • Noncontact restoration