Skip to main content

Applications of visible spectral imaging technology for pigment identification of colored relics

Abstract

Identifying pigments from colored relics is essential for their color restoration and for facsimile creation. A workflow for identifying pigment information is constructed based on visible spectral imaging technology, aligned with the drawing process of colored relics. This workflow includes three steps: boundary extraction, material identification and prediction of mixture proportions. The methods for segmenting visible spectral images, identifying chemical compositions, and predicting mixture proportions of pigments are extensively reviewed. Future research trends of these methods are also analyzed. The influence of the pigment particle size is currently underexplored but can be accomplished by multidisciplinary research.

Introduction

Colored relics offer invaluable insights into past cultures, societies, and artistic practices. They act as tangible links to historical events, religious beliefs, and daily life, showcasing the technological advancements, materials, and techniques of ancient civilizations. These relics also enable historians and archaeologists trace the evolution of artistic styles and cross-cultural influences across history. Unfortunately, many of these historically significant relics have suffered from severe decolorization, fading, and discoloration due to factors such as human activities, environmental changes, and natural disasters. To preserve their integrity and enhance their aesthetic appeal, it is crucial to provide accurate and scientific pigment information for color restoration and for facsimile creation. This information is expected to encompass details such as the application boundary, chemical composition, physical properties, and mixture proportions of the pigments, reflecting the original painting techniques used.

Advancements in digital technologies have provided effective methods for pigment identification, aiding in the color restoration and facsimile creation of colored relics. Initially, researchers employed techniques such as scanning electron microscopy, energy spectrum analysis [1,2,3], X-ray diffraction [4,5,6] and Fourier transform infrared spectroscopy [7,8,9] to identify the chemical composition of pigments in colored relics. However, these methods are invasive or minimally invasive, as they require collecting small samples from the colored relics. Recently, many non-contact analysis techniques have been developed. Their devices such as handheld Raman spectrometers [10, 11], spectroradiometers [12, 13] and optical fiber reflectance spectrometers [14,15,16] are now available, offering portability and ease of use, making them popular among scholars and conservationists. Despite the advantages of these techniques, they only provide point-by-point analysis, identifying pigment information at specific locations without offering spatial information that reflects spatial distribution of the pigments. As a result, they fall short of fully meeting the needs for guiding color restoration and facsimile creation of colored relics.

To capture the spatial information of colored relics, scanners or digital cameras with high spatial resolution have been widely used. These devices rely on trichromatic theory, meaning the color data (i.e., RGB values) they capture reflects the specific lighting and observation conditions at the time of capture. Let \(S(\lambda )\) denote the spectral power distribution of the illumination, \(\rho (\lambda )\) the visible spectral reflectance of the pigment, and \(r(\lambda )\), \(g(\lambda )\) and \(b(\lambda )\) the three-channel response characteristics (observation condition) of the devices. The RGB values can then be expressed as follows:

$$\begin{array}{*{20}c} {R = \int_{\lambda } {S(\lambda )\rho (\lambda )r(\lambda )d\lambda } } \\ {G = \int_{\lambda } {S(\lambda )\rho (\lambda )g(\lambda )d\lambda } } \\ {B = \int_{\lambda } {S(\lambda )\rho (\lambda )b(\lambda )d\lambda } } \\ \end{array}$$
(1)

It is clear that the color data represents the photometric integration of light reflected from pigments back to the imaging device after being illuminated by a light source. This color data depends on the device and illumination conditions, and any changes in illumination or the acquisition device can alter the recorded color information [17]. Because the color data reflects various factors, including illumination condition, the device used, and the pigments of the relics, there is no direct relationship between the color data and the actual pigment materials. This can lead to the phenomenon of metamerism [18], which can cause inaccuracies when using this color data for color restoration and facsimile creation of the relics.

Visible spectral reflectance is a crucial physical property of materials that characterizes their color regardless of illumination and observation conditions. In recent years, visible spectral imaging technology has been extensively researched for recording both the visible spectral reflectance and spatial information of colored relics [19]. Compared to the previously mentioned techniques, the imaging system used in visible spectral imaging is simple, cost-effective, and noninvasive, making it ideal for analyzing colored relics. Furthermore, this technology provides high-resolution spatial information and accurate color data for colored relics. The high spatial resolution can be used to identify the boundaries of pigments applied to colored relics, while the color information can help deduce the chemical composition, physical properties, and mixture proportions of the pigments. Since visible spectral reflectance acts as a "fingerprint" for an object and is independent of device and lighting conditions, visible spectral imaging technology can offer systematic guidance for pigment identification in the color restoration and reproduction of colored relics. This capability relies on fully utilizing the features of visible spectral images and accurately establishing the connections between these features and pigment information.

Visible spectral imaging and framework for pigment identification

A variety of visible spectral imaging techniques and systems have been documented in the literature, which can be categorized into four main types [19]: wavelength-scan methods, spatial-scan methods, time-scan methods, and simultaneous acquisition methods. Wavelength-scan methods capture images one wavelength at a time. Spatial-scan methods acquire the entire visible spectrum for a specific region of the image at a time, scanning the image sequentially, such as single-pixel detection [20] or line by line [21]. These methods are advantageous for capturing the visible spectrum of linearly moving objects but are relatively slow in acquisition speed. Time-scan methods collect a series of images, each representing a combination of spectral or spatial information. The final data is then processed to generate the complete spectral image, such as using Fourier methods [22, 23] or Hadamard transform [24]. Time-scan methods allows for the collection of intensity at each wavelength throughout the entire measurement period. However, even if only a few points along the spectral range are needed, the entire spectrum must still be gathered. Simultaneous acquisition methods such as color filter array [25, 26] capture the entire spectral image at once but may trade off in terms of spectral resolution, field of view, or spatial resolution.

Wavelength-scan methods are frequently used in the digital preservation of colored relics due to their advantages in acquisition speed, field of view, and spatial resolution. A conventional method for capturing visible spectral images involves placing a set of optical filters in a filter wheel in front of a monochrome camera [27]. Each optical filter transmits a narrow band of wavelengths, and images are sequentially captured through each filter. A more efficient method is to use tunable filters, such as liquid–crystal tunable filter (LCTF) [28, 29] or acousto-optical tunable filter (AOTF) [30, 31], in front of a monochrome camera. An LCTF can transmit a narrow-band wavelength by applying a varying voltage to a polarizable liquid crystal situated between two linear polarizers. An AOTF deforms into a grating with a specific period at each frequency of the acoustic waves, allowing it to transmit different wavelengths in a given direction. Tunable filters are compact and robust due to their lack of moving parts, but they tend to be expensive. Using RGB cameras and optical filters with a wide band of wavelengths significantly enhances acquisition speed [32,33,34]. With the aid of spectral reconstruction algorithms [35], using two filters with two shots to obtain six channels can achieve relatively high-precision visible spectral images. Another promising method is based on LED illumination. Initially, a set of LEDs are selected, each LED is illuminated in sequence, and a monochrome camera captures an image under each LED, thus producing a visible spectral image by spectral reconstruction [36, 37]. To increase the acquisition speed, an RGB camera and three LEDs are optimally combined to acquire nine channels with three shots [38, 39]. The visible spectral image is then obtained through reconstruction. For a more comprehensive assessment of the performance and quality of the various imaging systems, including both qualitative and quantitative evaluations, please refer to references [40,41,42,43].

A detailed analysis of colored relics is crucial for fully unlocking the potential of visible spectral imaging in pigment identification. The drawing process of Chinese colored relics typically involves three stages: drafting, outlining, and coloring, as illustrated in Fig. 1. Drafting involves determining the position and proportion of patterns using long horizontal lines; outlining defines the boundaries for pigment application; and coloring involves filling in pigments within these boundaries to assign colors. To effectively guide color restoration and facsimile creation of colored relics, research on visible spectral images should focus on several key aspects: segmenting the images based on the spatial distribution of pigments to define boundaries for pigment application; developing models to correlate visible spectral reflectance with pigment material information for accurate identification; and establishing models to predict pigment mixture proportions from visible spectral reflectance for precise color matching.

Fig. 1
figure 1

Painting process of colored relics

A framework for pigment identification using visible spectral imaging technology is presented, as depicted in the upper part of Fig. 2. The framework begins by examining the spatial correlation between pigment distribution and image pixels. It details the pixel features used to assess pigment similarity and establishes an image segmentation method to extract pigment boundaries. To provide material information of the pigments, a standard visible spectral reflectance database with known chemical composition and physical properties is created for reference. The framework identifies the chemical composition of the pigments by preprocessing visible spectral reflectance to eliminate noise in the original data, constructing a spectral feature space to characterize the chemical composition information, and defining matching criteria to differentiate between chemical compositions. Based on the identified chemical composition, physical properties such as pigment particle size are determined by extracting spectral features, modeling the relationship between physical properties and spectral features, and fitting data to these models. The framework also explores the light propagation mechanism in the pigment layer and the optical properties of mixed multicomponent pigments compared to their monocomponent counterparts to understand color rendering in colored relics. To achieve this, a forward spectral prediction model is first established to map the optical properties and proportions of monocomponent pigments to the visible spectral reflectance of mixed pigments. Then, a corresponding reverse proportion prediction model is created to map the relationship back. The optimal pigment mixture proportion is obtained as the optimal solution to the reverse proportion prediction model using optimization methods. Additionally, the framework is designed for continuous improvement through effective verification and evaluation.

Fig. 2
figure 2

Flowchart of the pigment identification of the colored relics based on the visible spectral images

Based on the above framework, the aim of the following review is to summarize the applications of visible spectral imaging technology in identifying pigments in colored relics. The main content of the review includes the following steps: segmentation of visible spectral images for boundary extraction, identification of pigment material information, and prediction of pigment mixture proportions.

Segmentations of visible spectral image for boundary extraction

Visible spectral images capture high-spatial resolution, two-dimensional details of colored relics and preserve the boundaries of pigments. These boundaries can be extracted through segmentation of the visible spectral images. Current segmentation methods for visible spectral images can be categorized into three types: methods based on single-pixel [44,45,46,47], methods based on spectral feature similarity between pixels [48,49,50], and methods based on superpixels.

Methods based on single-pixel

Methods based on single-pixel consider each pixel as a fundamental segmentation unit to map the spatial distribution of pigments in colored relics. These methods are convenient for subsequent pigment identification and therefore are widely used in early studies. For example, researchers have analyzed the visible spectral images of paintings such as Van Gogh's "The Starry Night," [51] Seurat's "A Sunday Afternoon on La Grande Jatte," [52] and Munch's "The Scream." [51]

When the pigment particles are small enough, the original pattern of the colored relics can be treated as a continuous-tone image. This approach preserves as much detail as possible and allows for accurate pigment identification in regions where colors transition. However, if the particle size of the pigments is larger than the size of each pixel in the visible spectral image, the identified pigment information in the pixels where different pigments overlap may become distorted. Furthermore, these methods face challenges such as large data processing demands and a lack of boundary information for the pigments.

Methods based on spectral feature similarity between pixels

These methods focus on the similarity of spectral features between pixels in visible spectral images. They group pixels with similar spectral properties together, regardless of their spatial location, to represent the spatial distribution of pigments. Many traditional image segmentation techniques have been used to organize pixels for boundary extraction of pigments. Researchers have employed these techniques to analyze visible spectral images of artworks like Van Gogh's "The Starry Night" [53] and the frescoes of Gautama Temple [54]. While these methods effectively extract pigment boundaries and reduce data processing needs, they often struggle with accurately delineating pigment contours in connected areas and providing precise color details. As illustrated in Fig. 3, this limitation can result in errors when identifying and interpreting pigments in colored relics.

Fig. 3
figure 3

Segmentation based on spectral feature similarity between pixels result in lost details. The left half is the original image; the right half is the segmented image

Superpixel methods

In colored relics, the same pigment often forms spatially connected blocks that span multiple neighboring pixels with similar spectral features. Previous segmentation methods have not accounted for this spatial organization, leading to inaccuracies in extracting pigment boundaries. To address this, superpixel methods that integrate both spectral and spatial similarities between pixels have been introduced to better capture the painting characteristics of colored relics [55,56,57]. As demonstrated in Fig. 4, these segmented superpixels are irregular clusters of neighboring pixels with similar spectral features, offering a more precise depiction of pigment boundaries.

Fig. 4
figure 4

Superpixel segmentation of a visible spectral image

Given the emerging trend in boundary extraction from visible spectral images, it is crucial to further explore the spatial relationship between image pixels and pigment distribution in colored relics. To accurately represent both the color details and the boundaries of pigment application, new segmentation methods should be developed. These methods should organize the pixels of visible spectral images in a way that effectively characterizes the pigment distribution in colored relics while preserving as much color detail as possible.

Identification of pigment material information

The chemical composition and physical properties of pigments determine their visible spectral reflectance. Conversely, the visible spectral reflectance provides insights into the chemical composition and physical properties of the pigments, allowing for the inference of material information. Identifying the chemical composition of pigments is a frequent subject in the literature. Currently, methods for analyzing the chemical composition of pigments can be categorized into two types: manual identification and automatic identification.

Manual identification

Manual Identification is an early method for identifying the chemical composition of pigments. It primarily relied on the human eye to visually compare features such as the shape of visible spectral reflectance and the similarity of derivative characteristics between the standard sample and the test sample to determine the pigment composition of the test sample. By comparing the shape of visible spectral reflectance, Cavaleri et al. [58] identified the pigments of the fresco in an ex-church in Piedmont. Similarly, Vitorino et al. [59] identified the red lake pigments in fourteenth to sixteenth centuries paintings. Wang et al. [60] identified the pigments from Tang Dynasty tombs by analyzing the shape of visible spectral reflectance combined with its first derivative characteristic peaks. However, relying on visual comparison is inefficient and highly dependent on experience, making it unsuitable for pixel-level batch processing of visible spectral images of colored relics.

Automatic identification

Each pigment has a distinct interaction with electromagnetic radiation, absorbing and reflecting certain wavelengths of light. This interaction results in a unique feature in its visible spectral reflectance, which can be used to identify the pigment. Automatic identification involves using various algorithms to analyze visible spectral reflectance to automatically identify the chemical composition of pigments. This process typically consists of at least three key steps: preprocessing, feature extraction, and identification modeling. Preprocessing prepares the raw visible spectral reflectance data for analysis, which can involve tasks such as data cleaning, normalization and scaling to remove noise or correct for environmental factors. Feature extraction focuses on extracting the relevant features from the preprocessed data. The selection of appropriate features is crucial, as it can significantly influence the performance of the identification model. Commonly used features include the visible spectral reflectance data, the first and second derivatives of the data, spectral angle, spectral correlation coefficients and principal component analysis [61,62,63]. In identification modeling step, a model is built to identify pigments based on the extracted features. This could involve using various machine learning algorithms such as decision trees, support vector machines or neural networks [48, 64,65,66].

Reference database

Pigment material information is identified through comparison or training, which require the preparation of standard samples to create a reference database of visible spectral reflectance. The accuracy of this identification is significantly influenced by the variety of pigment types used, as well as the methods employed for preparing and measuring the standard samples. To ensure precise identification, standard samples should be prepared following the drawing process of the specific identification target, and their visible spectral reflectance should be measured under the same geometric conditions as those used for acquiring visible spectral images of colored relics. Additionally, the standard database should include a wide range of pigment types to cover those used in the identification target. Cosentino [67] has established a comprehensive standard reference database for identifying pigments in oil paintings. In China, Chai [68] and Ding [69] have established reference databases that include 29 and 31 color blocks, respectively.

In addition to chemical composition, physical properties such as particle size are another important aspect of pigment material information [70,71,72]. As shown in Fig. 5, the particle size of mineral pigments significantly influences their color, with saturation and lightness being strongly determined by particle size. Some qualitative and quantitative analyses of the relationship between pigment particle size and color have been discussed in reference [73,74,75]. Painters have long mastered the techniques of grinding and rinsing mineral pigments to effectively control particle size and enhance color richness. This phenomenon is commonly observed in colored relics [55]. Figure 6 illustrates the identification results of wall paintings in the Mogao Grottoes, where both color blocks 1 and 2 are lapis lazuli, but their colors differ due to variations in particle size. These findings highlight the significance of particle size as a key technical parameter for identifying pigment material information, crucial for guiding the scientific color restoration and facsimile creation of colored relics. Despite its significance, this topic has not been extensively studied, and few reports focus on identifying the pigment particle size of colored relics based on visible spectral reflectance. In our previous research, we introduced three methods for this purpose: the image texture-based identification method [76], the graph-based identification method, and the parametric identification method [77]. Zou et al. proposed a model that uses principal component analysis and nonlinear curve fitting to identify the particle size of various malachite samples used in ancient Chinese colored relics [78]. It is important to point out that the relationship between visible spectral reflectance, chemical composition, and particle size of pigments remains unclear. Current methods for identifying chemical composition do not fully account for the interaction between chemical composition and particle size on visible spectral reflectance. Therefore, the effectiveness of these methods needs further investigation. Moreover, the reference database must also consider the particle size and the aging properties of the pigments.

Fig. 5
figure 5

Changes in malachite color resulting from variations in pigment particle size, with sizes decreasing from left to right

Fig. 6
figure 6

Western wall of cave 288 in the Mogao Grottoes. 1 and 2 are lapis lazuli pigments with different colors and particle sizes

Prediction of pigment mixture proportions

A mixture of monocomponent pigments with different colors can create new colors. This phenomenon is commonly seen in colored relics to achieve a variety of colors. When restoring colored relics, the color of the restored area should match the surrounding area, regardless of lighting and viewing conditions. This means the restored area must have the same visible spectral reflectance as the surrounding area. The visible spectral reflectance of a multicomponent pigment depends on the proportions of its monocomponent pigments, so determining these proportions based on the visible spectral reflectance of the multicomponent pigment is necessary for color restoration of colored relics. This can be accomplished by constructing color prediction models, which include a forward spectral prediction model and a reverse proportion prediction model.

Forward spectral prediction model

The reverse proportion prediction model is derived from the forward spectral prediction model, making the accuracy of the forward model crucial for accurate proportion prediction. The forward spectral prediction model involves a mapping relationship \(F\) of the visible spectral reflectance from the proportion of monocomponent pigments to the mixed multicomponent pigment, as follows:

$$r_{mix,\lambda } = F\left( {c_{1} ,c_{2} , \ldots ,c_{n} ,r_{1,\lambda } ,r_{2,\lambda } , \ldots ,r_{n,\lambda } } \right)$$
(2)

where \(n\) represents the number of monocomponent pigments mixed, \(\lambda\) is the wavelength of the visible spectral reflectance, \(r_{i,\lambda }\) is the visible spectral reflectance of each monocomponent pigment, \(c_{i}\) is the corresponding proportion, and \(r_{mix,\lambda }\) is the visible spectral reflectance of the multicomponent pigment.

Although many linear unmixing techniques from remote sensing [79,80,81] have been used to model pigment mapping relationships [82,83,84], these methods differ fundamentally from the pigment mapping process. In remote sensing, each pixel samples a larger spatial area, and the radiance measured is influenced by various materials within that area, making linear unmixing effective for modeling its mapping relationships. In contrast, pigment mixtures often consist of small particles evenly distributed in a binding medium, known as intimate mixtures. Consequently, the overall visible spectral reflectance is not simply a linear combination of the visible spectral reflectance of the monocomponent pigments [42]. To accurately develop the forward spectral prediction model and model the mapping relationships, it is crucial to understand the mechanism of light propagation within the pigment layer and the optical relationship between the multicomponent pigment and its monocomponent constituents.

The Kubelka–Munk (K-M) theory is commonly employed to describe the light propagation mechanism in the pigment layer [85,86,87]. According to this theory, light is considered to diffuse through a homogeneous and isotropic medium, where it is absorbed and scattered in both upward and downward directions. The absorbing and scattering property of a pigment, denoted as \({k \mathord{\left/ {\vphantom {k s}} \right. \kern-0pt} s}\), are linked to the visible spectral reflectance \(r\) of the pigment layer. Specifically, \({k \mathord{\left/ {\vphantom {k s}} \right. \kern-0pt} s}\) is defined as follows:

$$\frac{k}{s} = \frac{{(1 - r)^{2} }}{2r}$$
(3)

Duncan [88] was the first to report on the relationship between the optical properties of multicomponent pigments and their monocomponent pigments. The absorbing and scattering properties \(\left( {{k \mathord{\left/ {\vphantom {k s}} \right. \kern-0pt} s}} \right)_{mix,\lambda }\) of a multicomponent pigment can be viewed as a linear combination of the absorbing and scattering properties \(\left( {{k \mathord{\left/ {\vphantom {k s}} \right. \kern-0pt} s}} \right)_{i,\lambda }\) of its monocomponent pigments, with the corresponding proportions serving as coefficients. This relationship is defined as follows:

$$\left( \frac{k}{s} \right)_{mix,\lambda } = \sum\nolimits_{i = 1}^{n} {c_{i} \left( \frac{k}{s} \right)_{i,\lambda } }$$
(4)

K‒M theory combined with Duncan theory forms the forward spectral prediction model. This model assumes that the interior of the pigment layer is homogeneous and isotropic. However, in colored relics, the particle size of mineral pigments varies from a few microns to several hundred microns, and the particles are irregularly shaped, leading to the formation of voids in the pigment layer. The current model does not account for these effects, and a previous study [89] has shown that particle size significantly impacts the model's prediction accuracy. It is crucial to determine how this effect manifests in colored relics, re-examine the light propagation mechanism in mineral pigment layers, and develop new models to accurately map the relationship between visible spectral reflectance, mixing proportions, and particle size of the pigments.

Reverse proportion prediction model

The inverse proportion prediction model aims to map the visible spectral reflectance of a multicomponent pigment to the proportion of each monocomponent pigment. Ideally, this model serves as the inverse function \(F^{{{ - }1}}\) of the forward spectral prediction model \(F\). However, the forward spectral prediction model is often complex, making it difficult to derive an analytical equation for the inverse function directly. Consequently, the inverse proportion prediction process is typically treated as a constrained optimization problem, as described below:

$$\begin{gathered} \left( {c_{1}^{\prime } ,c_{2}^{\prime } ,..,c_{n}^{\prime } } \right) = \mathop {\arg \min }\limits_{{c_{1} ,c_{2} , \ldots ,c_{n} }} \left\| {{\mathbf{r}}_{predicted} - {\mathbf{r}}_{targeted} } \right\|_{2}^{2} \hfill \\ \begin{array}{*{20}c} { \, s.t. \, {\mathbf{r}}_{predicted} { = }F(c_{1} ,c_{2} , \ldots ,c_{n} ,r_{1,\lambda } ,r_{2,\lambda } , \ldots ,r_{n,\lambda } )} \\ {\sum\limits_{i = 1}^{n} {c{}_{i}} = 1} \\ {c_{1} ,c_{2} ,..,c_{n} \ge 0} \\ \end{array} \hfill \\ \end{gathered}$$
(5)

where \({\mathbf{r}}_{targeted}\) represents the visible spectral reflectance of the colored relics to be restored. \((c_{1}{\prime} ,c_{2}{\prime} ,..,c_{n}{\prime} )\) is the predicted optimal proportion of the monocomponent pigments, such that the visible spectral reflectance of the multicomponent pigment matches the visible spectral reflectance of the colored relics as closely as possible.

Considerable research has been conducted on predicting pigment proportions based on visible spectral images by inverting the K-M theory [86, 90, 91]. These studies primarily focus on identifying pigments by referencing an existing database of monocomponent pigments. For example, Zhao et al. [92] conducted an in-depth analysis of Vincent van Gogh’s “The Starry Night”, where they utilized a preexisting database of pure pigments to determine the closest match. With limited or no prior knowledge of the pigments present, Taufique et al. [93] proposed a new method for analyzing the Selden Map. They estimated abundances and performed classification in the abundance space, which can significantly reduce the workload of the model.

In earlier studies, color tristimulus values were frequently used as the matching target for reverse proportion prediction models, with linear iterative optimization employed to predict the proportions of monocomponent pigments [94]. As shown in Eq. (5), visible spectral reflectance is used as the matching target for predicting the proportions of monocomponent pigments. The traditional linear optimization strategy cannot provide a solution in this case. Thus, exploring optimal nonlinear optimization methods is necessary for accurate pigment proportion predictions. Additionally, unlike models based on optical principles, some methods predict proportions directly using nonlinear spectral unmixing techniques [95,96,97]. However, the effectiveness of these methods in predicting the proportions of pigment mixtures in colored relics requires further validation.

Conclusion

Visible spectral imaging technology offers a non-destructive way to capture both the spatial and spectral information of colored relics. This technology reveals the chemical composition and physical properties of the pigments used, as well as the true color characteristics of the relics. By understanding and modeling the relationships between image characteristics and the spatial distribution, chemical composition, particle size, and mixture proportion of pigments, challenges in pigment selection for color restoration and facsimile creation can be effectively addressed. Currently, the use of visible spectral images for pigment identification is gaining traction across various fields such as analytical chemistry, color science, and cultural heritage conservation. While researchers have developed several models with promising results, a comprehensive theoretical and technical framework has yet to be fully established, largely because visible spectral imaging technology has only recently advanced. Some significant challenges remain, particularly regarding how pigment particle size affects boundary extraction, material identification, and mixture proportion prediction. This research area is inherently multidisciplinary, involving applied optics, imaging science, image processing, analytical chemistry, and color science. Although interdisciplinary research has made some progress, only through deeper collaboration across multiple disciplines can these issues be thoroughly resolved. Given the low cost and simplicity of visible spectral imaging devices, this technology holds the potential to systematically identify pigments, facilitating pigment selection for color restoration and facsimile creation. Additionally, these methods can be extended to industries such as textiles, printing, dyeing, and coating, as well as agriculture for applications such as seed screening and plant disease detection. When combined with spectroscopic techniques like Raman and Fourier transform infrared spectroscopy, visible spectral imaging can provide more comprehensive and accurate analyses.

Availability of data and materials

No datasets were generated or analysed during the current study.

References

  1. Yang J, Zhou ZB, Lu TJ, Shen L. Investigation of gold gilding materials and techniques applied in the murals of Kizil Grottoes, Xinjiang, China. Appl Sci Basel. 2022;12:11202. https://doi.org/10.3390/app122111202.

    Article  CAS  Google Scholar 

  2. Zhang ZG, Ma QL, Berke H. Man-made blue and purple barium copper silicate pigments and the pabstite (BaSnSi3O9) mystery of ancient Chinese wall paintings from Luoyang. Heritage Sci. 2019;7:97. https://doi.org/10.1186/s40494-019-0340-4.

    Article  CAS  Google Scholar 

  3. Manship E, Cavallo G, Gilardi J, Riccardi MP. Treating smalt: a preliminary SEM-EDX study of the effects of aqueous-based alkaline conservation treatments on smalt in wall paintings. Stud Conserv. 2021;6:1–16. https://doi.org/10.1080/00393630.2021.1940721.

    Article  CAS  Google Scholar 

  4. Li JZ, Zha JR, Pan XX, Zhao T, Li JF, Guo H. A study of song dynasty polychrome statue-making techniques and materials in the sage mother hall of the Jinci Temple, Shanxi, China. Crystals. 2022;12:1003. https://doi.org/10.3390/cryst12071003.

    Article  CAS  Google Scholar 

  5. He J, Zhou W, Hu D, Liu S, Otero J, Rodriguez-Navarro C. A multi-analytical approach for the characterization of materials, manufacturing process and damage mechanisms of wall paintings in Samye Temple. Tibet Dyes Pigments. 2022;207:110704. https://doi.org/10.1016/j.dyepig.2022.110704.

    Article  CAS  Google Scholar 

  6. Moon D-H, Lee N-R, Lee E-W. Ancient pigments in Afrasiab murals: characterization by XRD, SEM, and Raman spectroscopy. Minerals. 2021;11:939.

    Article  CAS  Google Scholar 

  7. Prati S, Joseph E, Sciutto G, Mazzeo R. New advances in the application of FTIR microscopy and spectroscopy for the characterization of artistic materials. Acc Chem Res. 2010;43:792–801.

    Article  CAS  PubMed  Google Scholar 

  8. Fikri I, El Amraoui M, Haddad M, Ettahiri AS, Falguères C, Bellot-Gurlet L, Lamhasni T, Ait Lyazidi S, Bejjit L. Raman and ATR-FTIR analyses of medieval wall paintings from al-Qarawiyyin in Fez (Morocco). Spectrochim Acta A Mol Biomol Spectrosc. 2022;280:121557. https://doi.org/10.1016/j.saa.2022.121557.

    Article  CAS  PubMed  Google Scholar 

  9. Flores-Sasso V, Pérez G, Ruiz-Valero L, Martínez-Ramírez S, Guerrero A, Prieto-Vicioso E. Physical and chemical characterisation of the pigments of a 17th-century mural painting in the Spanish Caribbean. Materials. 2021;14:6866.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Papliaka ZE, Philippidis A, Siozos P, Vakondiou M, Melessanaki K, Anglos D. A multi-technique approach, based on mobile/portable laser instruments, for the in situ pigment characterization of stone sculptures on the island of Crete dating from Venetian and Ottoman period. Heritage Sci. 2016;4:15. https://doi.org/10.1186/s40494-016-0085-2.

    Article  CAS  Google Scholar 

  11. Li Y, Wang F, Ma J, He K, Zhang M. Study on the pigments of Chinese architectural colored drawings in the Altar of Agriculture (Beijing, China) by portable Raman spectroscopy and ED-XRF spectrometers. Vib Spectrosc. 2021;116:103291. https://doi.org/10.1016/j.vibspec.2021.103291.

    Article  CAS  Google Scholar 

  12. Li J, Wan X. Non-destructive identification of mineral pigments in ancient murals by visible spectroscopy. Spectrosc Spectral Anal. 2018;38:200–4. https://doi.org/10.3964/j.issn.1000-0593(2018)01-0200-05.

    Article  CAS  Google Scholar 

  13. Li M, Wei C, Wan X, Li J. Pigment identification and color analysis of ancient murals based on visible spectroscopy. Laser Optoelectron Progress. 2021;58:403–10.

    Google Scholar 

  14. Zhang W, Su B, Yin Y, Shui B, Qiang C, Yu Z, Shan Z. In-situ nondestructive analysis of the mural pigments in Northern Liang Caves at the Tiandishan Grottoes. Dunhuang Res. 2019. https://doi.org/10.13584/j.cnki.issn1000-4106.2019.04.018.

    Article  Google Scholar 

  15. Zhao X, Wang L. Progress in the analysis and conservation of cultural relics and artworks with fiber optic reflectance spectroscopy. Spectrosc Spectral Anal. 2017;37:21–6.

    Google Scholar 

  16. Fonseca B, Patterson CS, Ganio M, MacLennan D, Trentelman K. Seeing red: towards an improved protocol for the identification of madder- and cochineal-based pigments by fiber optics reflectance spectroscopy (FORS). Heritage Sci. 2019;7:15. https://doi.org/10.1186/s40494-019-0335-1.

    Article  CAS  Google Scholar 

  17. Tu L, Ma X, Du J, Xu Y. Research on digital acquisition of Dunhuang murals color. Art Des. 2019. https://doi.org/10.16272/j.cnki.cn11-1392/j.2019.01.008.

    Article  Google Scholar 

  18. Sciuto C, Cantini F, Chapoulie R, Cou C, De la Codre H, Gattiglia G, Granier X, Mounier A, Palleschi V, Sorrentino G. What lies beyond sight? Applications of ultraportable hyperspectral imaging (VIS-NIR) for archaeological fieldwork. J Field Archaeol. 2022. https://doi.org/10.1080/00934690.2022.2135066.

    Article  Google Scholar 

  19. Garini Y, Young IT, McNamara G. Spectral imaging: principles and applications. Cytometry A. 2006;69A:735–47. https://doi.org/10.1002/cyto.a.20311.

    Article  Google Scholar 

  20. Meng H, Gao Y, Wang X, Li X, Wang L, Zhao X, Sun B. Quantum dot-enabled infrared hyperspectral imaging with single-pixel detection. Light Sci Appl. 2024;13:121. https://doi.org/10.1038/s41377-024-01476-4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Biener G, Stoneman MR, Acbas G, Holz JD, Orlova M, Komarova L, Kuchin S, Raicu V. Development and experimental testing of an optical micro-spectroscopic technique incorporating true line-scan excitation. Int J Mol Sci. 2014;15:261–76.

    Article  Google Scholar 

  22. Candeo A, Ardini B, Ghirardello M, Valentini G, Clivet L, Maury C, Calligaro T, Manzoni C, Comelli D. Performances of a portable Fourier transform hyperspectral imaging camera for rapid investigation of paintings. Eur Phys J Plus. 2022;137:409. https://doi.org/10.1140/epjp/s13360-022-02598-7.

    Article  CAS  Google Scholar 

  23. Malik Z, Cabib D, Buckwald RA, Talmi A, Garini Y, Lipson SG. Fourier transform multipixel spectroscopy for quantitative cytology. J Microsc. 1996;182:133–40. https://doi.org/10.1046/j.1365-2818.1996.131411.x.

    Article  CAS  Google Scholar 

  24. Hanley QS, Verveer PJ, Arndt-Jovin DJ, Jovin TM. Three-dimensional spectral imaging by hadamard transform spectroscopy in a programmable array microscope. J Microsc. 2000;197:5–14. https://doi.org/10.1046/j.1365-2818.2000.00665.x.

    Article  CAS  PubMed  Google Scholar 

  25. Miao L, Qi H, Ramanath R, Snyder WE. Binary tree-based generic demosaicking algorithm for multispectral filter arrays. ITIP. 2006;15:3550–8. https://doi.org/10.1109/TIP.2006.877476.

    Article  Google Scholar 

  26. Feng K, Zhao Y, Chan JCW, Kong SG, Zhang X, Wang B. Mosaic convolution-attention network for demosaicing multispectral filter array images. IEEE Trans Comput Imaging. 2021;7:864–78. https://doi.org/10.1109/TCI.2021.3102052.

    Article  Google Scholar 

  27. Hill B. The history of multispectral imaging at Aachen University of Technology. Spectral Vision. 2002; 2–8. http://www.ite.rwth-aachen.de/Inhalt/Documents/Hill/AachenMultispecHistory05.pdf. Accessed Dec 2013.

  28. Zhang J, Li J. Spectral shift correction and adaptive band selection for multispectral imaging. OptLE. 2021;144:106632. https://doi.org/10.1016/j.optlaseng.2021.106632.

    Article  Google Scholar 

  29. Chen X, Guo T, Lin Z, Xu X, Zhang Z, Wang N, He S. A high throughput tunable filter module for multispectral imaging. Adv Opt Mater. 2024;12:2302009. https://doi.org/10.1002/adom.202302009.

    Article  CAS  Google Scholar 

  30. Li X, Gao M, Liu J, Li Y, Feng Y. Design of MWIR hyperspectral imagers based on acousto-optic tunable filters. Optik. 2023;276:170636. https://doi.org/10.1016/j.ijleo.2023.170636.

    Article  CAS  Google Scholar 

  31. Djakonov EA, Polikarpova NV. Acousto-optic methods for multispectral scanning of the multi-layer image in the field of art history. In Proceedings of the 2024 Wave Electronics and its Application in Information and Telecommunication Systems (WECONF), 3–7 June 2024, 2024; 1–4.

  32. Tominaga S, Sakai H. Spectral reflectance estimation from camera responses using local optimal dataset. J Imaging. 2023;9:47.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Finlayson GD, Zhu Y. Designing color filters that make cameras more colorimetric. ITIP. 2021;30:853–67. https://doi.org/10.1109/TIP.2020.3038523.

    Article  Google Scholar 

  34. Niu S, Wu G, Li X. Spectral filter selection based on human color vision for spectral reflectance recovery. Sensors. 2023;23:5225.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Zhang J, Su R, Fu Q, Ren W, Heide F, Nie Y. A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging. Sci Rep. 2022;12:11905. https://doi.org/10.1038/s41598-022-16223-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Park JI, Lee MH, Grossberg MD, Nayar SK. Multispectral imaging using multiplexed illumination. In Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, 14–21 Oct. 2007, 2007; 1–8.

  37. Shrestha R, Hardeberg JY, Boust C. LED based multispectral film scanner for accurate color imaging. In Proceedings of the 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems, 25–29 Nov. 2012, 2012; 811–817.

  38. Li H, Li G, Ye Y, Lin L. A high-efficiency acquisition method of LED-multispectral images based on frequency-division modulation and RGB camera. Opt Commun. 2021;480:126492. https://doi.org/10.1016/j.optcom.2020.126492.

    Article  CAS  Google Scholar 

  39. Li HN, Feng J, Yang WP, Wang L, Xu HB, Cao PF, Duan JJ. Multi-spectral imaging using LED illuminations. In Proceedings of the 2012 5th International Congress on Image and Signal Processing, 16–18 Oct. 2012, 2012; 538–542.

  40. Kuzio O, Farnand S. Comparing practical spectral imaging methods for cultural heritage studio photography. J Comput Cult Herit. 2022;16:11. https://doi.org/10.1145/3531019.

    Article  Google Scholar 

  41. Shrestha R, Hardeberg JY. Evaluation and comparison of multispectral imaging systems. In Proceedings of the Proceedings of IS&T 22nd Color and Imaging Conference, 2014; 107–112.

  42. Liang H. Advances in multispectral and hyperspectral imaging for archaeology and art conservation. Appl Phys A. 2012;106:309–23. https://doi.org/10.1007/s00339-011-6689-1.

    Article  CAS  Google Scholar 

  43. Jones C, Duffy C, Gibson A, Terras M. Understanding multispectral imaging of cultural heritage: determining best practice in MSI analysis of historical artefacts. J Cult Herit. 2020;45:339–50. https://doi.org/10.1016/j.culher.2020.03.004.

    Article  Google Scholar 

  44. Corradini M, de Ferri L, Pojana G. Fiber optic reflection spectroscopy-near-infrared characterization study of dry pigments for pictorial retouching. Appl Spectrosc. 2021;75:445–61. https://doi.org/10.1177/0003702820957641.

    Article  CAS  PubMed  Google Scholar 

  45. Pottier F, Kwimang S, Michelin A, Andraud C, Goubard F, Lavedrine B. Independent macroscopic chemical mappings of cultural heritage materials with reflectance imaging spectroscopy: case study of a 16th century Aztec manuscript. Anal Methods. 2017;9:5997–6008. https://doi.org/10.1039/c7ay00749c.

    Article  Google Scholar 

  46. Melo MJ, Nabais P, Vieira M, Araujo R, Otero V, Lopes J, Martin L. Between past and future: advanced studies of ancient colours to safeguard cultural heritage and new sustainable applications. Dyes Pigm. 2022;208:12. https://doi.org/10.1016/j.dyepig.2022.110815.

    Article  CAS  Google Scholar 

  47. Galli A, Gargano M, Bonizzoni L, Bruni S, Interlenghi M, Longoni M, Passaretti A, Caccia M, Salvatore C, Castiglioni I, et al. Imaging and spectroscopic data combined to disclose the painting techniques and materials in the fifteenth century Leonardo atelier in Milan. Dyes Pigm. 2021;187:15. https://doi.org/10.1016/j.dyepig.2020.109112.

    Article  CAS  Google Scholar 

  48. Grabowski B, Masarczyk W, Głomb P, Mendys A. Automatic pigment identification from hyperspectral data. J Cult Herit. 2018;31:1–12. https://doi.org/10.1016/j.culher.2018.01.003.

    Article  Google Scholar 

  49. Kleynhans T, Messinger DW, Delaney JK. Towards automatic classification of diffuse reflectance image cubes from paintings collected with hyperspectral cameras. Microchem J. 2020;157:104934.

    Article  CAS  Google Scholar 

  50. Wei D, Wang H, Wang K, Wang Z, Zhen G. Pigment classification method of mural sparse multi-spectral image based on space spectrum joint feature. Acta Photonica Sin. 2022;51:195–208.

    Google Scholar 

  51. Deborah H, George S, Hardeberg JY. Spectral-divergence based pigment discrimination and mapping: a case study on The Scream (1893) by Edvard Munch. J Am Inst Conserv. 2019;58:90–107. https://doi.org/10.1080/01971360.2018.1560756.

    Article  Google Scholar 

  52. Berns RS, Byrns S, Casadio F, Fiedler I, Gallagher C, Imai FH, Newman A, Taplin LA. Rejuvenating the color palette of Georges Seurat’s A Sunday on La Grande Jatte-1884: a simulation. Color Res Appl. 2006;31:278–93. https://doi.org/10.1002/col.20223.

    Article  Google Scholar 

  53. Zhao YH, Berns RS, Taplin LA, Coddington J. An investigation of multispectral imaging for the mapping of pigments in paintings. In Proceedings of the Conference on Computer Image Analysis in the Study of Art, San Jose, CA, Jan 28–29, 2008.

  54. Cao P, Lyu S, Wang W, Gao Z, Hou M. Extraction of mural paint loss regions based on spectral dimensionality reduction and Hu moment. J Graph. 2020;41:930–8. https://doi.org/10.11996/JG.j.2095-302X.2020060930.

    Article  Google Scholar 

  55. Li JF, Wan XX. Superpixel segmentation and pigment identification of colored relics based on visible spectral image. Spectrochim Acta Part a Mol Biomol Spectrosc. 2018;189:275–81. https://doi.org/10.1016/j.saa.2017.08.042.

    Article  CAS  Google Scholar 

  56. Magro N, Bonnici A, Cristina S. Ieee. Hyperspectral image segmentation for paint analysis. In Proceedings of the IEEE International Conference on Image Processing (ICIP), Electr Network, Sep 19–22, 2021; 1374–1378.

  57. Xu WY, Thomasson JA, Su Q, Ji CY, Shi YY, Zhou J, Chen H. A segmentation algorithm incorporating superpixel block and holistically nested edge for sugarcane aphids images under natural light conditions. Biosys Eng. 2022;216:241–55. https://doi.org/10.1016/j.biosystemseng.2022.02.011.

    Article  CAS  Google Scholar 

  58. Cavaleri T, Giovagnoli A, Nervo M. Pigments and mixtures identification by visible reflectance spectroscopy. Proc Chem. 2013;8:45–54. https://doi.org/10.1016/j.proche.2013.03.007.

    Article  CAS  Google Scholar 

  59. Vitorino T, Casini A, Cucci C, Melo MJ, Picollo M, Stefani L. Non-invasive identification of traditional red lake pigments in fourteenth to sixteenth centuries paintings through the use of hyperspectral imaging technique. Appl Phys A Mater Sci Process. 2015;121:891–901. https://doi.org/10.1007/s00339-015-9360-4.

    Article  CAS  Google Scholar 

  60. Wang LQ, Dang GC, Zhao J. Nondestructive analysis and identification of pigments on colored relies by fiber optic reflectance spectroscopy. Spectrosc Spectr Anal. 2008;28:1722–5.

    CAS  Google Scholar 

  61. Balas C, Epitropou G, Tsapras A, Hadjinicolaou N. Hyperspectral imaging and spectral classification for pigment identification and mapping in paintings by El Greco and his workshop. Multimed Tools Appl. 2018;77:9737–51. https://doi.org/10.1007/s11042-017-5564-2.

    Article  Google Scholar 

  62. Xu WZ, Tang XJ, Zhang G, Yang FC, Huang X, Li X, Liu DY, Zhao XC. Research on mural painting appreciatione based on spectral imaging and spectral analysis. Spectrosc Spectr Anal. 2017;37:3235–41. https://doi.org/10.3964/j.issn.1000-0593(2017)10-3235-07.

    Article  CAS  Google Scholar 

  63. Fan C, Zhang P, Wang S, Hu B. A study on classification of mineral pigments based on spectral angle mapper and decision tree. SPIE. 2018; 10806.

  64. Chen A, Jesus R, Vilarigues M. Identification of pure painting pigment using machine learning algorithms. In Proceedings of the Artificial Intelligence in Music, Sound, Art and Design, Cham, 2021//, 2021; 52–64.

  65. Liu L, Miteva T, Delnevo G, Mirri S, Walter P, de Viguerie L, Pouyet E. Neural networks for hyperspectral imaging of historical paintings: a practical review. Sensors. 2023;23:2419.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Kleynhans T, Schmidt Patterson CM, Dooley KA, Messinger DW, Delaney JK. An alternative approach to mapping pigments in paintings with hyperspectral reflectance image cubes using artificial intelligence. Heritage Sci. 2020;8:84. https://doi.org/10.1186/s40494-020-00427-7.

    Article  Google Scholar 

  67. Cosentino A. FORS spectral database of historical pigments in different binders. E Conserv J. 2014. https://doi.org/10.18236/econs2.201410.

    Article  Google Scholar 

  68. Chai B, Su B, Wen-yuan Z, Wang X, Li L. Standard multispectral image database for paint materials used in the Dunhuang Murals. Spectrosc Spectral Anal. 2017;37(10):3289–306. https://doi.org/10.3964/j.issn.1000-0593(2017)10-3289-18.

    Article  CAS  Google Scholar 

  69. Ding X. Study on cultural relics pigments based on hyperspectral imaging technology. Cult Geogr. 2014;24:204–5. https://doi.org/10.3969/j.issn.2095-0446.2014.24.150.

    Article  Google Scholar 

  70. Liang H, Keita K, Peric B, Vajzovic T. Pigment identification with optical coherence tomography and multispectral imaging. In Proceedings of the The 2nd International Topical Meeting on Optical Sensing and Artificial Vision, Saint-Petersburg, RU, 2008; 33–42.

  71. Cesaratto A, Nevin A, Valentini G, Brambilla L, Castiglioni C, Toniolo L, Fratelli M, Comelli D. A novel classification method for multispectral imaging combined with portable Raman spectroscopy for the analysis of a painting by Vincent Van Gogh. Appl Spectrosc. 2013;67:1234–41. https://doi.org/10.1366/13-07032.

    Article  CAS  PubMed  Google Scholar 

  72. Lau D, Villis C, Furman S, Livett M. Multispectral and hyperspectral image analysis of elemental and micro-Raman maps of cross-sections from a 16th century painting. Anal Chim Acta. 2008;610:15–24. https://doi.org/10.1016/j.aca.2007.12.043.

    Article  CAS  PubMed  Google Scholar 

  73. Yang X-L, Wan X-X. Analysis of the spectral reflectance and color of mineral pigments affected by their particle size. Color Res Appl. 2020;45:246–61. https://doi.org/10.1002/col.22455.

    Article  Google Scholar 

  74. Gueli AM, Bonfiglio G, Pasquale S, Troja SO. Effect of particle size on pigments colour. Color Res Appl. 2017;42:236–43. https://doi.org/10.1002/col.22062.

    Article  Google Scholar 

  75. Elias M. Relationship between the size distribution of mineral pigments and color saturation. Appl Opt. 2011;50:2464–73. https://doi.org/10.1364/AO.50.002464.

    Article  PubMed  Google Scholar 

  76. Zhu W, Wan X, Li J, Li C, Jin G, Liu Q. Nondestructive pigment size detection method of mineral paint film based on image texture. JEI. 2016;26:011002.

    Google Scholar 

  77. Li J, Wan X, Bu Y, Li C, Liang J, Liu Q. In situ identification of pigment composition and particle size on wall paintings using visible spectroscopy as a noninvasive measurement method. Appl Spectrosc. 2016;70:1900–9. https://doi.org/10.1177/0003702816645608.

    Article  CAS  PubMed  Google Scholar 

  78. Zou W, Yeo SY. Non-destructive prediction of the mixed mineral pigment content of ancient chinese wall paintings based on multiple spectroscopic techniques. Appl Spectrosc. 2024;78:702–13. https://doi.org/10.1177/00037028241248199.

    Article  CAS  PubMed  Google Scholar 

  79. Wei J, Wang X. An overview on linear unmixing of hyperspectral data. Math Probl Eng. 2020;2020:3735403. https://doi.org/10.1155/2020/3735403.

    Article  Google Scholar 

  80. Li Z, Altmann Y, Chen J, Mclaughlin S, Rahardja S. Sparse linear spectral unmixing of hyperspectral images using expectation-propagation. ITGRS. 2022;60:1–13. https://doi.org/10.1109/TGRS.2022.3147423.

    Article  Google Scholar 

  81. Brown M, Lewis H. Support vector machines and linear spectral unmixing for remote sensing. In Proceedings of the International Conference on Advances in Pattern Recognition, London, 1999//, 1999; 395–404.

  82. Valero EM, Martínez-Domingo MA, López-Baldomero AB, López-Montes A, Abad-Muñoz D, Vílchez-Quero JL. Unmixing and pigment identification using visible and short-wavelength infrared: reflectance vs logarithm reflectance hyperspaces. J Cult Herit. 2023;64:290–300. https://doi.org/10.1016/j.culher.2023.10.016.

    Article  Google Scholar 

  83. Deborah H, Ulfarsson MO, Sigurdsson J. Fully constrained least squares linear spectral unmixing of The Scream (Verso, 1893). In Proceedings of the 2021 11th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), 24–26 March 2021, 2021; 1–5.

  84. Bai D, Messinger D, Howell D. Hyperspectral analysis of cultural heritage artifacts: pigment material diversity in the Gough Map of Britain. OptEn. 2017;56:081805.

    Google Scholar 

  85. Fazlali F, Kandi SG. Identification of pigments in artworks by inverse tangent derivative of spectrum and a new filtering method. Heritage Sci. 2020;8:10. https://doi.org/10.1186/s40494-020-00438-4.

    Article  Google Scholar 

  86. Kirchner E, van der Lans I, Ligterink F, Geldof M, Gaibor ANP, Hendriks E, Janssens K, Delaney J. Digitally reconstructing Van Gogh’s field with irises near Arles. Part 2: pigment concentration maps. Color Res Appl. 2018;43:158–76. https://doi.org/10.1002/col.22164.

    Article  Google Scholar 

  87. Zhao Y, Berns RS. Predicting the spectral reflectance factor of translucent paints using Kubelka-Munk turbid media theory: review and evaluation. Color Res Appl. 2009;34:417–31. https://doi.org/10.1002/col.20525.

    Article  Google Scholar 

  88. Duncan D. The colour of pigment mixtures. PPS. 1940;52:390–401.

    CAS  Google Scholar 

  89. Li J, Wan X. Spectrophotometric color prediction of mineral pigments with relatively large particle size by single- and two-constant Kubelka- Munk theory. In Proceedings of the 25th Color and Imaging Conference: Color Science and Engineering Systems, Technologies, and Applications, CIC 2017, September 11, 2017 - September 15, 2017, Lillehammer, Norway. 2017; 324–329.

  90. Moghareh Abed F, Berns RS. Linear modeling of modern artist paints using a modification of the opaque form of Kubelka-Munk turbid media theory. Color Res Appl. 2017;42:308–15. https://doi.org/10.1002/col.22086.

    Article  Google Scholar 

  91. Tsuji M, Fujimura Y, Funatomi T, Mukaigawa Y, Morimoto T, Oishi T, Takamatsu J, Ikeuchi K. Pigment mapping for tomb murals using neural representation and physics-based model. In Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2–6 Oct. 2023, 2023; 1663–1671.

  92. Zhao Y, Berns RS, Taplin LA, Coddington J. An investigation of multispectral imaging for the mapping of pigments in paintings. In Proceedings of the Electronic imaging, 2008.

  93. Taufique AMN, Messinger D. Hyperspectral pigment analysis of cultural heritage artifacts using the opaque form of Kubelka-Munk theory; SPIE: 2019; 10986.

  94. Li JF, Xie DH, Li MX, Liu SW, Wei CA. Optimal learning samples for two-constant Kubelka-Munk theory to match the color of pre-colored fiber blends. Front Neurosci. 2022;16:10. https://doi.org/10.3389/fnins.2022.945454.

    Article  Google Scholar 

  95. Lyu S, Meng D, Hou M, Tian S, Huang C, Mao J. Nonlinear mixing characteristics of reflectance spectra of typical mineral pigments. Minerals. 2021;11:626.

    Article  CAS  Google Scholar 

  96. Cai J, Chatoux H, Boust C, Mansouri A. Extending the unmixing methods to multispectral images. In Proceedings of the International Conference on Communications in Computing, 2021.

  97. Radpour R, Kleynhans T, Facini M, Pozzi F, Westerby M, Delaney JK. Advances in automated pigment mapping for 15th-century manuscript illuminations using 1-D convolutional neural networks and hyperspectral reflectance image cubes. Appl Sci. 2024;14:6857.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was funded by the Natural Science Foundation of Henan (232300421384), the Key Science and Technology Program of Henan (232102210177), and the Key Scientific Research Projects of Higher Education Institutions of Henan (23A416008).

Author information

Authors and Affiliations

Authors

Contributions

The method design and implementation by C.W.; the conceptualization, overall framework and method design, research supervision and funding acquisition by J.L.; and S.L. contributed to the writing of the manuscript. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Junfeng Li.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, Ca., Li, J. & Liu, S. Applications of visible spectral imaging technology for pigment identification of colored relics. Herit Sci 12, 321 (2024). https://doi.org/10.1186/s40494-024-01434-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40494-024-01434-8

Keywords