Skip to main content

Table 4 Partial RAG evaluation results

From: Nanjing Yunjin intelligent question-answering system based on knowledge graphs and retrieval augmented generation technology

Question

Generated Content

Context

True answer in context

F

AR

CP

CR

CRY

For what occasions was Nanjing Yunjin mainly used in ancient times?

Nanjing Yunjin was mainly used in ancient times for royal court clothing and as a special product for the royal family during the Yuan, Ming, and Qing dynasties

…… this shows the status of Yun brocade in the royal ruling class. ……

Nanjing Yunjin was mainly used for royal clothing in ancient times and was a symbol of the royal family

1

1

1

1

1

Where is Nanjing Yunjin produced?

Nanjing Yunjin is produced in Nanjing, Jiangsu Province, China

……many comrades recalled and expressed their gratitude to this artist who made outstanding contributions to the protection, inheritance and development of Nanjing', 'respectively.……

Nanjing Yunjin is produced in Nanjing, Jiangsu Province, China

1

1

1

1

1

What are the main raw materials of Nanjing Yunjin?

Silk is the main raw material for Nanjing Yunjin. The material is soft to the touch, delicate, smooth, and wear-resistant. In addition to silk, gold and silver threads, and peacock feather threads are also commonly used in Yunjin production

Third step is the preparation of raw materials (such as gold and silver thread, peacock thread) Feather thread and silk raw materials that require nearly ten processes for processing and dyeing)……

Mainly mulberry silk, sometimes gold and silver thread, peacock feathers and other special materials are also used

1

1

1

1

1

When was Nanjing Yunjin Research Institute established?

The Nanjing Yunjin Research Institute was established on December 5, 1957

In March 1957, the Yunjin Research Institute was formally established. ……

1957

1

1

1

1

1

What does Bufu mean?

The information does not provide enough context or information to answer this question in detail, so I cannot provide a definitive answer

The inheritance and dissemination trend of Nanjing Yunjin in the new era ……

Bufu also refers to the official uniforms worn by ancient Chinese officials. Because of the distinctive Buzi pattern on the clothing, it is called Bufu

0.5

0

0

0.5

0

  1. In the table, F denotes Faithfulness, AR denotes Answer Relevancy, CP denotes Context Precision, CR denotes Context Recall, and CRY denotes Context Relevancy