a case study of virtual museum: reconstruction and restoration of dunhuang caves in china jiaoying...
TRANSCRIPT
![Page 1: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/1.jpg)
A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves i
n China
Jiaoying ShiState Key Lab of CAD&CG
College of Computer Science and EngineeringZhejiang University
![Page 2: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/2.jpg)
Contents
1. Introduction of Dunhuang Mogao Caves2. Reconstruction of Dunhuang Mogao Cave
s3. Restoration of the Murals in Dunhuang Mo
gao Caves
![Page 3: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/3.jpg)
1. Introduction of Dunhuang Mogao Caves1) It’s located in North-West desert area of China
2) Start excavating in Jin Dynasty(336 A.D), 1600 years old.
![Page 4: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/4.jpg)
3) There still exist 492 intact caves, more than 2400 painted sculptures, over 45000 square meter murals and wood architectures of Tang and Song Dynasty
muralsmurals
painted sculpturespainted sculptures
architecturesarchitectures
![Page 5: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/5.jpg)
4) Named as World History and Culture Heritage by UNESCO in 1987
UNITED NATIONS EDUCATIONAL UNITED NATIONS EDUCATIONAL SCIENTIFIC AND CULTURAL ORGSCIENTIFIC AND CULTURAL ORG
ANIZATIONANIZATIONCONVENTION CONCERNING THE CONVENTION CONCERNING THE
PROTECTION OF PROTECTION OF THE WORLD CULTURAL AND NATTHE WORLD CULTURAL AND NAT
URAL HERITAGEURAL HERITAGEThe World Heritage CommitteeThe World Heritage Committee
Has inscribedHas inscribedThe Mogao CavesThe Mogao Caves
On the world Heritage listOn the world Heritage listInscription on this List confirms the eInscription on this List confirms the e
xceptionalxceptionalAnd universal value of a cultural orAnd universal value of a cultural or
Natural site which requires protection Natural site which requires protection for the benefitfor the benefitOf all humanityOf all humanity
![Page 6: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/6.jpg)
5) The perennial invasion of sand blown by the wind has also done great damage to the treasury, thus putting it in severe danger.
6) In order to protect the Mogao Caves furthermore, today a severe measure of limiting the visitors number is taken by the local administrator.
7) So it is very urgent to build a virtual Museum of Dunhuang Mogao Caves to disseminate this World Cultural Heritage broadly.
![Page 7: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/7.jpg)
2. Reconstruction of Dunhuang Mogao Caves• Surveying the caves
• Modeling the caves
![Page 8: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/8.jpg)
• Digitizing the murals
◆
ph
oto
gra
ph
ing
p
hoto
gra
ph
ing
b
rack
et
bra
cket
◆
Dem
o o
f Sh
ootin
gD
em
o o
f Sh
ootin
g
The criterion: well-proportioned lighting, parallel moving The criterion: well-proportioned lighting, parallel moving and partial overlapsand partial overlaps
![Page 9: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/9.jpg)
• Mapping the murals onto the model
MappingMapping
![Page 10: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/10.jpg)
Mosaicing ImagesMosaicing Images
![Page 11: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/11.jpg)
• Digitization of three-dimensional culture relics
• Acquiring Acquiring high-high-precision precision 3D models 3D models by 3D by 3D scannerscanner
• The model acquired by 3D scanThe model acquired by 3D scan
![Page 12: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/12.jpg)
• Digitization and modeling of outdoor scene
1
2
Take photos of out-door scene in a fixed Take photos of out-door scene in a fixed pointpoint
Adjusting and Adjusting and mosaicingmosaicing
![Page 13: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/13.jpg)
Demo1: The navigation of Dunhuang Mogao Caves
![Page 14: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/14.jpg)
Demo2: The navigation of Outdoor Scene of Dunhuang Mogao Caves
![Page 15: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/15.jpg)
3. Restoration of the Murals of Dunhuang Mogao Caves• The murals and sculptures in Dunhuang Mogao C
aves have experienced color changes and impairment over 1600 years.
• Introducing 3 techniques for virtual restoration of the mural color of Dunhuang Mogao Caves.
![Page 16: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/16.jpg)
Virtual Color Virtual Color RestorationRestoration
Reasoning Reasoning Based on Based on Scientific Scientific
RulesRules
AnalogicaAnalogical Thinking l Thinking
ModelModel
Reasoning Reasoning Based on Based on
experience experience knowledgeknowledge
![Page 17: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/17.jpg)
1) Reasoning Based on Scientific Rules
ExperiencExperience e
KnowledgKnowledge e
Chemical Chemical Color Color
Changing Changing RuleRule
Physical Physical Color Color
Changing Changing RuleRule
ComputComputerer
Color Changing ModelColor Changing Modelin Computerin Computer
![Page 18: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/18.jpg)
Chemical Color Changing RuleAccording to the chemical knowledge of Dunhuang researAccording to the chemical knowledge of Dunhuang researchers, we got the Chemical Color Changing Rule.chers, we got the Chemical Color Changing Rule.
Changing graduallyChanging gradually
Red Lead OxideRed Lead Oxide (PbO (PbO22 ) + Oxygen(O ) + Oxygen(O2 2 ) Pb) Pb33OO44
![Page 19: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/19.jpg)
Physical Color Changing RuleOver some time t, the color gradually Over some time t, the color gradually changes or fades by covered dust. changes or fades by covered dust. It is essential a color mixing process of the It is essential a color mixing process of the mural’s color and dust’s colormural’s color and dust’s color
Let mural color Let mural color CCbb (( RRbb ,, GGbb ,, BBbb )) , dust color , dust color CCff (( RRff ,, GGff ,, BBff )) , the transparence of , the transparence of CCff be be XX%, then the mixing color is:%, then the mixing color is:
%)%)1(%,%)1(
%,%)1((%),,(
XBXBXGXG
XRXRXCCA
bfbf
bffb
RGB(160,168,171) + RGB(119,71,31) RGB(150,144,136)RGB(160,168,171) + RGB(119,71,31) RGB(150,144,136) 25% Transparence25% Transparence
![Page 20: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/20.jpg)
2) Analogous Thinking Model
The same dynastyThe same dynastyand caveand cave
•Multi-layer Multi-layer muralmural•This is the inner layer This is the inner layer not been oxygenatednot been oxygenatedafter outer layer fell offafter outer layer fell off
The unoxygenated color elementThe unoxygenated color elementprovide the source knowledge for provide the source knowledge for analogous reasoninganalogous reasoning
![Page 21: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/21.jpg)
3) Reasoning Based on Experience Knowledge of the Dunhuang Artists and Researchers
The set of Dunhuang typical color of the Tang Dynasty:The set of Dunhuang typical color of the Tang Dynasty:
RedRed
YellowYellow
BlueBlue
GreenGreen
BrownBrown
GrayGray
WhiteWhite
GoldenGolden
![Page 22: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/22.jpg)
Color Region ObtainingColor Region Obtaining
Edge DestinationEdge Destination
Color LayeringColor Layering
Based on the set of typicBased on the set of typical color of Dunhuangal color of Dunhuang
Reasoning Based on Experience Knowledge of the Dunhuang Artists and Researchers
![Page 23: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/23.jpg)
Refer the Refer the color well-color well-protected protected mural image mural image to restoreto restore
Source ImageSource Image
Anology ReferenceAnology Reference
Destination Destination ImageImage
Dunhuang Mural Color Virtual Restoration—Example of Color Faded Restoration
![Page 24: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/24.jpg)
Dunhuang Mural Color Virtual Restoration—Example of Color Faded Restoration
According to the According to the Chemical Color Chemical Color Gradually Gradually Changing Rule to Changing Rule to restorerestore
Source ImageSource Image Destination Destination ImageImage
Chemical Color Gradually Changing RuleChemical Color Gradually Changing Rule
![Page 25: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/25.jpg)
Dunhuang Mural Color Virtual Restoration—Example of Color Faded Restoration
Integrating Color Integrating Color Faded Faded RestorationRestoration and Color and Color Changed Changed RestorationRestoration
Source ImageSource Image Destination Destination ImageImage
![Page 26: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/26.jpg)
Dunhuang Mural Color Virtual Restoration—Example of Color Faded Restoration
Using Created Using Created Pattern to Pattern to restore faded restore faded regionregion
Source ImageSource Image
Created PatternCreated Pattern
Destination ImageDestination Image
![Page 27: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/27.jpg)
Demo3: Dunhuang Mural Color Changing Process
![Page 28: A Case Study of Virtual Museum: Reconstruction and Restoration of Dunhuang Caves in China Jiaoying Shi State Key Lab of CAD&CG College of Computer Science](https://reader035.vdocuments.mx/reader035/viewer/2022062321/56649dab5503460f94a999ea/html5/thumbnails/28.jpg)
Thanks!