Realistic and interactive image-based rendering of ancient chinese artifacts using a multiple camera array

Abstract

This paper proposes a system for photorealistic interactive rendering of ancient Chinese artifacts for cultural heritage preservation using multiview images captured by a circular multiple-camera array. It employs 3D reconstruction and precomputed shadow field techniques to enable real-time relighting and object interaction. Moreover, Gabor features are employed to improve the robustness of line matching along epipolar lines and robust radial basis function modeling is employed to suppress possible outliers arising from false matching. Using the 3D model reconstructed, the precomputed shadow field is employed to provide real-time rendering/relighting and object movement, after acceleration on a graphic processing unit (GPU). Excellent rendering results are obtained and the ancient Chinese artifacts can be displayed in modern multi-view displays and conventional stereo systems. © 2011 IEEE.