Next Generation of In-situ Precision Three-dimensional Surface Metrology: A Smart Self-adaptive Multiscopic Approach for Industrial 4.0

Professor Tsoi, Kit Hon   (Co-Principal Investigator (Co-PI) (for projects led by other university))

Cheung Chi Fai Benny   (Project coordinator)

48

2023-04-01

1961600

Next Generation of In-situ Precision Three-dimensional Surface Metrology: A Smart Self-adaptive Multiscopic Approach for Industrial 4.0

In-situ measurement, Multiscopic, Precision surface metrology, Smart selfadaptive, Industry 4.0

Production and Manufacturing

R5047-22

Research Impact Fund (RIF) 2022/23

2022

On-going

(1) To study the key issues, science and technology of in-situ measurement of precision threedimensional (3D) surfaces, and the state-of-the-art methods in the field of autostereoscopic 3Dmeasurement technology, light field technology, advanced optical system design, advanced sensingtechnology for real-time position and status tracking, machine learning-based depth extractionmethod, inhomogeneous data fusion, and smart self-adaptive technology; as well as variousmachine-learning super-resolution technologies;(2) To research and develop the smart self-adaptive multiscopic (SAMS) in-situ precision 3Dmeasurement principle by developing the multiscopic scheme shared by various functional 3Dmeasurement components that can simultaneously acquire raw 3D information for further dataprocessing, integrating real-time position and status tracking methods to acquire the spatial positionof the measurement system in the global coordinate system, and developing the related dataprocessing method for 3D reconstruction based on datasets acquired from multiplex usage ofdifferent functional 3D measurement components, data fusion method for the output of measurementresults based on processed measurement datasets and status information and smart self-adaptionmethod for the selection and adjustment of the measurement strategy;(3) To develop the technological framework and the building blocks of functional modules for thesmart SAMS system including a multiscopic optical (MSO) module to perform multiplex acquisitionof raw 3D information, as well as an integrated real-time position and status tracking (IRPST)module to determine the spatial position and state in the global coordinate system with high accuracyfor the smart SAMS system; an artificial-intelligence-based data processing and fusion (AIDPF)module for 3D surface reconstruction and measurement; and a machine learning-based self-adaption(MLSA) module that can adjust the measurement strategy under various measurement scenarios andenvironments;(4) Hence, to establish the smart SAMS system with different configurations by integrating andcustomizing the building blocks of functional modules according to different in-situ precision 3Dmeasurement scenarios and applications for Industry 4.0 including endoscopic configuration for nonline-of-sight (NLOS) 3D measurement, profilometric configuration for direct 3D surfacemeasurement, as well as robotic 3D measurement and inspection configuration;(5) To verify the overall performance of the smart SAMS system through a series of in-situ precision3D measurement experiments conducted on purposely designed and calibrated complex 3D surfacesunder a wide range of manufacturing scenarios and to compare the performance with other in-situmeasurement methods and systems. Hence, to undertake a series of pilot projects for the industrialpartners to further refine, customize and realize the capability of the smart SAMS system accordingto the measurement needs under different manufacturing scenarios and industrial environments.