In a terminal-guiding image processing system,a single-mode image processing system will bring some problems,such as low matching precision and low anti-dis turbing ability.So a multi-mode image processing system is becoming a better choice.In this paper, based on multi-DSP chip and multi-FPGA chip,the distributed management hardware architecture system,which is composed of interface management and image matching computation,is proposed and used for realizing a multi-mode image pr ocessing system. This system is compatible with optical and RF modes.There are three advantages o f this system:high real-time performance,high reconfigurability,and high universal.Moreover,based on the compound terminal-guiding image processing system hardware platform in this paper,diffe rent FPGA pre-process algorithms are used for achieving image pre-processing under diffe rent modes,and then the SIFT feature matching algorithm is proposed for realizing image parallel matchin g computation. Experiments show that the compound terminal-guiding image processing system and SIFT matching algorithm in this paper can realize real-time processing under optical and RF m odes with high matching accuracy.