In visual tracking system,template upd ating has been a very hot and challenging topic in the visual tracking algo rithm s based on pattern matching,and has a great value in practical application and research.In order to cope with the problem of template updating due to variations of object appearance and background under complex environment,a novel template updating strategy of visual tracking is proposed in this paper to enhance the precision o f the target template. The proposed method can update the classified sub-model by the distinguishes an d changes of feature information in both time and space,and it also avoids the over-updatin g of template.It makes fewer errors during the updating,and improves the fault tolerance ability of the target template.The adaptive template can be used in the case of appearance and backgro und changes,and can improve the tracking accuracy and robustness in a certain extent.Experimental r esults show that the proposed method exhibits better performance in the visual tracking system,a nd is robust to pose,illumination,deformation and occlusion.