In order to improve the quality of hole filling in the virtual view rendering,t his paper proposes an algorithm of virtual view hole filling based on convolutional neural network.Th e proposed algorithm includes image preprocessing,feature extraction and hole filling.Firstly,implement the image preprocessing of double virtual view, that is,using the depth image based rendering (DIBR) technique to get the image before hole filling and the hole mask.Then,use the convolutional neural network to extract the feature,as for the hole,use the structure similarity loss function to optimize the network;finally,fill the hole in the virtual vie w with the extracted features. Experimental results indicate that the proposed algorithm effectively fills the hole of the double virtual view and achieves better performance in terms of the quality of subjective visual view ef fect.