In based on depth image virtual viewpo int rendering,depth video produced by depth estimation software exists lots of distortions which cause distortion and texture loss in virtual viewpoint.To enhance the quality of depth video produced by depth estimation so ftware,a depth image rectification algorithm based on image segmentation is proposed to tackle depth video distortion in this paper.The consistency of color and depth map is utilized to correct the depth distortion in different regions,which consequently improves the virtual view quality.Firstl y,the edge and the motion regions of texture video are detected,from which motion and edge mas ks can be derived. Secondly,aided by edge motion information of color image,the color image is clas sified by mean shift method and different labels are assigned to different classes.Finally,the corresponding convergence regions in depth map are statistically analyzed,and de pth histogram is obtained.The depth relative to the peak in depth histogram is used to correct t he inconsistent region.Experimental results show that this depth video rectification algorithm is better than based pixel on filtering,rectifies the block distortion of depth video,solves the problem of texture loss and edge distortion,and improves virtua l view quality by 0.20dB.