Abstract:H.264/AVC achieves higher compression efficiency than previous video coding standards.Howerer,this performance gain co mes at the cost of an increased computational complexity due to the use of varia ble block-size motion estimation and multiple reference frames.Thus,it is very important for H.264/AVC to improve the coding speed,therefore this paper propose s a fast inter-frame coding algorithm applied in the H.264/AVC video coding st andard.Firstly,the candidate modes of current MB are predicted based on moving a nd texture,excluding the coding modes with low probability to be selected by cur rent MB;Secondly,the mode possibilty orders are estimated based on inter-layer and spatial correlations.then the modes are sorted into sequential list accordin g to the possibility orders from high to low;Thirdly,the relationship between mo de distribution and variation of quantization parameter,temporal and spatial cor relation are estimated,then the rate-distortion early termination is proposed c ombining with the relationship;Finally,the modes are checked sequentially with t he rate-distortion early termination.When the rate-distortion early terminatio n condition is satisfied,the encoding procedure is terminated to improve the cod ing speed.The experimental results show that the encoding speed for the proposed algorithm can be improved by 72% with negligible coding loss.