To achieve higher coding efficiency and less coding time for scalable vedio coding(SVC),this paper presents a fast inter-frame encoding algorithm suitable for the enhancement layer,in which the weights of the various models are calculated and ordered with the combination of the residual prediction and rate distortion as the early termination criteria.The Experiment results show that the proposed algorithm can significantly improve the encoding speed with negligible influence on encoding quality.