In this paper,we propose a new algorithm for bundle adjustment based on the fixed constraints between the two cameras in stereo vision.The new algorithm improves the normal equation of traditional bundle adjustment,and it only needs to optimize extrinsic parameters of one camera in each iteration.The two cameras can be better bounded as one and it can achieve a higher accuracy.The dimension of the matrix in the new algorithm is half of that in the traditional algorithm.Therefore it will reduce t...