3D reconstruction based on high-level features, such as line and plane, is a significant development trend in Digital Photogrammetry and Computer Vision. To auto-recognize corresponding line and point is a core problem in above research areas. Therefore this article presents a novel line segment stereo recognition algorithm based on straight line auto-grouping, epipolar line constraint guiding, vanishing point direction guiding, and image pyramid model. The strategy for auto-recognizing corresponding line bases on "independent observation" + "local integral constraint" + "large area search" + ...