Geometric-semantic coherent building models are demanding in many geoscience applications. Conventional building modeling methods often rely on successive roof plane segmentation and fitting. The subsequent reconstruction procedure is difficult to assure topologic consistency and geometric accuracy. This article starts with a library of predefined building models or primitives, including pyramid, gable, hip, etc. We propose an optimal model fitting approach that holistically determines all of its parameters from segmented point cloud data. The approach is formulated as an optimization problem ...