The popular convolutional neural networks (CNN) require data augmentation to achieve rotation invariance. We propose an alternative mechanism, Pre-Rotation Only at Inference stage (PROAI), to make CNN rotation invariant. The overall idea is to learn how the human brain observe images. At the training stage, PROAI trains a CNN with a small number using images only at one orientation. At the inference stage, PROAI introduces a pre-rotation operation to rotate each test image into its all-possible orientations and calculate classification scores using the trained CNN with a small number of parame...