Human activity recognition (HAR) has received intensely attention in many applications, such as healthcare, human-computer interaction, and smart home. Existing HAR methods based on deep learning (DL) have been proposed in the last several years. However, these DL-based HAR methods are hard to balance between performance and cost, which truly limited the applications in practical scenarios. To solve this problem, this paper proposes a smartphone-aided HAR method using the residual multi-layer perceptron (Res-MLP). It composes of two linear layers and Gaussian error linear unit (GELU) activation function, and obtains Res-MLP network through residual. Experimental results show that the proposed HAR method can achieve a high classification accuracy of 96.72% based on the public UCI HAR dataset.