To make better to use the cloud computing technology, and to overcome the computing and storage requirements which increase rapidly with the number of training samples, in this project propose, a new parallel algorithm – Parallel Regularized Multiple-Criteria Linear Programming (PRMCLP) algorithm – The RMCLP model is converted into a unconstrained optimization problem, and then, in the parallel version, it is split into several task, where each part is mapped and computed on a separate processor. In this approach enables us to obtain efficiently the final optimization solution of the whole classification problem. At last, we apply this algorithm into Medical data classification. All experiments show that our method and approach greatly increases the training speed of RMCLP in the parallel case.