As the scale of information data increases enormously, traditional singleprocessor or multiprocessor structure based computing devices are unable to meet the requirements of realtime data processing. The heterogeneous parallel computing technology attracts  much attention and is widely applied for its effective computation efficiency and parallel realtime processing capability. We propose a parallel design of the JPEG compression algorithm based on OpenCL by using the advantages of the GPU in image processing. The JPEG algorithm is divided into multiple kernel programs, and the kernels are sequentially controlled by the event information transfer. The parallel algorithm is simulated and verified on the GPU+CPU platform. Experimental results show that under the same image quality condition, the parallel algorithm can improve algorithm implementation efficiency  and reduce time substantially. And as the graph size increases, the efficiency of the algorithm obtains obvious improvement.