The communication and parallel-executing of the high-performance multi-core DSP is the key to the multi-core system design. The resource consumption is analyzed for each module of the video object tracking algorithm, and the idea of parallel computing is proposed for each part of the algorithm. The improved Binary-Mask algorithm is proposed to extract the background image; and the proposed auxiliary parallel architecture can realize the load-balance. The Inter Processor Communication(IPC) synchronization mechanisms are researched for DSP multi-core communication. The three-core parallel processing system is realized with pipelined parallel architecture. The communication delay time is tested by experiment, and target tracking program is divided into three DSP cores for parallel processing , which can achieve real-time requirement.