The displacement detection principle of eddy current sensor is introduced. The temperature drifting phenomena occurred in measuring displacement are analyzed, which are caused by thermal expansion and contraction of sensor winding and detector. Referring to the temperature drifting of sensor, a calibrating device with compensating function of eddy current sensor is manufactured, and the temperature for output voltage of sensor is compensated, which reduces the influence of temperature changes on output voltage of sensor. The implementation method of temperature calibration by this device is proposed and validated in experiment, which realizes the calibration for output voltage of eddy current sensor under the circumstance temperature variation and fixed displacement. Comparing to the detection without temperature compensation, the variation of voltage decreases by about 50%.