A novel impulsive noise elimination filter, entitled noise exclusive filter (NEF), which shows a high performance at the restoration of images distorted by impulsive noise, is proposed in this paper. NEF uses chi-square goodness-of-fit test in order to detect the corrupted pixels more accurately. Simulation results show that the proposed filter achieves a superior performance compared with the other filters mentioned in this paper in terms of noise suppression and detail preservation, particularly when the noise density is very high. The proposed method also achieves the robustness and detail preservation perfectly for a wide range of impulsive noise density. NEF provides efficient filtering performance with reduced computational complexity.