Image discrimination robustness of classical image quality metrics: an analysis on MAE, MSE, ERGAS, LMSE, SSIM, SAM, UIQI, PSNR, NIQE, PIQE, SNR, VIF, FSIM, GMSD, and NCC


Civicioglu P., Beskdok E.

Quality and Quantity, vol.60, no.2, pp.3559-3621, 2026 (Scopus)

  • Publication Type: Article / Article
  • Volume: 60 Issue: 2
  • Publication Date: 2026
  • Doi Number: 10.1007/s11135-025-02404-3
  • Journal Name: Quality and Quantity
  • Journal Indexes: Scopus, International Bibliography of Social Sciences, ABI/INFORM, Index Islamicus, Political Science Complete, Psycinfo, Social services abstracts, Sociological abstracts, Worldwide Political Science Abstracts
  • Page Numbers: pp.3559-3621
  • Keywords: Colony-based search algorithm, Contrast sketching, Image quality metrics, Localized-IQM, MAE, MSE, ERGAS, LMSE, SSIM, SAM, UIQI, PSNR, NIQE, PIQE, SNR, VIF, FSIM, GMSD, NCC
  • Erciyes University Affiliated: Yes

Abstract

Classical Image Quality Metrics (IQMs) are widely used in fields like remote sensing and computer vision for quantitative image discrimination. They face significant robustness challenges that compromise reliability in critical applications. These issues are evident when perceptually distinct images, especially after enhancements such as Spline-based non-linear Contrast Sketching, yield identical IQM scores, hindering effective differentiation and raising concerns about the trustworthiness of automated systems. To address these limitations, this study first analyzes the image discrimination robustness of 15 conventional IQMs on a dataset of 12 Test Images, establishing baselines and failure points. Furthermore, this study presents and evaluates the Localized IQM Calculation Method (Localized-IQM), a potential enhancement to existing approaches. This method enhances IQM robustness by incorporating local image characteristics and statistical variations, moving beyond less discriminative global evaluations. Experimental findings demonstrate that Localized-IQM yields substantially more robust and reliable outcomes for challenging image discrimination problems compared to the direct global application of conventional IQMs. Its enhanced performance is consistent across diverse image types and common alteration levels. Consequently, the proposed method offers a significantly improved, dependable framework for image quality assessment, promising to advance image analysis accuracy and reliability in fields requiring precise image differentiation.