Image discrimination robustness of classical image quality metrics: an analysis on MAE, MSE, ERGAS, LMSE, SSIM, SAM, UIQI, PSNR, NIQE, PIQE, SNR, VIF, FSIM, GMSD, and NCC


Civicioglu P., Beskdok E.

Quality and Quantity, 2025 (Scopus) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2025
  • Doi Numarası: 10.1007/s11135-025-02404-3
  • Dergi Adı: Quality and Quantity
  • Derginin Tarandığı İndeksler: Scopus, International Bibliography of Social Sciences, ABI/INFORM, Index Islamicus, Political Science Complete, Psycinfo, Social services abstracts, Sociological abstracts, Worldwide Political Science Abstracts
  • Anahtar Kelimeler: Colony-based search algorithm, Contrast sketching, Image quality metrics, Localized-IQM, MAE, MSE, ERGAS, LMSE, SSIM, SAM, UIQI, PSNR, NIQE, PIQE, SNR, VIF, FSIM, GMSD, NCC
  • Erciyes Üniversitesi Adresli: Evet

Özet

Classical Image Quality Metrics (IQMs) are widely used in fields like remote sensing and computer vision for quantitative image discrimination. They face significant robustness challenges that compromise reliability in critical applications. These issues are evident when perceptually distinct images, especially after enhancements such as Spline-based non-linear Contrast Sketching, yield identical IQM scores, hindering effective differentiation and raising concerns about the trustworthiness of automated systems. To address these limitations, this study first analyzes the image discrimination robustness of 15 conventional IQMs on a dataset of 12 Test Images, establishing baselines and failure points. Furthermore, this study presents and evaluates the Localized IQM Calculation Method (Localized-IQM), a potential enhancement to existing approaches. This method enhances IQM robustness by incorporating local image characteristics and statistical variations, moving beyond less discriminative global evaluations. Experimental findings demonstrate that Localized-IQM yields substantially more robust and reliable outcomes for challenging image discrimination problems compared to the direct global application of conventional IQMs. Its enhanced performance is consistent across diverse image types and common alteration levels. Consequently, the proposed method offers a significantly improved, dependable framework for image quality assessment, promising to advance image analysis accuracy and reliability in fields requiring precise image differentiation.