Saltar a casilla de búsquedaSaltar a navegaciónIr directamente al contenido principal

Influence of statistical feature normalisation methods on K-Nearest Neighbours and K-Means in the context of industry 4.0

  • Iratxe Niño-Adan(autor correspondiente)
    ,
  • Itziar Landa-Torres
    ,
  • Eva Portillo
    ,
*Autor correspondiente de este trabajo
Publicación:
Contribución a una revista
Artículo
Investigación
Revisión por expertos

Abstract

Normalisation is a preprocessing technique widely employed in Machine Learning (ML)-based solutions for industry to equalise the features’ contribution. However, few researchers have analysed the normalisation effect and its implications on the ML algorithm performance, especially on Euclidean distance-based algorithms, such as the well-known K-Nearest Neighbours and K-means. In this sense, this paper formally analyses the effect of normalisation yielding results significantly far from the state-of-the-art traditional claims. In particular, this paper shows that normalisation does not equalise the contribution of the features, with the consequent impact on the performance of the learning process for a particular problem. More concretely, this demonstration is made on K-Nearest Neighbours and K-means Euclidean distance-based ML algorithms. This paper concludes that normalisation can be viewed as an unsupervised Feature Weighting method. In this context, a new metric (Normalisation weight) for measuring the impact of normalisation on the features is presented. Likewise, an analysis of the normalisation effect on the Euclidean distance is conducted and a new metric referred to as Proportional influence that measures the features influence on the Euclidean distance is proposed. Both metrics enable the automatic selection of the most appropriate normalisation method for a particular engineering problem, which can significantly improve both the computational cost and classification performance of K-Nearest Neighbours and K-means algorithms. The analytical conclusions are validated on well-known datasets from the UCI repository and a real-life application from the refinery industry.

Research Output Information

Tipo de resultado

Publicación:
Contribución a una revista
Artículo
Investigación
Revisión por expertos

Idioma original

Inglés

Número de artículo

104807

Revista (Volumen, Número de Edición)

Engineering Applications of Artificial Intelligence (Volumen 111)

Hitos de publicación

  • Publicada - 05/2022

Estado de publicación

Publicada - 05/2022

ISSN

0952-1976

ID de publicación

  • Scopus: 85127123319

Funding Details

This work has been supported by a DATAinc fellowship ( 48-AF-W1-2019-00002 ) and a TECNALIA Research and Innovation PhD Scholarship . Besides, this work is part of the OILTWIN project (KK-2020/00052), funded by the ELKARTEK program of the SPRI-Basque Government .

Sustainable Development Goals

  • ODS 9: Industria, innovación e infraestructura
    ODS 9: Industria, innovación e infraestructura

Publication metrics

Métricas

SciVal
FWCI
1.50
SciVal
Número de autores
4
SciVal
Percentil de artículo
81
SciVal
citaciones
31

PlumX, se abre en una pestaña nueva

Capturas
57
Número de citas
31