Τεχνικές μείωσης του πληθυσμού των δεδομένων με ανεκτικότητα στις απούσες τιμές

Τεχνικές μείωσης του πληθυσμού των δεδομένων με ανεκτικότητα στις απούσες τιμές (EL)

Κουκάρας, Πολυχρόνης (EL)

Ουγιάρογλου, Στέφανος (EL)

Διαμαντάρας, Κωνσταντίνος (EL)

Δέρβος, Δημήτριος (EL)

masterThesis

Μεταπτυχιακή εργασία (EL)

Master thesis (EN)

2023-01-25T12:25:09Z

2024-10-07T13:21:28Z

2020-07-15

Μεταπτυχιακή εργασία - Σχολή Μηχανικών - Τμήμα Μηχανικών Πληροφορικής και Ηλεκτρονικών Συστημάτων,2020(α/α 11965) (EL)

In recent years, large amounts of training data, from various sources, become available on a daily basis. These quantities are usually not possible to be used by classification algorithms due to the high cost of computing as well as the high memory storage requirements. Therefore, this data is often pre-processed by Data Reduction Techniques in order to reduce computing costs and memory requirements. Many data reduction techniques have been proposed and are available in the literature. These techniques mainly concern the ‗k Nearest Neighbor classifier‘. However, these techniques cannot manage the Missing Values that always appear in real training data sets. Thus, before pre-processing by a data reduction technique, it is necessary to apply another pre-processing step to complete the Missing Values Imputation. In the literature, we come across to several such methods and this paper presents the most important ones. However, by applying an extra pre-processing step is a major drawback that adds computational cost. This is the motivation for this thesis. This thesis proposes a new variant of a data reduction technique that can manage missing values without requiring the additional pre-processing step for data imputation. This technique is a Prototype Generation algorithm and is called the Editing and Reduction through Homogeneous Clusters (ERHC) algorithm. The new ERHC variant manages the missing values using the partial distance technique and applying k-means clustering that does not take into account the missing values. In addition, the performance of ERHC has been tested after the imputation of missing values by the average per class imputation method. The two aforementioned ERHC variants are compared to each other and to the algorithm of the nearest neighbors without reducing the population of data by performing experiments on 13 data sets and estimating the accuracy of classification and reduction ratio (Reduction Rate) achieved by the two ERHC algorithms. The experimental results show remarkable performance for both variants of the ERHC algorithm. (EN)

Missing Values Imputation (EN)

Categorization of Neighboring Neighbors (EN)

ERHC (EN)

Data Reduction Techniques (EN)

Calculation (EN)

Partial distance (EN)

K-means Clustering (EN)

Ελληνική γλώσσα

Σχολή Μηχανικών - Τμήμα Μηχανικών Πληροφορικής και Ηλεκτρονικών Συστημάτων

Σχολή Μηχανικών - Τμήμα Μηχανικών Πληροφορικής και Ηλεκτρονικών Συστημάτων (EL)

Default License

International Hellenic University

Institutional Repository of the International Hellenic University

Πτυχιακές Εργασίες

Σχολή Μηχανικών

Τμήμα Μηχανικών Πληροφορικής & Ηλεκτρονικών Συστημάτων