On the Quality of Synthetic Generated Tabular Data

• Type: Article in International Scientific Journal
• Date: 2023

Authors

Espinosa, E (Author) Other; Figueira, A (Author) FCUP

Journal

Title: Mathematics

Vol. 11

Final page: 3278

Publisher: MDPI

Indexing

ISI Web of Knowledge - 8 Citations

Scopus - 12 Citations

Other information

Authenticus ID: P-00Y-S1F

DOI: 10.3390/math11153278

Abstract (EN): Class imbalance is a common issue while developing classification models. In order to tackle this problem, synthetic data have recently been developed to enhance the minority class. These artificially generated samples aim to bolster the representation of the minority class. However, evaluating the suitability of such generated data is crucial to ensure their alignment with the original data distribution. Utility measures come into play here to quantify how similar the distribution of the generated data is to the original one. For tabular data, there are various evaluation methods that assess different characteristics of the generated data. In this study, we collected utility measures and categorized them based on the type of analysis they performed. We then applied these measures to synthetic data generated from two well-known datasets, Adults Income, and Liar+. We also used five well-known generative models, Borderline SMOTE, DataSynthesizer, CTGAN, CopulaGAN, and REaLTabFormer, to generate the synthetic data and evaluated its quality using the utility measures. The measurements have proven to be informative, indicating that if one synthetic dataset is superior to another in terms of utility measures, it will be more effective as an augmentation for the minority class when performing classification tasks.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 18