Extending Inverse Frequent Itemsets Mining to Generate Realistic Datasets: Complexity, Accuracy and Emerging Applications

Domenico Saccá, Edoardo Serra, Antonio Rullo

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

The development of novel platforms and techniques for emerging “Big Data” applications requires the availability of real-life datasets for data-driven experiments, which are however not accessible in most cases for various reasons, e.g., confidentiality, privacy or simply insufficient availability. An interesting solution to ensure high quality experimental findings is to synthesize datasets that reflect patterns of real ones using a two-step approach: first a real dataset X is analyzed to derive relevant patterns Z (latent variables) and, then, such patterns are used to reconstruct a new dataset X' that is like X but not exactly the same. The approach can be implemented using inverse mining techniques such as inverse frequent itemset mining (IFM), which consists of generating a transactional dataset satisfying given support constraints on the itemsets of an input set, that are typically the frequent ones. This paper introduces various extensions of IFM within a uniform framework with the aim to generate artificial datasets that reflect more elaborated patterns (in particular infrequency and duplicate constraints) of real ones. Furthermore, in order to further enlarge the application domain of IFM, an additional extension is introduced that considers more structured schemes for the datasets to be generated, as required in emerging big data applications, e.g., social network analytics.

Original languageAmerican English
Pages (from-to)1736-1774
Number of pages39
JournalData Mining and Knowledge Discovery
Volume33
Issue number6
DOIs
StatePublished - Nov 2019

Keywords

  • Big data
  • Classification
  • Data mining
  • Frequent itemset mining
  • Inverse problems
  • Linear programming
  • Synthetic dataset

EGS Disciplines

  • Computer Sciences

Fingerprint

Dive into the research topics of 'Extending Inverse Frequent Itemsets Mining to Generate Realistic Datasets: Complexity, Accuracy and Emerging Applications'. Together they form a unique fingerprint.

Cite this