updated docs

Author: zStupan

docs/api/index.rst

@@ -9,4 +9,5 @@ API Reference
     niaarm
     rule
     rule_list
+    text
     visualize

docs/api/text.rst

@@ -0,0 +1,6 @@
+Text
+====
+
+.. automodule:: niaarm.text
+    :members:
+    :show-inheritance:

docs/getting_started.rst

@@ -217,6 +217,68 @@ presented in `this paper <https://link.springer.com/chapter/10.1007/978-3-030-62
 
 .. image:: _static/hill_slopes.png
 
+Text Mining (Experimental)
+~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+An experimental implementation of association rule text mining using nature-inspired algorithms
+is also provided. The :mod:`niaarm.text` module contains the :class:`~niaarm.text.Corpus` and :class:`~niaarm.text.Document` classes for loading and preprocessing corpora,
+a :class:`~niaarm.text.TextRule` class, representing a text rule, and the :class:`~niaarm.text.NiaARTM` class, implementing association rule text mining
+as a continuous optimization problem. The :func:`~niaarm.mine.get_text_rules` function, equivalent to :func:`~niaarm.mine.get_rules`, but for text mining, was also
+added to the :mod:`niaarm.mine` module.
+
+.. code:: python
+
+    import pandas as pd
+    from niaarm.text import Corpus
+    from niaarm.mine import get_text_rules
+    from niapy.algorithms.basic import ParticleSwarmOptimization
+
+    df = pd.read_json('datasets/text/artm_test_dataset.json', orient='records')
+    documents = df['text'].tolist()
+    corpus = Corpus.from_list(documents)
+
+    algorithm = ParticleSwarmOptimization(population_size=200, seed=123)
+    metrics = ('support', 'confidence', 'aws')
+    rules, time = get_text_rules(corpus, max_terms=5, algorithm=algorithm, metrics=metrics, max_evals=10000, logging=True)
+
+    if len(rules):
+        print(rules)
+        print(f'Run time: {time:.2f}s')
+        rules.to_csv('output.csv')
+    else:
+        print('No rules generated')
+        print(f'Run time: {time:.2f}s')
+
+**Output:**
+
+.. code:: text
+
+    Fitness: 0.53345778328699, Support: 0.1111111111111111, Confidence: 1.0, Aws: 0.48926223874985886
+    Fitness: 0.7155830770302328, Support: 0.1111111111111111, Confidence: 1.0, Aws: 1.0356381199795872
+    Fitness: 0.7279963436805833, Support: 0.1111111111111111, Confidence: 1.0, Aws: 1.072877919930639
+    Fitness: 0.7875917299029188, Support: 0.1111111111111111, Confidence: 1.0, Aws: 1.251664078597645
+    Fitness: 0.8071206688346807, Support: 0.1111111111111111, Confidence: 1.0, Aws: 1.310250895392931
+    STATS:
+    Total rules: 52
+    Average fitness: 0.5179965084882088
+    Average support: 0.11538461538461527
+    Average confidence: 0.7115384615384616
+    Average lift: 5.524038461538462
+    Average coverage: 0.17948717948717943
+    Average consequent support: 0.1517094017094015
+    Average conviction: 1568561408678185.8
+    Average amplitude: nan
+    Average inclusion: 0.007735042735042727
+    Average interestingness: 0.6170069642291859
+    Average comprehensibility: 0.6763685578758655
+    Average netconf: 0.6675824175824177
+    Average Yule's Q: 0.9670329670329672
+    Average antecedent length: 1.6346153846153846
+    Average consequent length: 1.8461538461538463
+
+    Run time: 13.37s
+    Rules exported to output.csv
+
 Interest Measures
 -----------------
 

docs/index.rst

@@ -24,7 +24,8 @@ The current version includes (but is not limited to) the following functions:
 - searching for association rules,
 - providing output of mined association rules,
 - generating statistics about mined association rules,
-- visualization of association rules.
+- visualization of association rules,
+- association rule text mining (experimental).
 
 Documentation
 =============

docs/refs.bib

@@ -1,27 +1,66 @@
-@inproceedings{fister2018differential,
-  title={Differential evolution for association rule mining using categorical and numerical attributes},
-  author={Fister Jr., Iztok and Iglesias, Andres and Galvez, Akemi and Ser, Javier Del and Osaba, Eneko and Fister, Iztok},
-  booktitle={International conference on intelligent data engineering and automated learning},
-  pages={79--88},
-  year={2018},
-  organization={Springer}
+@inproceedings{fister_differential_2018,
+    address = {Cham},
+    title = {Differential {Evolution} for {Association} {Rule} {Mining} {Using} {Categorical} and {Numerical} {Attributes}},
+    isbn = {9783030034931},
+    doi = {10.1007/978-3-030-03493-1_9},
+    language = {en},
+    booktitle = {Intelligent {Data} {Engineering} and {Automated} {Learning} – {IDEAL} 2018},
+    publisher = {Springer International Publishing},
+    author = {Fister, Iztok and Iglesias, Andres and Galvez, Akemi and Del Ser, Javier and Osaba, Eneko and Fister, Iztok},
+    editor = {Yin, Hujun and Camacho, David and Novais, Paulo and Tallón-Ballesteros, Antonio J.},
+    year = {2018},
+    pages = {79--88},
 }
 
-@inproceedings{fister2020improved,
-  title={Improved nature-inspired algorithms for numeric association rule mining},
-  author={Fister Jr, Iztok and Podgorelec, Vili and Fister, Iztok},
-  booktitle={International Conference on Intelligent Computing \& Optimization},
-  pages={187--195},
-  year={2020},
-  organization={Springer}
+@inproceedings{fister_jr_improved_2021,
+    address = {Cham},
+    title = {Improved {Nature}-{Inspired} {Algorithms} for {Numeric} {Association} {Rule} {Mining}},
+    isbn = {9783030681548},
+    doi = {10.1007/978-3-030-68154-8_19},
+    language = {en},
+    booktitle = {Intelligent {Computing} and {Optimization}},
+    publisher = {Springer International Publishing},
+    author = {Fister Jr., Iztok and Podgorelec, Vili and Fister, Iztok},
+    editor = {Vasant, Pandian and Zelinka, Ivan and Weber, Gerhard-Wilhelm},
+    year = {2021},
+    pages = {187--195},
 }
 
+@article{fister_jr_brief_2020,
+    title = {A brief overview of swarm intelligence-based algorithms for numerical association rule mining},
+	doi = {10.48550/ARXIV.2010.15524},
+    abstract = {Numerical Association Rule Mining is a popular variant of Association Rule Mining, where numerical attributes are handled without discretization. This means that the algorithms for dealing with this problem can operate directly, not only with categorical, but also with numerical attributes. Until recently, a big portion of these algorithms were based on a stochastic nature-inspired population-based paradigm. As a result, evolutionary and swarm intelligence-based algorithms showed big efficiency for dealing with the problem. In line with this, the main mission of this chapter is to make a historical overview of swarm intelligence-based algorithms for Numerical Association Rule Mining, as well as to present the main features of these algorithms for the observed problem. A taxonomy of the algorithms was proposed on the basis of the applied features found in this overview. Challenges, waiting in the future, finish this paper.},
+    journal = {arXiv:2010.15524 [cs]},
+    author = {Fister Jr. , Iztok and Fister, Iztok},
+    month = oct,
+    year = {2020},
+}
+
+@inproceedings{fister_population-based_2020,
+	address = {New York, NY, USA},
+	series = {{ISMSI} '20},
+	title = {Population-based metaheuristics for {Association} {Rule} {Text} {Mining}},
+	isbn = {9781450377614},
+	doi = {10.1145/3396474.3396493},
+	booktitle = {Proceedings of the 2020 4th {International} {Conference} on {Intelligent} {Systems}, {Metaheuristics} \& {Swarm} {Intelligence}},
+	publisher = {Association for Computing Machinery},
+	author = {Fister, Iztok and Deb, Suash and Fister, Iztok},
+	month = mar,
+	year = {2020},
+	keywords = {association rule text mining, particle swarm optimization, triathlon, natural language processing, optimization},
+	pages = {19--23},
+}
 
-@article{fister2021brief,
-  title={A Brief Overview of Swarm Intelligence-Based Algorithms for Numerical Association Rule Mining},
-  author={Fister Jr, Iztok and Fister, Iztok},
-  journal={Applied Optimization and Swarm Intelligence},
-  pages={47--59},
-  year={2021},
-  publisher={Springer}
+@inproceedings{fister_visualization_2020,
+	address = {Cham},
+	title = {Visualization of {Numerical} {Association} {Rules} by {Hill} {Slopes}},
+	isbn = {9783030623623},
+	doi = {10.1007/978-3-030-62362-3_10},
+	language = {en},
+	booktitle = {Intelligent {Data} {Engineering} and {Automated} {Learning} – {IDEAL} 2020},
+	publisher = {Springer International Publishing},
+	author = {Fister, Iztok and Fister, Dušan and Iglesias, Andres and Galvez, Akemi and Osaba, Eneko and Del Ser, Javier and Fister, Iztok},
+	editor = {Analide, Cesar and Novais, Paulo and Camacho, David and Yin, Hujun},
+	year = {2020},
+	pages = {101--111},
 }