Merge branch 'release/5.25.0'

Author: JeltevanBoheemen

.github/ISSUE_TEMPLATE/bug_report.yaml

@@ -47,7 +47,7 @@ body:
     attributes:
       label: Version
       description: |
-        Please add information about the version of I-analyzer where you encountered the bug.
+        Please add information about the version of Textcavator where you encountered the bug.
         You can find the version number (e.g. "1.2.3") in the footer of the site.
     validations:
       required: false

.vscode/launch.json

@@ -31,6 +31,15 @@
             "django": true,
             "justMyCode": true
         },
+        {
+            "name": "django: loadcorpora",
+            "type": "python",
+            "request": "launch",
+            "program": "${workspaceFolder}/backend/manage.py",
+            "args": ["loadcorpora"],
+            "django": true,
+            "justMyCode": false
+        },
         {
             "type": "chrome",
             "request": "launch",

CITATION.cff

@@ -2,7 +2,7 @@
 # Visit https://bit.ly/cffinit to generate yours today!
 
 cff-version: 1.2.0
-title: I-Analyzer
+title: Textcavator
 message: >-
   If you use this software, please cite it using the
   metadata from this file.
@@ -15,16 +15,16 @@ authors:
 identifiers:
   - type: doi
     value: 10.5281/zenodo.8064133
-repository-code: 'https://github.com/CentreForDigitalHumanities/I-analyzer'
-url: 'https://ianalyzer.hum.uu.nl'
+repository-code: 'https://github.com/CentreForDigitalHumanities/Textcavator'
+url: 'https://textcavator.hum.uu.nl'
 abstract: >-
-  I-analyzer is a tool for exploring corpora (large
-  collections of texts). You can use I-analyzer to find
+  Textcavator is a tool for exploring corpora (large
+  collections of texts). You can use Textcavator to find
   relevant documents, or to make visualisations to
   understand broader trends in the corpus. The interface is
   designed to be accessible for users of all skill levels.
 
-  I-analyzer is primarily intended for academic research and
+  Textcavator is primarily intended for academic research and
   higher education. We focus on data that is relevant for
   the humanities, but we are open to datasets that are
   relevant for other fields.
@@ -35,5 +35,5 @@ keywords:
   - elasticsearch
   - natural language processing
 license: MIT
-version: 5.22.1
-date-released: '2025-09-03'
+version: 5.25.0
+date-released: '2025-12-08'

README.md

@@ -1,37 +1,41 @@
-# I-analyzer
+# Textcavator
+
+> [!NOTE]
+> We are currently in the process of renaming this application from I-analyzer to Textcavator.
 
 [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.8064133.svg)](https://doi.org/10.5281/zenodo.8064133)
-[![Actions Status](https://github.com/CentreForDigitalHumanities/I-analyzer/workflows/Unit%20tests/badge.svg)](https://github.com/CentreForDigitalHumanities/I-analyzer/actions)
+[![Backend unit tests](https://github.com/CentreForDigitalHumanities/Textcavator/actions/workflows/backend-test.yml/badge.svg)](https://github.com/CentreForDigitalHumanities/Textcavator/actions/workflows/backend-test.yml)
+[![Frontend unit tests](https://github.com/CentreForDigitalHumanities/Textcavator/actions/workflows/frontend-test.yml/badge.svg)](https://github.com/CentreForDigitalHumanities/Textcavator/actions/workflows/frontend-test.yml)
 
 > "The great text mining tool that obviates all others."
 > — Julian Gonggrijp
 
-I-analyzer is a web application for exploring corpora (large collections of texts). You can use I-analyzer to find relevant documents, or to make visualisations to understand broader trends in the corpus. The interface is designed to be accessible for users of all skill levels.
+Textcavator is a web application for exploring corpora (large collections of texts). You can use Textcavator to find relevant documents, or to make visualisations to understand broader trends in the corpus. The interface is designed to be accessible for users of all skill levels.
 
-I-analyzer is primarily intended for academic research and higher education. We focus on data that is relevant for the humanities, but we are open to datasets that are relevant for other fields.
+Textcavator is primarily intended for academic research and higher education. We focus on data that is relevant for the humanities, but we are open to datasets that are relevant for other fields.
 
 ## Contents
 
-This repository contains the source code for the I-analyzer web application, which consists of a Django backend and Angular frontend.
+This repository contains the source code for the Textcavator web application, which consists of a Django backend and Angular frontend.
 
-For corpora included in I-analyzer, the backend includes a definition file that specifies how to read the source files, and how this data should be structured and presented in I-analyzer. This repository does _not_ include the source data itself, beyond a few sample files for testing.
+For corpora included in Textcavator, the backend includes a definition file that specifies how to read the source files, and how this data should be structured and presented in Textcavator. This repository does _not_ include the source data itself, beyond a few sample files for testing.
 
 ## Usage
 
-If you are interested in using I-analyzer, the most straightforward way to get started is to visit [ianalyzer.hum.uu.nl](https://ianalyzer.hum.uu.nl/). This server is maintained by the Research Software Lab and contains corpora focused on a variety of fields. We also maintain more specialised collections at [PEACE portal](https://peace.sites.uu.nl/epigraphy/search/) and [People & Parliament](https://people-and-parliament.hum.uu.nl/).
+If you are interested in using Textcavator, the most straightforward way to get started is to visit [ianalyzer.hum.uu.nl](https://ianalyzer.hum.uu.nl/). This server is maintained by the Research Software Lab and contains corpora focused on a variety of fields. We also maintain more specialised collections at [PEACE portal](https://peace.sites.uu.nl/epigraphy/search/) and [People & Parliament](https://people-and-parliament.hum.uu.nl/).
 
-I-analyzer does not have an "upload data" option (yet!). If you are interested in using I-analyzer as a way to publish your dataset, or to make it easier to search and analyse, you can go about this two ways:
+Textcavator does not have an "upload data" option (yet!). If you are interested in using Textcavator as a way to publish your dataset, or to make it easier to search and analyse, you can go about this two ways:
 
 - Contact us (see below for details) about hosting your dataset on one of our existing servers, or hosting a new server for your project.
-- Self-host I-analyzer. This would allow you to maintain full control over the data and who can access it. I-analyzer is open source software, so you are free to host it yourself, either as-is or with your own modifications. However, feel free to contact us with any questions or issues.
+- Self-host Textcavator. This would allow you to maintain full control over the data and who can access it. Textcavator is open source software, so you are free to host it yourself, either as-is or with your own modifications. However, feel free to contact us with any questions or issues.
 
 ## Development
 
-The [documentation directory](./documentation/) contains documentation for developers. This includes [installation instructions](./documentation/First-time-setup.md) to set up an I-analyzer server.
+The [documentation directory](./documentation/) contains documentation for developers. This includes [installation instructions](./documentation/First-time-setup.md) to set up an Textcavator server.
 
 ## Licence
 
-The source code of I-analyzer is shared under an MIT licence. See [LICENSE](./LICENSE) for the full licence statement.
+The source code of Textcavator is shared under an MIT licence. See [LICENSE](./LICENSE) for the full licence statement.
 
 ### Images
 
@@ -45,11 +49,11 @@ Some images currently lack a licence file. We are working on providing clear cop
 
 If you wish to cite this repository, please use the metadata provided in our [CITATION.cff file](./CITATION.cff).
 
-If you wish to cite material that you accessed through I-analyzer, or you are not sure if you should also be citing this repository, please refer to the [citation instructions in the user manual](./frontend/src/assets/manual/en-GB/citation.md).
+If you wish to cite material that you accessed through Textcavator, or you are not sure if you should also be citing this repository, please refer to the [citation instructions in the user manual](./frontend/src/assets/manual/en-GB/citation.md).
 
 ## Contact
 
-For questions, small feature suggestions, and bug reports, feel free to [create an issue](https://github.com/CentreForDigitalHumanities/I-analyzer/issues/new/choose). If you don't have a Github account, you can also [contact the Centre for Digital Humanities](https://cdh.uu.nl/contact/).
+For questions, small feature suggestions, and bug reports, feel free to [create an issue](https://github.com/CentreForDigitalHumanities/Textcavator/issues/new/choose). If you don't have a Github account, you can also [contact the Centre for Digital Humanities](https://cdh.uu.nl/contact/).
 
-If you want to add a new corpus to I-analyzer, or have an idea for a project, please [contact the Centre for Digital Humanities](https://cdh.uu.nl/contact/) rather than making an issue, so we can discuss the possibilities with you.
+If you want to add a new corpus to Textcavator, or have an idea for a project, please [contact the Centre for Digital Humanities](https://cdh.uu.nl/contact/) rather than making an issue, so we can discuss the possibilities with you.
 

backend/Dockerfile.base

@@ -1,5 +1,5 @@
 # Base image
-FROM docker.io/library/python:3.9 AS base
+FROM docker.io/library/python:3.12 AS base
 # Setting this means stdout and stderr streams are sent to terminal in real time
 ENV PYTHONUNBUFFERED 1
 # Get required libraries for xmlsec

backend/README.md

@@ -1,4 +1,4 @@
-# I-analyzer backend
+# Textcavator backend
 
 The text mining tool that obviates all others
 

backend/addcorpus/admin.py

@@ -1,6 +1,7 @@
 from django.contrib import admin, messages
 from .models import Corpus, CorpusConfiguration, CorpusDataFile, Field, CorpusDocumentationPage
 
+
 def show_warning_message(request):
     '''
     Message to display when loading a form for a resource based on a python class
@@ -16,10 +17,11 @@ def show_warning_message(request):
 
 class InlineDatafileAdmin(admin.StackedInline):
     model = CorpusDataFile
-    fields = ['file', 'is_sample']
+    fields = ['file', 'is_sample', 'confirmed']
     show_change_link = True,
     extra = 0
 
+
 class CorpusAdmin(admin.ModelAdmin):
     readonly_fields = [
         'configuration', 'ready_to_index', 'ready_to_publish', 'date_created',
@@ -32,6 +34,7 @@ class CorpusAdmin(admin.ModelAdmin):
     list_filter = ['groups', 'active']
     inlines = [InlineDatafileAdmin]
 
+
 class InlineFieldAdmin(admin.StackedInline):
     model = Field
     fields = ['display_name', 'description']
@@ -174,6 +177,7 @@ def get_form(self, request, obj=None, **kwargs):
             show_warning_message(request)
         return super().get_form(request, obj, **kwargs)
 
+
 admin.site.register(Corpus, CorpusAdmin)
 admin.site.register(CorpusConfiguration, CorpusConfigurationAdmin)
 admin.site.register(Field, FieldAdmin)

backend/addcorpus/apps.py

@@ -4,3 +4,6 @@
 class AddcorpusConfig(AppConfig):
     default_auto_field = 'django.db.models.BigAutoField'
     name = 'addcorpus'
+
+    def ready(self):
+        import addcorpus.signals

backend/addcorpus/constants.py

@@ -4,19 +4,22 @@
     ('parliament', 'Parliamentary debates'),
     ('periodical', 'Newspapers and other periodicals'),
     ('finance', 'Financial reports'),
-    ('ruling', 'Court rulings'),
-    ('review', 'Online reviews'),
+    ('ruling', 'Laws and rulings'),
+    ('review', 'Reviews and discussions'),
     ('inscription', 'Funerary inscriptions'),
     ('oration', 'Orations'),
     ('book', 'Books'),
-    ('informative', 'Informative'),
+    ('letter', 'Letters and life writing'),
+    ('poetry', 'Poetry and songs'),
+    ('social', 'Social media'),
+    ('other', 'Other'),
 ]
 '''
 Types of data
 '''
 
 class MappingType(Enum):
-    'Elasticsearch mapping types that are implemented in I-analyzer'
+    'Elasticsearch mapping types that are implemented in Textcavator'
 
     TEXT = 'text'
     KEYWORD = 'keyword'

backend/addcorpus/documentation.py

@@ -8,6 +8,7 @@ def render_documentation_context(raw_template):
     today = date.today()
     context = Context({
         'frontend_url': settings.BASE_URL,
+        'site_name': settings.SITE_NAME,
         'date': {
             'year': today.year,
             'month': today.strftime('%B'),