Add documentation for 1.12.0-M1 (#5294)

* Add documentation for 1.12.0-M1

---------

Co-authored-by: Simon Dumas <simon.dumas@senscience.ai>

Author: imsdu

delta/plugins/elasticsearch/src/main/scala/ch/epfl/bluebrain/nexus/delta/plugins/elasticsearch/ElasticSearchPluginModule.scala

@@ -114,8 +114,6 @@ class ElasticSearchPluginModule(priority: Int) extends ModuleDef {
       )(uuidF)
   }
 
-  make[MigrateDefaultIndexing].from { (xas: Transactors) => MigrateDefaultIndexing(xas) }
-
   make[ElasticSearchCoordinator].fromEffect {
     (
         views: ElasticSearchViews,
@@ -124,18 +122,16 @@ class ElasticSearchPluginModule(priority: Int) extends ModuleDef {
         supervisor: Supervisor,
         client: ElasticSearchClient,
         config: ElasticSearchViewsConfig,
-        cr: RemoteContextResolution @Id("aggregate"),
-        migration: MigrateDefaultIndexing
+        cr: RemoteContextResolution @Id("aggregate")
     ) =>
-      migration.run >>
-        ElasticSearchCoordinator(
-          views,
-          graphStream,
-          registry,
-          supervisor,
-          client,
-          config
-        )(cr)
+      ElasticSearchCoordinator(
+        views,
+        graphStream,
+        registry,
+        supervisor,
+        client,
+        config
+      )(cr)
   }
 
   make[MainIndexingCoordinator].fromEffect {

delta/plugins/elasticsearch/src/main/scala/ch/epfl/bluebrain/nexus/delta/plugins/elasticsearch/MigrateDefaultIndexing.scala

@@ -1,5 +1,7 @@
 @@@ index
 
+- @ref:[v1.12 Release Notes](v1.12-release-notes.md)
+- @ref:[v1.11 To v1.12 Migration](v1.11-to-v1.12-migration.md)
 - @ref:[v1.11 Release Notes](v1.11-release-notes.md)
 - @ref:[v1.10 To v1.11 Migration](v1.10-to-v1.11-migration.md)
 - @ref:[v1.10 Release Notes](v1.10-release-notes.md)
@@ -18,7 +20,41 @@ This section of the documentation lists the significant BlueBrain Nexus releases
 applications.
 
 TODO: update release date
-The latest stable release is **v1.10.0** released on **17.09.2024**.
+
+The latest stable release is **v1.11.0** released on **09.12.2024**.
+
+## 1.12.0
+
+### Breaking changes
+
+@@@ note { .warning }
+
+The items listed below are changes that have been made in this release that may break compatibility with previous releases.
+
+**Nexus Delta now fully supports JSON-LD 1.1**
+
+- This implied updating some underlying libraries which could result in discrepancies in processing compared to previous versions of Nexus.
+- With the support of JSON-LD 1.1, the ability to a have a lenient processor for incoming JSON-LD payloads has been removed.
+
+Please test this new version carefully and address any issues on the client side before pushing in a production environment.
+
+**Resource metadata**
+
+- The `_project` field in resource metadata is now populated with as its reference (`org/project`) instead of its address
+- The `_incoming` and `_outgoing` links are not part of the metadata anymore (the endpoints remain available for resources and files)
+
+**Indexing**
+
+- Projects, resolvers, schemas, storages and views are not indexed anymore in Blazegraph and Elasticsearch.
+@@@
+
+### New features / enhancements
+
+- Full support of JSON-LD 1.1 via [Apache Jena 5.x](https://jena.apache.org/) and [Titanium JSON-LD](https://github.com/filip26/titanium-json-ld)
+- The default indexing in Elasticsearch has been rewritten to push data in a single Elasticsearch index in order to reduce shard consumption.
+- Projects, resolvers, schemas, storages and views are not indexed anymore to prepare further changes on how they are handled
+
+A detailed list of changes included in the release can be found in the @ref:[release notes](v1.12-release-notes.md).
 
 ## 1.11.0
 
@@ -38,6 +74,8 @@ The items listed below are changes that have been made in this release that brea
 - @ref:[Conditional requests](../delta/api/conditional-requests.md)
 - @ref:[Passivation](../delta/api/views/index.md#passivation)
 
+A detailed list of changes included in the release can be found in the @ref:[release notes](v1.11-release-notes.md).
+
 ## 1.10.0
 
 ### Breaking changes

…res/init/V2_00_M01__ship_drop_tables.ddl …res/init/V1_12_M01__ship_drop_tables.ddldelta/sourcing-psql/src/main/resources/scripts/postgres/init/V2_00_M01__ship_drop_tables.ddl renamed to delta/sourcing-psql/src/main/resources/scripts/postgres/init/V1_12_M01__ship_drop_tables.ddl delta/sourcing-psql/src/main/resources/scripts/postgres/init/V2_00_M01__ship_drop_tables.ddl renamed to delta/sourcing-psql/src/main/resources/scripts/postgres/init/V1_12_M01__ship_drop_tables.ddl

@@ -0,0 +1,43 @@
+# v1.11 To v1.12 Migration
+
+# Schema changes
+Run the differents scripts starting with V1_12 in order:
+
+https://github.com/BlueBrain/nexus/tree/$git.branch$/delta/sourcing-psql/src/main/resources/scripts/postgres/init
+
+# Indexing in Elasticsearch and Blazegraph
+
+Those different changes in 1.12 require a full reindexing in Elasticsearch and Blazegraph:
+
+* default indexing in Elasticsearch now pushes to a single index
+* projects, resolvers, schemas, storages and views are not indexed anymore
+* some metadata fields are not indexed anymore
+
+The choice of migration will depend on your current setup, needs, and uptime requirements that you want to uphold for
+your users.
+
+If you can accept partial results in Elasticsearch/Blazegraph during the reindexing process, this migration can be achieved as follows:
+
+* Make a backup of your PostgreSQL instance
+* Deploy new instances of Elasticsearch and Blazegraph
+* Scale down Nexus Delta, update the image version and change its configuration to point to those new instances
+* Configure Delta via the `plugins.elasticsearch.main-index.shards` depending on your amount of data 
+and [following the Elastic recommendations about sharding](https://www.elastic.co/guide/en/elasticsearch/reference/current/size-your-shards.html)
+* You can optionally allocate more resources to Delta, PostgreSQL, Blazegraph and Elasticsearch to accommodate for the load related to the indexing
+* You may also want to reindex in Elasticsearch first and then in Blazegraph if the load is too high
+* Run the following SQL script to delete the former default elasticsearch views and their progress:
+```sql
+DELETE FROM scoped_events WHERE type = 'elasticsearch' AND id = 'https://bluebrain.github.io/nexus/vocabulary/defaultElasticSearchIndex';
+DELETE FROM scoped_states WHERE type = 'elasticsearch' AND id = 'https://bluebrain.github.io/nexus/vocabulary/defaultElasticSearchIndex';
+DELETE FROM projection_offsets WHERE module = 'elasticsearch' AND resource_id = 'https://bluebrain.github.io/nexus/vocabulary/defaultElasticSearchIndex';
+DELETE FROM projection_offsets WHERE name = 'event-metrics';
+```
+* Run the following SQL script to delete the progress of Blazegraph indexing:
+```sql
+DELETE FROM projection_offsets WHERE module = 'blazegraph';
+```
+* Start Nexus Delta 
+* Monitor the load of the different components and the indexing process by running the following query
+```sql
+SELECT * FROM projection_offsets ORDER BY updated_at DESC;
+```

docs/src/main/paradox/docs/releases/index.md

@@ -0,0 +1,22 @@
+# v1.12 Release Notes
+
+> This is an incremental software release that adds several improvements across the board.
+> The API is backwards compatible with v1.11
+>
+
+// TODO: update date
+For the detailed list of updates in this release, see the @link:[list of addressed issues](https://github.com/BlueBrain/nexus/issues?&q=is%3Aissue+is%3Aclosed+created%3A2024-12-10..2025-02-28+){ open=new } since v1.11.
+
+If you are currently using Nexus Delta from 1.11.x, please
+visit the @ref:[migration instructions](v1.11-to-v1.12-migration.md) for the necessary steps to successfully upgrade.
+
+
+## Nexus Delta
+
+### Support of JSON-LD 1.1
+
+This change allow Nexus to provide a full support of JSON-LD 1.1 including features such as scoped contexts and JSON literals.
+
+### Default indexing
+
+The default Elasticsearch view now points to a single index to avoid the oversharding problems when a Nexus instance contains a lot of projects.