Update semantic highlighting sagemaker endpoint deploy scripts (#585)

* Update semantic highlighting sagemaker endpoint deploy scripts

Signed-off-by: Junqiu Lei <[email protected]>

* Address review comments: improve offline deployment support

Signed-off-by: Junqiu Lei <[email protected]>

* Address review comments: simplify ModernBERT semantic matching

Signed-off-by: Junqiu Lei <[email protected]>

* Use NLTK for robust sentence splitting in ModernBERT

Signed-off-by: Junqiu Lei <[email protected]>

* Update batch inference in ModernBERT semantic highlighting
Signed-off-by: Junqiu Lei <[email protected]>

Signed-off-by: Junqiu Lei <[email protected]>

---------

Signed-off-by: Junqiu Lei <[email protected]>

Author: junqiu-lei

CHANGELOG.md

@@ -36,6 +36,7 @@ Inspired from [Keep a Changelog](https://keepachangelog.com/en/1.0.0/)
 - Upgrade torch version to fix security issue ([#561](https://github.com/opensearch-project/opensearch-py-ml/pull/561))
 - Upgrade numpy and python version ([#562](https://github.com/opensearch-project/opensearch-py-ml/pull/562))
 - Update space type mapping for sentence transformer models ([#574](https://github.com/opensearch-project/opensearch-py-ml/pull/574))
+- Update semantic highlighting sagemaker endpoint deploy scripts ([#585](https://github.com/opensearch-project/opensearch-py-ml/pull/585))
 
 ### Fixed
 - Fix for uploading models with function_name instead of model_task ([#553](https://github.com/opensearch-project/opensearch-py-ml/pull/553))