Skip to content

Conversation

davidkyle
Copy link
Member

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then the default value (false) means ML will only use 30% of the available memory making it impractical to run the ELSER model without giving the container a huge amount of memory. Start local sets xpack.ml.use_auto_machine_memory_percent : true for this reason

For users wanting to get started with semantic search it is confusing that they cannot run an ml model in the container as instructed in the Install Elasticsearch with Docker guide.

The single node docker instructions have been updated with a command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent.

For the multi-node guide the docker compose file is updated to enable the ml setting for every node in the cluster. An alternative would be to make only 1 of the 3 nodes an ml node and apply the setting to that node only.

Copy link
Contributor

github-actions bot commented Oct 3, 2024

Documentation preview:

@elasticsearchmachine elasticsearchmachine added the Team:Docs Meta label for docs team label Oct 3, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-docs (Team:Docs)

Copy link
Contributor

@shainaraskas shainaraskas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approved with a couple of edits!

@davidkyle davidkyle added the auto-backport Automatically create backport pull requests when merged label Oct 7, 2024
@davidkyle
Copy link
Member Author

In the preview, the formatting for the code example I added is not right. I can't see what I did wrong, @shainaraskas can see what I'm missing please

Screenshot 2024-10-07 at 20 01 56

Copy link
Contributor

@szabosteve szabosteve left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM2!

@davidkyle
Copy link
Member Author

@elasticmachine update branch

@davidkyle davidkyle enabled auto-merge (squash) November 8, 2024 12:28
@davidkyle davidkyle merged commit b161f2c into elastic:main Nov 8, 2024
4 of 5 checks passed
davidkyle added a commit to davidkyle/elasticsearch that referenced this pull request Nov 8, 2024
…cker getting started (elastic#114009)

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then
the default value (false) means ML will only use 30% of the available memory making
it impractical to run the ELSER model. This is useful for users wanting to get started 
with semantic search.The single node docker instructions have been updated with a 
command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent. For the multi-node guide the docker 
compose file is updated to enable the ml setting for every node in the cluster.
davidkyle added a commit to davidkyle/elasticsearch that referenced this pull request Nov 8, 2024
…cker getting started (elastic#114009)

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then
the default value (false) means ML will only use 30% of the available memory making
it impractical to run the ELSER model. This is useful for users wanting to get started 
with semantic search.The single node docker instructions have been updated with a 
command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent. For the multi-node guide the docker 
compose file is updated to enable the ml setting for every node in the cluster.
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.16
8.x

elasticsearchmachine pushed a commit that referenced this pull request Nov 8, 2024
…cker getting started (#114009) (#116480)

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then
the default value (false) means ML will only use 30% of the available memory making
it impractical to run the ELSER model. This is useful for users wanting to get started 
with semantic search.The single node docker instructions have been updated with a 
command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent. For the multi-node guide the docker 
compose file is updated to enable the ml setting for every node in the cluster.
elasticsearchmachine pushed a commit that referenced this pull request Nov 8, 2024
…cker getting started (#114009) (#116479)

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then
the default value (false) means ML will only use 30% of the available memory making
it impractical to run the ELSER model. This is useful for users wanting to get started 
with semantic search.The single node docker instructions have been updated with a 
command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent. For the multi-node guide the docker 
compose file is updated to enable the ml setting for every node in the cluster.
jozala pushed a commit that referenced this pull request Nov 13, 2024
…cker getting started (#114009)

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then
the default value (false) means ML will only use 30% of the available memory making
it impractical to run the ELSER model. This is useful for users wanting to get started 
with semantic search.The single node docker instructions have been updated with a 
command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent. For the multi-node guide the docker 
compose file is updated to enable the ml setting for every node in the cluster.
alexey-ivanov-es pushed a commit to alexey-ivanov-es/elasticsearch that referenced this pull request Nov 28, 2024
…cker getting started (elastic#114009)

If xpack.ml.use_auto_machine_memory_percent is not explicitly set to true then
the default value (false) means ML will only use 30% of the available memory making
it impractical to run the ELSER model. This is useful for users wanting to get started 
with semantic search.The single node docker instructions have been updated with a 
command that gives the container enough memory to run the ELSER model and enables xpack.ml.use_auto_machine_memory_percent. For the multi-node guide the docker 
compose file is updated to enable the ml setting for every node in the cluster.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged >docs General docs changes Team:Docs Meta label for docs team v8.16.0 v8.17.0 v9.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants