Skip to content

Commit 89b5908

Browse files
committed
M #-: Modify technical details for new scheduler
Signed-off-by: Pedro Ielpi <[email protected]>
1 parent 2b54268 commit 89b5908

File tree

3 files changed

+22
-49
lines changed

3 files changed

+22
-49
lines changed

source/installation_and_configuration/ha/frontend_ha.rst

Lines changed: 8 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -316,7 +316,7 @@ The whole procedure is documented :ref:`above <frontend_ha_setup_add_remove_serv
316316

317317
.. _frontend_ha_recover_servers:
318318

319-
Recovering servers
319+
Recovering Servers
320320
================================================================================
321321

322322
When a *follower* is down for some time it may fall out of the recovery window, i.e. the log may not include all the records needed to bring it up to date. In order to recover this server you need to:
@@ -340,7 +340,7 @@ During maintenance you may use ``onezone disable zone_id``. Disabled zone can st
340340

341341
.. _frontend_ha_shared:
342342

343-
Shared data between HA nodes
343+
Shared data Between HA Nodes
344344
================================================================================
345345

346346
HA deployment requires the filesystem view of most datastores (by default in ``/var/lib/one/datastores/``) to be the same on all frontends. It is necessary to set up a shared filesystem over the datastore directories. This document doesn't cover configuration and deployment of the shared filesystem; it is left completely up to the cloud administrator.
@@ -386,7 +386,7 @@ The Raft algorithm can be tuned by several parameters in the configuration file
386386

387387
Any change in these parameters can lead to unexpected behavior during the fail-over and result in whole-cluster malfunction. After any configuration change, always check the crash scenarios for the correct behavior.
388388

389-
Compatibility with the earlier HA
389+
Compatibility with the Earlier HA
390390
=================================
391391

392392
In OpenNebula <= 5.2, HA was configured using a classic active-passive approach, using Pacemaker and Corosync. While this still works for OpenNebula > 5.2, it is not the recommended way to set up a cluster. However, it is fine if you want to continue using that HA method if you're coming from earlier versions.
@@ -395,38 +395,30 @@ This is documented here: `Front-end HA Setup <http://docs.opennebula.io/5.2/adva
395395

396396
.. _server_sync_ha:
397397

398-
Synchronize configuration files across servers
398+
Synchronize Configuration Files Across Servers
399399
================================================================================
400400

401-
You can use the command ``onezone serversync``. This command is designed to help administrators to sync OpenNebula's configurations across High Availability (HA) nodes and fix lagging nodes in HA environments. It will first check for inconsistencies between local and remote configuration files inside ``/etc/one/`` directory. In case these exist, the local version will be replaced by the remote version and only the affected service will be restarted. Whole configuration files will be replaced with the sole exception of ``/etc/one/oned.conf``. In this case, the local ``FEDERATION`` configuration will be maintained, but the rest of the content will be overwritten. A backup will be made inside ``/etc/one/`` before replacing any file.
401+
To synchronize files, you can use the command ``onezone serversync``. This command is designed to help administrators to sync OpenNebulas configurations across HA nodes and fix lagging nodes in HA environments. The command first checks for inconsistencies between local and remote configuration files inside the ``/etc/one/`` directory. If inconsistencies are found, the local version of a file will be replaced by the remote version, and only the affected service will be restarted. Whole configuration files will be replaced, with the sole exception of ``/etc/one/oned.conf``. For this file, the local ``FEDERATION`` configuration will be maintained, but the rest of the content will be overwritten. Before replacing any file, a backup will be made inside ``/etc/one/``.
402402

403-
.. warning:: Only use this option between HA nodes, never across federated nodes
403+
.. warning:: Only use this option between HA nodes, never across federated nodes.
404404

405405
This is the list of files that will be checked and replaced:
406406

407407
Individual files:
408408

409-
- ``/etc/one/az_driver.conf``
410-
- ``/etc/one/az_driver.default``
411-
- ``/etc/one/ec2_driver.conf``
412-
- ``/etc/one/ec2_driver.default``
413-
- ``/etc/one/econe.conf``
414409
- ``/etc/one/monitord.conf``
415410
- ``/etc/one/oneflow-server.conf``
416411
- ``/etc/one/onegate-server.conf``
417-
- ``/etc/one/vcenter_driver.default``
418-
419-
420412

421413
Folders:
422414

423415
- ``/etc/one/fireedge``
424416
- ``/etc/one/auth``
425-
- ``/etc/one/ec2query_templates``
426417
- ``/etc/one/hm``
418+
- ``/etc/one/schedulers``
427419
- ``/etc/one/vmm_exec``
428420

429-
.. note:: Any file inside previous folders that doesn't exist on the remote server (like backups) will **not** be removed.
421+
.. note:: Any file inside the above folders that does not exist on the remote server (such as backups) will *not* be removed.
430422

431423
Usage
432424
-----

source/integration_and_development/references/compile.rst

Lines changed: 1 addition & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ Follow these simple steps to install the OpenNebula software:
2525
2626
.. note::
2727

28-
scons can parallelize the build with the `-j NUM_THREADS` parameter. For instance, to compile the with 4 parallel processes execute
28+
scons can parallelize the build with the `-j NUM_THREADS` parameter. For instance, to compile the with 4 parallel processes execute:
2929

3030
.. code::
3131
@@ -145,29 +145,6 @@ The packages do a ``system-wide`` installation. To create a similar environment,
145145
scons: done building targets.
146146
oneadmin@frontend:~/opennebula-x.y.z $> sudo ./install.sh -u oneadmin -g oneadmin
147147

148-
.. warning::
149-
150-
An error as below might occur during building process:
151-
.. prompt:: bash # auto
152-
153-
# scons -j2 mysql=yes syslog=yes
154-
/usr/bin/ld: src/common/libnebula_common.a(HttpRequest.o): undefined reference to symbol 'curl_easy_cleanup'
155-
/usr/bin/ld: /usr/lib64/libcurl.so.4: error adding symbols: DSO missing from command line
156-
collect2: error: ld returned 1 exit status
157-
scons: *** [src/scheduler/src/sched/mm_sched] Error 1
158-
scons: building terminated because of errors.
159-
160-
In that case one needs to patch ``src/scheduler/src/sched/SConstruct`` file:
161-
162-
.. prompt:: bash # auto
163-
164-
# diff one/src/scheduler/src/sched/SConstruct one-orig/src/scheduler/src/sched/SConstruct
165-
48c48,49
166-
< 'xml2'
167-
---
168-
> 'xml2',
169-
> 'curl'
170-
171148
Ruby Dependencies
172149
================================================================================
173150

source/open_cluster_deployment/kvm_node/kvm_driver.rst

Lines changed: 13 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -481,10 +481,10 @@ Tuning & Extending
481481

482482
.. _kvm_multiple_actions:
483483

484-
Multiple Actions per Host
484+
Multiple Actions per Host or Cluster
485485
--------------------------------------------------------------------------------
486486

487-
By default the VMM driver is configured to allow more than one action to be executed per Host. Make sure the parameter ``-p`` is added to the driver executable. This is done in ``/etc/one/oned.conf`` in the VM_MAD configuration section:
487+
By default the VMM driver is configured to allow more than one action to be executed per Host. Make sure the parameter ``-p`` is added to the driver executable. This is done in ``/etc/one/oned.conf``, in the ``VM_MAD`` configuration section:
488488

489489
.. code::
490490
@@ -495,23 +495,27 @@ By default the VMM driver is configured to allow more than one action to be exec
495495
DEFAULT = "vmm_exec/vmm_exec_kvm.conf",
496496
TYPE = "kvm" ]
497497
498-
Restart the main OpenNebula service if changes were made to the mentioned file:
498+
Additionally, also in ``/etc/one/oned.conf``, increase the value of the ``MAX_ACTIONS_PER_HOST`` (default = ``1``), for example:
499+
500+
.. prompt:: bash $ auto
501+
502+
MAX_ACTIONS_PER_HOST = 10
503+
504+
To increase the maximum number of allowed actions per cluster, increase the value of the ``MAX_ACTIONS_PER_CLUSTER`` parameter (default = ``30``).
505+
506+
After changing ``/etc/one/oned.conf``, restart the main OpenNebula service:
499507

500508
.. prompt:: bash $ auto
501509

502510
$ sudo systemctl restart opennebula
503511

504-
The scheduler configuration should be changed to let it deploy more than one VM per Host. The file is located at ``/etc/one/sched.conf`` and the value to change is ``MAX_HOST`` For example, to let the scheduler submit 10 VMs per Host use this line:
512+
Additionally, if you are using the Rank Scheduler, you will need to change the configuration to let the scheduler deploy more than one VM per Host. In the file ``/etc/one/schedulers/rank.conf``, change the value of the ``MAX_HOST`` parameter. For example, to let the scheduler submit 10 VMs per Host:
505513

506514
.. code::
507515
508516
MAX_HOST = 10
509517
510-
Restart the scheduler service for this change to take effect:
511-
512-
.. prompt:: bash $ auto
513-
514-
$ sudo systemctl restart opennebula-scheduler
518+
Changes in ``rank.conf`` do not require a restart.
515519

516520
.. _kvmg_files_and_parameters:
517521

0 commit comments

Comments
 (0)