Merge pull request #1848 from kielfriedt/main

added more details on 3 nodes replica set

Author: jasonrandrews

content/learning-paths/servers-and-cloud-computing/mongodb/benchmark_mongodb-8.0.md

@@ -28,7 +28,7 @@ sudo yum install python2
   {{< /tab >}}
 {{< /tabpane >}}
 
-For Ubuntu 22.04 and 24.04, Python 2 is not available using the package manager. 
+For Ubuntu 22.04 and 24.04, Python 2 is not available using the package manager.
 
 You can install Python 2.7 using:
 
@@ -61,16 +61,16 @@ cd ycsb-0.17.0
 ./bin/ycsb
 ```
 
-## Load/Insert Test on MongoDB
+## A simple Load/Insert Test on MongoDB
 
-To load and test the performance of loading data(INSERT) into default database `ycsb` at `localhost:27017` where MongoDB is running using the synchronous driver run the following command:
+To load and test the performance of loading data(INSERT) into default database `ycsb` at `(localhost/Primary Node):27017` where MongoDB is running using the synchronous driver run the following command:
 
 ```console
 ./bin/ycsb load mongodb -s -P workloads/workloada -p mongodb.url=mongodb://localhost:27017/ycsb?w=0 -threads 10
 ```
 The "-P" parameter is used to load property files. In this example, you used it load the workloada parameter file which sets the recordcount to 1000 in addition to other parameters. The "-threads" parameter indicates the number of threads and is set to 1 by default.
 
-## Update/Read/Read Modify Write Test on MongoDB
+## A simple Update/Read/Read Modify Write Test on MongoDB
 
 To test the performance of executing a workload which includes running UPDATE, Read Modify Write(RMW) and/or READ operations on the data using 10 threads for example, use the following command:
 
@@ -115,5 +115,5 @@ At the end of each test, statistics are printed to the console. Shown below is t
 ...
 ```
 
-Continue to the next section to run YCSB on a 3 node cluster. 
+[Continue to the next section to run YCSB on a 3 node cluster.](/learning-paths/servers-and-cloud-computing/mongodb/replica_set_testing)
 

content/learning-paths/servers-and-cloud-computing/mongodb/replica.md renamed to content/learning-paths/servers-and-cloud-computing/mongodb/create_replica_set.md

@@ -1,81 +1,40 @@
 ---
 # User change
-title: "Run YCSB using a 3 node replica set"
+title: "Creating MongoDB test scenarios"
 
-draft: true
-
-weight: 5 # (intro is 1), 2 is first, 3 is second, etc.
+weight: 3 # (intro is 1), 2 is first, 3 is second, etc.
 
 # Do not modify these elements
 layout: "learningpathall"
 ---
-
-The recommended MongoDB YCSB test setup is a relica set containing three nodes of equal size. The primary node is the node you send the YCSB traffic to and the others are secondary nodes.
+## MongoDB test scenarios
+To test Mongodb you need two parts. A instance running the testing software([YCSB](/learning-paths/servers-and-cloud-computing/mongodb/benchmark_mongodb-8.0)). one or more instances running MongoDB in some configuration. The recommended MongoDB test setup is a three node relica set. These three nodes are of equal size with one instance being desigated as the primary node( the target for test traffic ) and the others as secondary nodes.
 
 ## What is a replica set?
 
-A replica set is a group of instances that maintain the same data set. A replica set contains many nodes, but 3 nodes are used for testing. 
+A replica set is a group of instances that maintain the same dataset. A replica set contains many nodes, but three nodes are the most common for testing.
 
 ## What node size should I use?
 
-The most common size for testing MongoDB is an 8 vCPU instance. You can test with any sized machine, but if you are looking for ideal testing conditions 8 vCPUs is enough. Each node should have 32GB of RAM.
-
-You should keep the complete data set in memory. Additional details abut the recommended configuration are provided below.
-
-## Create a replica set
-
-Create a 3 node replica set by starting 3 Arm instances with the specifications above. 
-
-Install MongoDB on each node using the previously provided instructions. 
-
-Select 1 instance as the primary node and install YCSB on the instance.
-
-## Initialize the replica set
-
-1. Set variables with the IP addresses of each node:
+The most common size for testing MongoDB is an 8 vCPU instance. You can test with any sized instance, but if you are looking for ideal testing conditions, 8 vCPUs is enough. Each node should have atleast 32GB of RAM.
 
-    ```bash
-    PRIMARY_NODE_IP="<primary-node-ip>"
-    SECONDARY_NODE1_IP="<secondary-node1-ip>"
-    SECONDARY_NODE2_IP="<secondary-node2-ip>"
-    ```
+To achieve the best results, its recommended to keep the complete data set in memory. If you see disk access when running tests, increase the RAM size of your instances. Additional details about the recommended configuration are provided below.
 
-2. Connect to the primary node using the MongoDB shell:
-
-    ```bash
-    mongosh --host <primary-node-ip>:27017
-    ```
+## Creating replica sets
 
-3. Initialize the replica set with the following command:
+You can create replica sets of any size(two is the minimum). Three is recemmended but you can add as many as you like.
 
-    ```bash
-    PRIMARY_NODE_IP="<primary-node-ip>"
-    SECONDARY_NODE1_IP="<secondary-node1-ip>"
-    SECONDARY_NODE2_IP="<secondary-node2-ip>"
+## Three node replica sets
 
-    mongosh --host $PRIMARY_NODE_IP:27017 <<EOF
-    rs.initiate({
-      _id: "rs0",
-      members: [
-        { _id: 0, host: "$PRIMARY_NODE_IP:27017" },
-        { _id: 1, host: "$SECONDARY_NODE1_IP:27017" },
-        { _id: 2, host: "$SECONDARY_NODE2_IP:27017" }
-      ]
-    })
-    EOF
-    ```
+To creating a three node replica set, start by launching three [Arm based instance](/learning-paths/servers-and-cloud-computing/csp/) of equal size.
 
-3. Verify the replica set status:
+[install](/learning-paths/servers-and-cloud-computing/mongodb/run_mongodb) Mongodb on all three instances.
 
-    ```bash
-    mongosh --host $PRIMARY_NODE_IP:27017 <<EOF
-    rs.status()
-    EOF
-    ```
+Once all three instances are up and running. Modify the service and configuration file for all instances.
 
 ## Modify the MongoDB configuration
 
-Use a text editor to edit the file `/etc/mongodb.conf` file and replace the contents of the file with the text below.
+Use a text editor to edit the file `/etc/mongodb.conf` and replace the contents of the file with the text below.
 
 ```console
 # Configuration Options: https://docs.mongodb.org/manual/reference/configuration-options/
@@ -111,6 +70,8 @@ setParameter:
   tlsWithholdClientCertificate: true
 ```
 
+**Details of what all these mean is below:**
+
 **systemLog:** Contains locations and details of where logging should be contained.
 - **path:** Location for logging
 
@@ -135,39 +96,87 @@ setParameter:
 
 If you want to use encryption you will need to add the security and keyFile to your configuration. As well as change some of the parameters in the `mongod.conf` file.
 
+Run this command to reload the new configurtion.
 
-## Recommended Tests on MongoDB
-
-The most common real world test to run is a 95/5 test, 95% read and 5% update. 100/0 and 90/10 are also popular. 
+```
+sudo service mongod restart
+```
 
-Run the following commands for about 5 mins before collecting data.
+## Modify the MongoDB service
 
-Load the dataset:
+Use a text editor to edit the file `/etc/systemd/system/mongod.service` and replace the contents of the file with the text below.
 
-```console
-./bin/ycsb load mongodb -s  -P workloads/workloadb  -p mongodb.url=mongodb://localhost:27017 -p compressibility=2 -p fieldlengthdistribution=zipfian -p minfieldlength=50 -threads 64 -p recordcount=20000000
+```
+[Unit]
+Description=High-performance, schema-free document-oriented database
+After=network.target
+Documentation=https://docs.mongodb.org/manual
+
+[Service]
+User=mongodb
+Group=mongodb
+ExecStart=/usr/bin/mongod --quiet --config /etc/mongod.conf
+
+# Recommended limits for for mongod as specified in
+# https://docs.mongodb.com/manual/reference/ulimit/#recommended-ulimit-settings
+# (file size)
+LimitFSIZE=infinity
+# (cpu time)
+LimitCPU=infinity
+# (virtual memory size)
+LimitAS=infinity
+# (locked-in-memory size)
+LimitMEMLOCK=infinity
+# (open files)
+LimitNOFILE=64000
+# (processes/threads)
+LimitNPROC=64000
+
+[Install]
+WantedBy=multi-user.target
 ```
 
-Run the 95/5 test:
+details on these can be found here: https://docs.mongodb.com/manual/reference/ulimit/#recommended-ulimit-settings
 
-```console
-./bin/ycsb run mongodb -s  -P workloads/workloadb  -p mongodb.url=mongodb://localhost:27017 -p minfieldlength=50 -p compressibility=2 -p maxexecutiontime=120 -threads 64 -p operationcount=40000000 -p recordcount=20000000 -p requestdistribution=zipfian -p readproportion=0.95 -p updateproportion=0.05
+Run this command to reload the service.
 
+```
+sudo ystemctl daemon-reload
 ```
 
-Run the 100/0 test:
+**Once all three instances are created and have mongodb installed, select one to be your primary node. The remaining instances will be secondary nodes.**
 
-```console
-./bin/ycsb run mongodb -s  -P workloads/workloadc  -p mongodb.url=mongodb://Localhost:27017 -p minfieldlength=50 -p compressibility=2 -p maxexecutiontime=120 -threads 64 -p operationcount=40000000 -p recordcount=20000000 -p requestdistribution=zipfian -p readproportion=1.0 -p updateproportion=0.0
-```
+## Initialize the replica set
 
-Run the 90/10 test:
+Connect to the primary node and run the following commands below.
 
-```console
-./bin/ycsb run mongodb -s  -P workloads/workloadb  -p mongodb.url=mongodb://localhost:27017 -p minfieldlength=50 -p compressibility=2 -p maxexecutiontime=120 -threads 64 -p operationcount=40000000 -p recordcount=20000000  -p requestdistribution=zipfian -p readproportion=0.90 -p updateproportion=0.10
-```
+1. Set variables with the IP addresses of each node:
+
+    ```bash
+    PRIMARY_NODE_IP="<primary-node-ip>"
+    SECONDARY_NODE1_IP="<secondary-node1-ip>"
+    SECONDARY_NODE2_IP="<secondary-node2-ip>"
+    ```
 
-## Other tests
+2. Initialize the replica set with the following command:
+
+    ```
+    mongosh --host $PRIMARY_NODE_IP:27017 <<EOF
+    rs.initiate({
+      _id: "rs0",
+      members: [
+        { _id: 0, host: "$PRIMARY_NODE_IP:27017", priority: 2, votes: 1 },
+        { _id: 1, host: "$SECONDARY_NODE1_IP:27017", priority: 1, votes: 1 },
+        { _id: 2, host: "$SECONDARY_NODE2_IP:27017", priority: 1, votes: 1 }
+      ]
+    })
+    EOF
+    ```
 
-For instructions on running any other tests or more details on the metrics reported, refer to the [GitHub project for the YCSB.](https://github.com/brianfrankcooper/YCSB/wiki/).
+3. Verify the replica set status:
 
+    ```bash
+    mongosh --host $PRIMARY_NODE_IP:27017 <<EOF
+    rs.status()
+    EOF
+    ```

content/learning-paths/servers-and-cloud-computing/mongodb/mongodb_configuration.md

@@ -1,7 +1,7 @@
 ---
 # User change
-title: "Measure performance of MongoDB on Arm"
-weight: 3 # 1 is first, 2 is second, etc.
+title: "Alternative performance testing of MongoDB"
+weight: 6 # 1 is first, 2 is second, etc.
 
 # Do not modify these elements
 layout: "learningpathall"
@@ -53,7 +53,7 @@ Use the following options:
   * `-t` defines the number of threads
   * `-db` defines the database to use
   * `-c` defines how the data is collected.
-  
+
   For example:
 ```bash { cwd="./mongodb-performance-test" }
 export jarfile=./latest-version/mongodb-performance-test.jar