Skip to content

Commit 78aeb7b

Browse files
author
Sebastian Wagner
committed
Merge remote-tracking branch 'upstream/schacht/doc-improvements' into develop
2 parents b2e067a + baa6d92 commit 78aeb7b

File tree

2 files changed

+17
-18
lines changed

2 files changed

+17
-18
lines changed

docs/user/FAQ.rst

Lines changed: 14 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -14,13 +14,11 @@ Permission denied when using redis unix socket
1414

1515
If you get an error like this:
1616

17-
```
18-
intelmq.lib.exceptions.PipelineError: pipeline failed - ConnectionError('Error 13 connecting to unix socket: /var/run/redis/redis.sock. Permission denied.',)
19-
```
17+
``intelmq.lib.exceptions.PipelineError: pipeline failed - ConnectionError('Error 13 connecting to unix socket: /var/run/redis/redis.sock. Permission denied.',)``
2018

21-
make sure the permissions for the socket are set accordingly in `/etc/redis/redis.conf` (or wherever your config is), e.g.:
19+
make sure the permissions for the socket are set accordingly in ``/etc/redis/redis.conf`` (or wherever your config is), e.g.:
2220

23-
unixsocketperm 777
21+
``unixsocketperm 777``
2422

2523
Why is the time invalid?
2624
-------------------------------------------------------------------
@@ -41,13 +39,13 @@ In most cases the bottlenecks are look-up experts. In these cases you can easily
4139
Multithreading
4240
^^^^^^^^^^^^^^
4341
44-
When using the AMQP broker, you can make use of Multi-threading. See the [Uer-Guide, section Multithreading](User-Guide.html#multithreading-beta).
42+
When using the AMQP broker, you can make use of Multi-threading. See the :ref:`multithreading` section.
4543
4644
"Classic" load-balancing (Multiprocessing)
4745
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
4846
4947
Before Multithreading was available in IntelMQ, and in case you use Redis as broker, the only way to do load balancing involves more work.
50-
Create multiple instances of the same bot and connect them all to the same source and destination bots. Then set the parameter `load_balance` to `true` for the bot which sends the messages to the duplicated bot. Then, the bot sends messages to only one of the destination queues and not to all of them.
48+
Create multiple instances of the same bot and connect them all to the same source and destination bots. Then set the parameter ``load_balance`` to ``true`` for the bot which sends the messages to the duplicated bot. Then, the bot sends messages to only one of the destination queues and not to all of them.
5149

5250
True Multi*processing* is not available in IntelMQ. See also this :issue:`discussion on a possible enhanced load balancing <186>`.
5351

@@ -70,36 +68,34 @@ The raw data consumes about 50% - 30% of the messages' size. The size of course
7068

7169
You can do this for example by using the *Field Reducer Expert*. The configuration could be:
7270

73-
* `type`: `blacklist`
74-
* `keys`: `raw`
71+
* ``type``: ``blacklist``
72+
* ``keys``: ``raw``
7573

7674
Other solutions are the *Modify* bot and the *Sieve* bot. The last one is a good choice if you already use it and you only need to add the command:
7775

78-
```
79-
remove raw
80-
```
76+
``remove raw``
8177

8278
**In the database**
8379

8480
In case you store data in the database and you want to keep its size small, you can (periodically) delete the raw data there.
8581

8682
To remove the raw data for a events table of a PostgreSQL database, you can use something like:
8783

88-
```
89-
UPDATE events SET raw = NULL WHERE "time.source" < '2018-07-01';
90-
```
84+
.. code-block:: sql
9185
92-
If the database is big, make sure only update small parts of the database by using an appropriate `WHERE` clause. If you do not see any negative performance impact, you can increase the size of the chunks, otherwise the events in the output bot may queue up. The `id` column can also be used instead of the source's time.
86+
UPDATE events SET raw = NULL WHERE "time.source" < '2018-07-01';
87+
88+
If the database is big, make sure only update small parts of the database by using an appropriate ``WHERE`` clause. If you do not see any negative performance impact, you can increase the size of the chunks, otherwise the events in the output bot may queue up. The ``id`` column can also be used instead of the source's time.
9389

9490
My bot(s) died on startup with no errors logged
9591
-------------------------------------------------------------------
9692

97-
Rather than starting your bot(s) with `intelmqctl start`, try `intelmqctl run [bot]`. This will provide valuable debug output you might not otherwise see, pointing to issues like system configuration errors.
93+
Rather than starting your bot(s) with ``intelmqctl start``, try ``intelmqctl run [bot]``. This will provide valuable debug output you might not otherwise see, pointing to issues like system configuration errors.
9894

9995
Orphaned Queues
10096
-------------------------------------------------------------------
10197

102-
This section has been moved to the [intelmqctl documentation](intelmctl.html#orphaned-queues)
98+
This section has been moved to the section :ref:`orphan-queues`.
10399

104100
.. _faq multithreading not avail:
105101
Multithreading is not available for this bot

docs/user/intelmqctl.rst

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -413,6 +413,9 @@ Check
413413
---------------
414414
This command will do various sanity checks on the installation and especially the configuration.
415415

416+
417+
.. _orphan-queues:
418+
416419
Orphaned Queues
417420
^^^^^^^^^^^^^^^
418421

0 commit comments

Comments
 (0)