GH-633: Optimise routing to reduce DNS resolution 'mark' (#183)

* GH-633: modify how the NodeRecordMetadataMessage is handled

* GH-633: use the hashset for unreachable hosts for compute_undesirability()

* GH-633: NodeRecordMetadataMessage handler is able to add unreachable host to the hashset of unreachanle hosts

* GH-633: add the ability to receive the Option of hostname inside compute_new_undesirability()

* GH-633: remove clippy warnings

* GH-633: fix tests in proxy_server.rs

* GH-611: fix test masq_erc20_contract_exists_on_ethereum_ropsten_integration

* GH-633: remove commented out code

* GH-633: fix the errors in multinode integration tests

* GH-633: use an enum to generalise NodeRecordMetadataMessage and only send this message when host name is found

* GH-633: remove the desirable_for_exit field

* GH-633: rename server_name to server_name_opt inside AddReturnRouteMessage

* GH-633: remove problems due to change in NodeRecordMetadata structure inside multinode integration tests

* GH-633: use lifetime specifier instead of cloning the hostname as a String

* GH-633: Review 2 changes

* GH-633: refactor the code isnide handle_dns_resolve_failure()

* Partial multinode test

* GH-633 Test is written, but doesn't pass yet

* GH-633 New multinode test passes, but suspiciously

* GH-633 Multinode test working, but failing; plus some light mods

* Removed warnings

* GH-499: Made ProxyServer picky about main and alias keys; fixed CryptDENull to panic about mismatched keys

* There's something funky about the way Standard Gossip is processed that produces a half neighborship where there should be a full neighborship

* GH-633: Test works better

* GH-633: remove clippy warnings

* GH-633: fix the failing test

* Multinode test is still failing, but more successfully than ever before

* GH-633: Commented out part of multinode test that doesn't pass in order to consider a new card

* GH-633: minor review changes inside proxy_server/mod.rs

* GH-633: formatting changes

* GH-633: remove clippy warnings

* GH-633: increase version

* GH-633: rename field to originator_public_key

* GH-631: Did more fixing on the blockchain multinode test

* GH-633: An attempt to remove the warnings inside the multinode test

* GH-633: change the version number of libc from 2.36-4 to 2.36-6

* GH-633: implement alias_public_key
() and absorb_configuration() for MASQRealNode

* GH-633: trying to fix the multinode test errors

* GH-633: rename the field back to originator_alias_public_key

* GH-633: remove clippy warnings from the multinode tests

* GH-611: remove unused import from the file communication_failure_test.rs

* GH-633: remove warnings from the connection_termination_test.rs

* GH-633: Added some time for example.com to respond

* GH-633: fixing to right use of cryptdes on decrypting cores packages as the routing service

* GH-633: fix one test in the routing_service.rs

* GH-633: modify helper functions and fix the test logs_and_ignores_message_that_cannot_be_decrypted

* GH-633: fix test route_logs_and_ignores_cores_package_that_demands_proxy_client_routing_with_paying_wallet_that_cant_pay

* GH-633: fix test converts_live_message_to_expired_for_existing_proxy_client

* GH-633: continue with Bert

* GH-633: add some panics and eprintlns for debugging

* GH-633: fix all tests in routing_service.rs

* GH-633: add a todo

* GH-633: fix the integration test

* GH-633: fix test reported_server_drop

* GH-633: fix of an issue with fatal instance dropping: seeking for a decent solution of that need for allowence of post-creation configuration of MASQMockNode

* GH-633(for bert): Review 1 Changes (#228)

* GH-633: fix the test symmetric_encryption_fails_with_different_keys (only failing on IDE)

* GH-633: remove the to_hex function

* GH-633: reduce the thread sleep by 1 sec inside the bookkeeping test

* GH-633: remove the lazy_static inside the test module of the file routing_service.rs

* GH-633: review changes for the routing_service.rs

* GH-633: add test route_data_to_peripheral_component_uses_main_key_on_payload_for_hopper

* GH-633: add review changes for gossip_acceptor.rs

* GH-633: further changes in gossip_acceptor.rs

* GH-633: compose message only if log level is debug

* GH-633: typecast payload_size to u64

* GH-633: improve the trace log for calculating undesirability of the DNS Resolution failure

* GH-633: further review changes for the src/neighborhood/mod.rs

* GH-633: join filter and map to form filter_map

* GH-633: add diagram to the test standard_gossip_containing_unfamiliar_node_addrs_leads_to_them_being_ignored

* GH-633: add review changes for the src/proxy_client/mod.rs

* GH-633: rename variables in verify_sigature()

* GH-633: use the 2 functions inside impl block of RatePack in production code

* GH-633: bring back the test id_returns_error_when_the_id_fails_to_decrypt

* GH-633: rename utility function to make_route_to_proxy_client()

* GH-633: improve comment and rename variables in the function make_round_trip_route

* GH-633: fix the problem with the match arm in compute_new_undesirability

* GH-633: represent pub key in hex

* GH-633: remove the commented out code after migrating it to a new card

* GH-633: add assertions for dns error response inside the multinode test

* GH-633: change host_name to hostname inside the NRMetadataChange::AddUnreachableHost

* GH-633: formatting fixes

* GH-633: make the assertions alive inside the multinode test and add a new todo

* GH-633 (for bert): Review 2 Changes (#231)

* GH-633: function rename to add_src_node_as_half_neighbor

* GH-633: improve diagram for the test standard_gossip_containing_unfamiliar_node_addrs_leads_to_them_being_ignored

* GH-633: improve the way debug message is built

* GH-633: improve assertion for logs for fn computing_undesirability_works_for_exit_on_over_leg_for_blacklisted_host

* GH-633: rename variables inside fn verify_signature

* GH-633: rename the fn name to make_one_way_route_to_proxy_client

* GH-633: formatiing changes

* GH-633: remove blank line

* GH-633: remove unnecessary comment inside the test

* GH-633: attempt to fix build errors

* GH-671: removing www.failingFailing.com as non-http anymore for www.neverssl.com

* GH-633: fix formatting issues

* GH-633: correction of a non-ideal design for a configurable mock node handle

* GH-633: fix the test symmetric_encryption_fails_with_different_keys

* GH-633: fix formatting issues

* GH-633: review five (#235)

* GH-633-after-review-four: addressed things from the review

* GH-633: another try to implement the mutable MASQMockNode even better, huh

* GH-633-after-review-four: a little change in function name

---------

Co-authored-by: Bert <[email protected]>

* GH-633: bump the version to 0.7.2

---------

Co-authored-by: Dan Wiebe <[email protected]>
Co-authored-by: masqrauder <[email protected]>
Co-authored-by: Bert <[email protected]>
Co-authored-by: Bert <[email protected]>

Author: 5 people

automap/Cargo.lock

@@ -1,6 +1,6 @@
 [package]
 name = "automap"
-version = "0.7.0"
+version = "0.7.2"
 authors = ["Dan Wiebe <[email protected]>", "MASQ"]
 license = "GPL-3.0-only"
 copyright = "Copyright (c) 2019-2021, MASQ (https://masq.ai) and/or its affiliates. All rights reserved."

automap/Cargo.toml

@@ -44,4 +44,5 @@ echo "***                                             AUTOMAP HEAD
 cd "$CI_DIR/../automap"
 ci/all.sh "$PARENT_DIR"
 echo "***                                             AUTOMAP TAIL                                          ***"
-echo "*********************************************************************************************************"
+echo "*********************************************************************************************************"
+

ci/all.sh

@@ -1,6 +1,6 @@
 [package]
 name = "dns_utility"
-version = "0.7.1"
+version = "0.7.2"
 license = "GPL-3.0-only"
 authors = ["Dan Wiebe <[email protected]>", "MASQ"]
 copyright = "Copyright (c) 2019, MASQ (https://masq.ai) and/or its affiliates. All rights reserved."

dns_utility/Cargo.lock

@@ -1,6 +1,6 @@
 [package]
 name = "masq"
-version = "0.7.1"
+version = "0.7.2"
 authors = ["Dan Wiebe <[email protected]>", "MASQ"]
 license = "GPL-3.0-only"
 copyright = "Copyright (c) 2019, MASQ (https://masq.ai) and/or its affiliates. All rights reserved."

dns_utility/Cargo.toml

@@ -1,6 +1,6 @@
 [package]
 name = "masq_lib"
-version = "0.7.1"
+version = "0.7.2"
 authors = ["Dan Wiebe <[email protected]>", "MASQ"]
 license = "GPL-3.0-only"
 copyright = "Copyright (c) 2019, MASQ (https://masq.ai) and/or its affiliates. All rights reserved."

masq/Cargo.toml

@@ -1,6 +1,6 @@
 [package]
 name = "multinode_integration_tests"
-version = "0.7.1"
+version = "0.7.2"
 authors = ["Dan Wiebe <[email protected]>", "MASQ"]
 license = "GPL-3.0-only"
 copyright = "Copyright (c) 2019, MASQ (https://masq.ai) and/or its affiliates. All rights reserved."

masq_lib/Cargo.toml

@@ -2,7 +2,7 @@
 
 OUTPUT_DIR="$1"
 mkdir -p "$OUTPUT_DIR"
-for container in $(docker ps -a | tail -n +2 | cut -c 128- | grep test_node_)
+for container in $(docker ps -a | tail -n +2 | cut -c 177- | grep test_node_)
 do
     ./docker_logs.sh "$container" > "$OUTPUT_DIR"/"$container".log
 done