Issue #162 Impl check_access (#165)

* update toolchain to nightly and fix `cargo clippy` installation error

* fix clippy errors

* update to `.await` and fix cargo errors/warnings

* clean up some files

* Clean up some files and some not needed dependencies

* update .travis.yml to use latest nightly

* follower - merge fix for `.await`

* fix cargo fmt

* add rust-toolchain for sentry only, until `.await` is merged

* clean up `sentry`

* make sentry build again

* cargo-make 0.22.2 fixes the installation of clippy so remove the custom task override

* update `futures-preview` to `alpha.19`

* sentry - add the `adapter` along side `futures-preview`, `hyper`, `regex` and `tokio`

* sentry - add the cli options, load config and make a 404 Not found response.

* sentry - add `serde` & `serde_urlencoded`

* sentry - routes - channel - list channel WIP

* sentry - move `fn not_found` & `fn bad_request` to lib

* sentry - Cargo.toml - add `unstable-stream` feature for `hyper`

* sentry - more to channels list and channel create endpoints

* sentry - fix some issues and clean up code

* sentry - Cargo.toml - add `chrono`

* primitives - remove channel::ChannelListParams

* sentry - ChannelListQuery

* sentry - better error response handling & move channel list & create code to own modules

* sentry - Fix changes required because of the merge & `clippy` warnings

* sentry - remove `rust-toolchain`

* fix `rustfmt`

* improve `Adapter`, `EthereumAdapter` & `DummyAdapter`

* sentry - Application struct

* Fix `EthereumAdapter` and fix `clippy` warnings

* fix import

* primitives - big_num - fix `clippy` warnings about `to_owned()`

* primitives - add `slog` and impl own PrefixCompactFormat

* primitives - re-export `slog_async::Async` & `slog_term::TermDecorator`

* sentry - working logging for the `Application`:
- use the re-exported from `primitives` `slog` structs & traits
- Cargo.toml - remove `slog-term` & `slog-async` since we use the re-exported once

* sentry - use `error!` for server error & suppress `clustered` warning for not using it now

* Use patch instead of `git` url & branch in the `primitives` `Cargo.toml`

* sentry - add listening to port on `Application::run`

* sentry - add missing `info` import

* Fix some merge problems and re-add the `Send` trait bound for the `Adapter`

* sentry - Cargo.toml - add `redis`

* sentry - register `db` module and add `REDIS_URL` to it

* sentry - function for creating `redis` async connection

* [WIP] sentry - access - check_access - rules that are applicable

* primitives - config - use `RateLimit` from `event_submission` module

* primitives - use `std::time::Duration` for `RateLimit.time_frame`
- primitives - Cargo.toml - add `serde_millis`
- primitives - `RateLimit.time_frame` to `Duration`

* primitives - Cargo.toml - reorder dependencies

* sentry - access - finish up `check_access`

* Clean up README files

* sentry - db - fix wrong merge & change to SharedConnection

* sentry - db - `expect()` instead of `unwrap()`

* sentry - access - take reference to `RateLimit`

* sentry - Cargo.toml - `redis` to version `0.13.1-alpha`
- Cargo.toml - `redis` patch for WIP branch of `async_await_api`

* [+test] sentry - access - check_access - return Result, fix `redis` error

* [test] sentry - access - check_access - finish the last test for an IP RateLimit

* Travis-ci - add `redis` service

Author: elpiel

.travis.yml

@@ -6,6 +6,8 @@ env:
   global:
     - CARGO_MAKE_RUN_CHECK_FORMAT="true"
     - CARGO_MAKE_RUN_CLIPPY="true"
+services:
+  - redis-server
 matrix:
   fast_finish: true
 script:

Cargo.lock

@@ -7,3 +7,6 @@ members = [
     "sentry",
     "adview-manager",
 ]
+
+[patch.crates-io]
+redis = {version = "0.13.1-alpha.0", git = "https://github.com/Marwes/redis-rs", branch = "async_await_api"}

Cargo.toml

@@ -6,42 +6,12 @@ Reference implementation of the [AdEx validator stack](https://github.com/adexne
 
 Components:
 
-* Domain crate
-* Sentry - check the list of [opened issues](https://github.com/AdExNetwork/adex-validator-stack-rust/issues?q=is:open+is:issue+project:AdExNetwork/adex-validator-stack-rust/1)
-* Validator worker - The validator worker(`Leader` or `Follower`) that validates/proposes new states.
-* memory-repository - Generic helper crate for creating InMemory repositories for testing.
-* adapter - Adapter trait for `sign`, `verify` and `validate_channel` with Dummy implementation for testing.
+* Sentry
+* Validator worker
+* Adapter
+* AdView manager
 
-**Note:** Please refer to the README.md of the component for a more detailed overview of it.
-
-## Domain
-Contains all the Domain `Aggregates`, `Entities`, `Value Objects`, interfaces (traits) and `Domain Error`.
-The interfaces(traits) include  The `RepositoryFuture` and the `Aggregates`/`Entities` traits for the repositories.
-
-All the structs have defined (de)serialization. The also have incorporated domain rules, e.g.
-`TargetingTag.score` (the `Score` struct) should be with a value between `0` and `100`.
-This means that once we have a `Score` object, we are guaranteed to have a valid object everywhere.
-
-The `Repository` traits are meant to help you create the correct abstractions in the underlying application,
-as every application has different requirements for the way and things it will fetch.
-
-## Sentry & Validator worker
-
-Split into 3 layer - Domain, Infrastructure & Application.
-- Domain - the domain objects/structs that are defining the business rules and constraints.
-- Infrastructure - specific implementations of e.g. Repositories, Logging and etc.
-like `Memory__Repository`, `Api__Repository` and so on.
-- Application - all the application specific logic, which means services, structs and etc. that use the Domain and it's
-traits to achieve the task at hand. For example: In sentry we have the `resource`s, there we define the
-`channel_create`. Which handles the request, validates it and uses the `ChannelRepository` trait to
-`add` the new Channel and returns the appropriate Response. It is not however limited to Request -> Response.
-
-## Testing setup
-
-### Rust setup
-
-- Requires `nightly 2019-05-08`, because of the new syntax for `await` and our `tower-web` dependency fails to build.
-We've setup `rust-toolchain` but you can manually override it as well with `rustup override set nightly-2019-05-08`.
+## Local & Testing setup
 
 #### Linux
 - The crate `openssl-sys` requires `libssl-dev` and `pkg-config` for Ubuntu.
@@ -53,32 +23,30 @@ We've setup `rust-toolchain` but you can manually override it as well with `rust
 - `$HOME/docker/volumes/postgres` - your local storage for postgres (persist the data when we remove the container)
 - `POSTGRES_PASSWORD=docker` - the password of `postgres` user
 
-### Run Sentry Rest API
+### Run Redis:
 
-`DATABASE_URL=postgresql://postgres:docker@localhost:5432/sentry cargo run --bin sentry`
+`docker run --name some-redis -d redis`
 
-### Run Validator Worker
+### Run automated tests
 
-`cargo run --bin validator`
+Since we have integration tests that require Redis & Postgres,
+you need to be running those in order to run the automated tests:
 
-For the available options:
+`cargo make test`
 
-`cargo run --bin validator -- --help`
+### Run Sentry Rest API
 
-#### Environment variables:
+* With the DummyAdapter(replace the `DummyIdentity`):
 
-**NOTE: Currently we use `.env` file to define values for those environment variables.
-We need to see if we want configuration files per binary instead.**
+`export PORT=8006; cargo run -p sentry -- -a dummy -i DummyIdentity`
 
-##### Sentry: 
-- `DATABASE_URL` - The url of the Postgres database used for production.
-- `SENTRY_CHANNEL_LIST_LIMIT` - the limit per page for listing channels from the `/channel/list` request.
+* With the EthereumAdapter:
 
-##### Validator:
-- `VALIDATOR_TICKS_WAIT_TIME` - The time for a whole cycle(tick) of the validator worker to get & loop channels,
-validate and send statuses and etc.
-- `VALIDATOR_SENTRY_URL` - The url of the Sentry API that should be used
-- `VALIDATOR_VALIDATION_TICK_TIMEOUT` - The maximum time for validation of a single channel as a `Leader` or `Follower`
+TODO
+
+### Run Validator Worker
+
+TODO
 
 ## Development environment
 
@@ -89,5 +57,7 @@ as well as on CI. For a complete list of out-of-the-box commands you can check
 Locally it's enough to ensure that `cargo make` command (it will execute the default dev. command) is passing.
 It will run `rustfmt` for you, it will fail on `clippy` warnings and it will run all the tests.
 
+*Note:* You need to have setup Redis and Postgres as well.
+
 You can related to the [Makefile.stable.toml](https://github.com/sagiegurari/cargo-make/blob/master/src/lib/Makefile.stable.toml)
 for more commands and cargo-make as a whole.

README.md

@@ -11,6 +11,8 @@ futures-preview = { version = "=0.3.0-alpha.19", features = ["compat"]}
 serde = { version = "^1.0", features = ['derive'] }
 serde_json = "1.0"
 serde-hex = "0.1.0"
+serde_millis = "0.1.1"
+# Configuration
 toml = "0.5"
 # Logging
 slog = { version = "^2.5.2" , features = ["max_level_trace"] }
@@ -20,6 +22,9 @@ slog-async = "^2.3.0"
 chrono = { version = "0.4", features = ["serde"] }
 time = "0.1.42"
 hex = "0.3.2"
+merkletree = "0.10.0"
+tiny-keccak = "1.5"
+eth_checksum = "0.1.1"
 # Numbers - BigNum, Numbers, Traits and Derives
 num-bigint = { version = "0.2", features = ["serde"] }
 num = "0.2.0"
@@ -28,9 +33,5 @@ num-derive = "0.2"
 # Fixtures
 fake = { version = "^1.3", features = ["chrono"] }
 rand = { version = "^0.6" }
+# Other
 lazy_static = "1.4.0"
-merkletree = "0.10.0"
-tiny-keccak = "1.5"
-eth_checksum = "0.1.1"
-
-