Riak Test v1.1.0#786

Open

jburwell wants to merge 157 commits intomasterfrom

feature/mixed-mode-riak-test

Commits on Apr 22, 2015

Make some changes to riak_test to make it more flexible

kellymclaughlin
authored and
Brett Hazen
committed
convert bucket_types test to decoupled r_t framework

bowrocker
authored and
Brett Hazen
committed
convert basic_command_line test to decoupled r_t framework

bowrocker
authored and
Brett Hazen
committed
convert bucket_types test to decoupled r_t framework

bowrocker
authored and
Brett Hazen
committed
convert bucket_props_roundtrip test to decoupled r_t framework

bowrocker
authored and
Brett Hazen
committed
Move replication tests to separate subdirectory

kellymclaughlin
authored and
Brett Hazen
committed
Move rebar plugin to separate directory

kellymclaughlin
authored and
Brett Hazen
committed
Add missing node function to rt.erl

kellymclaughlin
authored and
Brett Hazen
committed
Remove direct calls to rtdev harness from replication tests

kellymclaughlin
authored and
Brett Hazen
committed
Move configuration functions to rt_config.

bowrocker
authored and
Brett Hazen
committed
Continue to move config functions from rt to rt_config.

bowrocker
authored and
Brett Hazen
committed
Migrate several more functions into rt_cluster from rt.

bowrocker
authored and
Brett Hazen
committed
Move backend related functions from rt module to new rt_backend module.

bowrocker
authored and
Brett Hazen
committed
Move protobuf-related functions from rt module to rt_pb.

bowrocker
authored and
Brett Hazen
committed
Fix rt_pb function exports.

bowrocker
authored and
Brett Hazen
committed
Refactor http-relate rt functions

bowrocker
authored and
Brett Hazen
committed
Move node-related functions from rt module to rt_node.

bowrocker
authored and
Brett Hazen
committed
Move rt:brutal_kill to rt_node.

bowrocker
authored and
Brett Hazen
committed
Move ring-related rt functions to rt_ring; some cleanup.

bowrocker
authored and
Brett Hazen
committed
Move command-line oriented rt functions to rt_cmd_line.

bowrocker
authored and
Brett Hazen
committed
Move bucket types related functions from rt module to rt_bucket_types.

bowrocker
authored and
Brett Hazen
committed
Move AAE related functions from rt module to rt_aae.

bowrocker
authored and
Brett Hazen
committed
More functions moved to rt_node.

bowrocker
authored and
Brett Hazen
committed
Move rt:is_pingable to rt_node.

bowrocker
authored and
Brett Hazen
committed
Move systest read/write functions from rt module to rt_systest.

bowrocker
authored and
Brett Hazen
committed
Fix calls to rt:teardown; should be rt_cluster:teardown.

bowrocker
authored and
Brett Hazen
committed
Move all access to rt_properties record into an rt_properties module

kellymclaughlin
authored and
Brett Hazen
committed
Take first pass at harness refactoring.

bowrocker
authored and
Brett Hazen
committed
Convert rt_cs_dev harness to test_harness behaviour.

bowrocker
authored and
Brett Hazen
committed
Fix typo in rt_cs_dev: 'behavious' -> 'behaviour'.

bowrocker
authored and
Brett Hazen
committed
Fix whitespace in rt_cs_dev.

bowrocker
authored and
Brett Hazen
committed
Refactor and reorganize riak_test_escript module

kellymclaughlin
authored and
Brett Hazen
committed
Fix issue with lager startup

kellymclaughlin
authored and
Brett Hazen
committed
Fix whitespace problems; add some edoc to harness modules.

bowrocker
authored and
Brett Hazen
committed
Move default cluster config to rt_properties.

bowrocker
authored and
Brett Hazen
committed
Fix code reference for edoc in rt_harness.

bowrocker
authored and
Brett Hazen
committed
Add support for test group annotations to riak_tests.

bowrocker
authored and
Brett Hazen
committed
Add support for multiple test_type attributes by changing format to take lists.

bowrocker
authored and
Brett Hazen
committed
Address review feedback.

bowrocker
authored and
Brett Hazen
committed
Major overhaul of the internal workings of riak_test

kellymclaughlin
authored and
Brett Hazen
committed
Port Jon Anderson's work on test groups to avoid merge pain

kellymclaughlin
authored and
Brett Hazen
committed
Convert riak_cli dependency to clique dependency

kellymclaughlin
authored and
Brett Hazen
committed
Expand support for replication test conversion

kellymclaughlin
authored and
Brett Hazen
committed
Use metadata property and change confirm arity to 1

kellymclaughlin
authored and
Brett Hazen
committed
Convert a few tests to new API and fix a some framework bugs

kellymclaughlin
authored and
Brett Hazen
committed
Fix several framework bugs found while testing

kellymclaughlin
authored and
Brett Hazen
committed
Add an external_properties field to rt_properties record

kellymclaughlin
authored and
Brett Hazen
committed
WIP: Support execution of old and new style tests

John Burwell
authored and
Brett Hazen
committed
Update build scripts and README to better reflect mixed mode
Brett Hazen
committed
Move configuration functions to rt_config.

bowrocker
authored and
Brett Hazen
committed
Migrate several more functions into rt_cluster from rt.

bowrocker
authored and
Brett Hazen
committed
WIP: Support execution of old and new style tests

John Burwell
authored and
Brett Hazen
committed
Initial run of an old style test

John Burwell
authored and
Brett Hazen
committed
Reduced repetition in tests/overload predicates

bearcage
authored and
Brett Hazen
committed
Move configuration functions to rt_config.

bowrocker
authored and
Brett Hazen
committed
Migrate several more functions into rt_cluster from rt.

bowrocker
authored and
Brett Hazen
committed
WIP: Support execution of old and new style tests

John Burwell
authored and
Brett Hazen
committed
Reduced repetition in tests/overload predicates

bearcage
authored and
Brett Hazen
committed
- Fix mistakes in the rebase with origin/master

John Burwell
authored and
Brett Hazen
committed
Additional rebase cleanup

John Burwell
authored and
Brett Hazen
committed
- Fixes a rebase error in repl_bucket_types

John Burwell
authored and
Brett Hazen
committed
Modifies node_manager to deploy zero nodes for old style tests an

John Burwell
authored and
Brett Hazen
committed
Ports more rt functions and fixes the verify_build_cluster test case

John Burwell
authored and
Brett Hazen
committed
Redirects function calls in the rt module to use their analogs in the

John Burwell
authored and
Brett Hazen
committed
Wraps the rt:set_conf, rt:set_advanced_conf, and rt:update_app_config

John Burwell
authored and
Brett Hazen
committed
Refinements to the wrapper to pass the verify_down test case

John Burwell
authored and
Brett Hazen
committed
Update rtdev:deploy_nodes/1

vagrant
authored and
Brett Hazen
committed
Adjust VersionMap to key off dev[0-9] and path names appropriately
Brett Hazen
committed
Adds additional debug logging to rtdev and pulls the master version of a

John Burwell
authored and
Brett Hazen
committed
Update to support verify_membackend
Brett Hazen
committed
Adds support for admin/3 to the rt_cmd_line, rt_harness, and rtdev

John Burwell
authored and
Brett Hazen
committed
verify_staged_clustering passes using the r_t v1 API Wrapper

John Burwell
authored and
Brett Hazen
committed
Adds debug logging to rt:allocate_nodes to introspect the calculation of

John Burwell
authored and
Brett Hazen
committed
Modified rt_harness_util to use the rt2 rather than the rt module

John Burwell
authored and
Brett Hazen
committed
Modifies rtdev-all to use make deps for non-tagged builds

John Burwell
authored and
Brett Hazen
committed
The verify_staged_clustering test case passes using the r_t v1 API

John Burwell
authored and
Brett Hazen
committed
verify_riak_stats passes using the r_t v1 API wrapper

John Burwell
authored and
Brett Hazen
committed
Rename rt_max_wait_time to rt_max_receive_wait_time and document config settings
Brett Hazen
committed
- Removes riak from the repo -- it should be ignored

John Burwell
authored and
Brett Hazen
committed
Refines deprecation logging for the rt_max_wait_time parameter and adds

John Burwell
authored and
Brett Hazen
committed
Add back support for riak_test_runner:metadata/0 for unported tests
Brett Hazen
committed
Fixed typo in rt_max_receive_wait_time
Brett Hazen
committed
Fix result() returned by handle_sync_event to remain in current state instead of moving to state "ok"
Brett Hazen
committed
Add test_summary_format_time for human-readable Duration output
Brett Hazen
committed
Fixed typos in rt_bucket_type function names
Brett Hazen
committed
Update the proper settings of `spam_dir`
Brett Hazen
committed
Implements an option (rt_execution_mode) to specify that r_t should run

John Burwell
authored and
Brett Hazen
committed
Adds the partition_repair test case to the regression test script

John Burwell
authored and
Brett Hazen
committed
Add back missing version of rt:set_conf to run verify_build_cluster
Brett Hazen
committed
Update CS devrel paths
Brett Hazen
committed
Support riak_control_authentication
Brett Hazen
committed
Re-implements prompting to leave nodes running on failure and verify_jmx

John Burwell
authored and
Brett Hazen
committed
- Modifies rtdev-install to create directories in the form of

John Burwell
authored and
Brett Hazen
committed
verify_aae test cases using the v1 API wrapper. Adds the test case to

John Burwell
authored and
Brett Hazen
committed
ensemble_bysantine, ensemble_interleave, verify_claimant, and

John Burwell
authored and
Brett Hazen
committed
Test case gh_riak_core_155 passes using the v1 wrapper

John Burwell
authored and
Brett Hazen
committed
Update pb_security to use code:get_object_code/1 to work with new framework
Brett Hazen
committed
Add debugging statements to test results to help debug in case of framework failure
Brett Hazen
committed
Update versioning
Brett Hazen
committed
Update version configuration and add version validation
Brett Hazen
committed
Add in verify_search test to regression suite
Brett Hazen
committed
verify_2i_aae passes the regression test suite. verify_membackend no

John Burwell
authored and
Brett Hazen
committed
Fixes the creation of the current results symlink and various syntax

John Burwell
authored and
Brett Hazen
committed
WIP: Initial draft of a Riak cluster FSM and associated API to replace

John Burwell
authored and
Brett Hazen
committed
verify_handoff now passes using the v1 API wrapper

John Burwell
authored and
Brett Hazen
committed
Fix overload test for rebase
Brett Hazen
committed
Add verify_capabilities to regression suite
Brett Hazen
committed
Add support for loaded_upgrade test
Brett Hazen
committed
replication2, overload, and repl_fs_stat_caching pass using the v1 API

John Burwell
authored and
Brett Hazen
committed
- v2 API Definition: Initial work on the node API

John Burwell
authored and
Brett Hazen
committed
- The repl_fs_stat_caching and replication2 test cases work with the v1

John Burwell
authored and
Brett Hazen
committed
Fixes continue on fail feature to ensure that test runs actually stop

John Burwell
authored and
Brett Hazen
committed
Fixes a syntax error in the regression test script that causes riak_test

John Burwell
authored and
Brett Hazen
committed
Add support for verify_handoff_mixed
Brett Hazen
committed
Add verify_bitcask_tombstone2_upgrade to regression test suite
Brett Hazen
committed
Add replication_object_reformat to regression test list
Brett Hazen
committed
Wraps rt:pbc/1 to call rt_pb:pbc/1 and fixes riak_test_escript to only

John Burwell
authored and
Brett Hazen
committed
Wraps rt:pbc/2 to call rt_pb:pbc/2 and adds implementation of

John Burwell
authored and
Brett Hazen
committed
Fixes the implementation of rt_pb:pbc/2 to properly match the results of

John Burwell
authored and
Brett Hazen
committed
WIP: Additional refinements to the v2 API specification

John Burwell
authored and
Brett Hazen
committed
Modifies rt_config:get/1 to default the continue_on_fail flag when no

John Burwell
authored and
Brett Hazen
committed
Roll back regression test to work with new testing infrastructure
Brett Hazen
committed
verifymembackend passes the using v1 wrapper

John Burwell
authored and
Brett Hazen
committed
Revert verify_membackend back to master version
Brett Hazen
committed
Finally get replication2_pg passing in the regression suite
Brett Hazen
committed
Continued work on implementing the new r_t v2 API

John Burwell
authored and
Brett Hazen
committed
Initial introduction of rt_test_plan record to wrap tests
Brett Hazen
committed
Get GiddyUp product and version from the default version instead of config
Brett Hazen
committed
Finally get GiddyUp working
Brett Hazen
committed
Re-sync all tests from master
Brett Hazen
committed
Get GiddyUp consuming riak_test.log
Brett Hazen
committed
Convert giddyup module into a gen_server
Brett Hazen
committed
Fix creation of test plans from GiddyUp
Brett Hazen
committed
Report full test names when showing which tests to run or not run
Brett Hazen
committed
Sync up botched rebase of rt.erl
Brett Hazen
committed
Use the full name of a test case (including backend) when reporting
Brett Hazen
committed

Commits on Apr 23, 2015

Update riak_test.config
Brett Hazen
committed
Add better debugging messages when no tests are specified and when giddyup_host is not set in config file
Brett Hazen
committed

Commits on Apr 24, 2015

Update riak_test.config
Brett Hazen
committed

Commits on Apr 27, 2015

Change how results table is written to lager file
Brett Hazen
committed

Commits on Apr 28, 2015

Fix unit tests for rt_config
Brett Hazen
committed

Commits on Apr 30, 2015

Register Erlang setup before determining which tests to run so YZ tests
Brett Hazen
committed
Addresses BTA-207 to fix cuttlefish_configuration test and
Brett Hazen
committed

Commits on May 5, 2015

Close files after making local copies for GiddyUp
Brett Hazen
committed

Commits on May 6, 2015

Fix clique table for atoms as failure reasons
Brett Hazen
committed

Commits on May 7, 2015

Add unit tests for results table
Brett Hazen
committed

Commits on May 8, 2015

Resync tests from master
Brett Hazen
committed

Commits on May 12, 2015

Put lib directory back in git because intercepts are stored there
Brett Hazen
committed

Commits on May 13, 2015

Fix specification of backends
Brett Hazen
committed

Commits on May 14, 2015

Handle the case where versions are single atoms, not version/config
Brett Hazen
committed

Commits on May 19, 2015

Introduces the rt_riak_cluster and rt_riak_node FSMs to orchestrate Riak
John Burwell
committed

Commits on May 20, 2015

Add back in support for version upgrade path for BTA-204
Brett Hazen
committed
Update README.md
Brett Hazen
committed
Update README.md
Brett Hazen
committed

Commits on May 26, 2015

Fix kv679_dataloss for new mixed framework
Brett Hazen
committed
Fix deploy_nodes/1 versions for riak667_safe
Brett Hazen
committed

Commits on Jun 5, 2015

- WIP: Breaking change that is untested for node defintions to support
John Burwell
committed