Invoke AfterStep and BeforeStep even when the step status is skipped (or scenario status failed) when previous step(s) failed.

[divakar89]

For reporting purposes, it is nicer to have all the steps to be able to be added to a report with skipped status when the previous step is failed (which makes the scenario status failed). Currently, this is not supported and thus the report looks like always the failure is with the last step. Rather it would be great if we can force the afterstep/beforestep to be invokable even when the step status is skipped (the status shouldn't be able to be modified).

Certainly other BDD tools allow this as far as I know Cucumber, but reqnroll lacks this.

[divakar89]

duplicate of issue raised #892

[gasparnagy]

As this is a feature request, let's continue the discussion here.

[gasparnagy]

We should clarify this, because my fear is that the "need" (report skipped tests) behind this request and the "request" (invoke before/after step hooks on skipped steps) is too far away from each other.

Side note on the "request" (invoke before/after step hooks on skipped steps): Currently Reqnroll does not provide a way to do this and I don't think it would be generally a good idea to invoke these hooks for the skipped steps.

On the "need": The formatter infrastructure we have does support reporting skipped tests and those steps are included both in the cucumber messages and the HTML report we generate. So could you please clarify the circumstances of your need? What kind of reporting you refer to?

In general, for reporting purposes, it is better to use the Reqnroll event infrastructure (ITestThreadExecutionEventPublisher). It provides a StepSkippedEvent for the skipped tests. Unfortunately I haven't found any good example on how this should be used, but the concept is that you need to create a runtime plugin, handle the CustomizeTestThreadDependencies, and resolve the ITestThreadExecutionEventPublisher to call either the AddListener (to listen to all events) or the AddHandler to listen to a particular event. This is basically what we also do with out formatters, see

Reqnroll/Reqnroll/Formatters/PubSub/CucumberMessagePublisher.cs

Lines 86 to 91 in 6f0e3a0

	runtimePluginEvents.CustomizeTestThreadDependencies += (_, args) =>
	{
	var testThreadExecutionEventPublisher = args.ObjectContainer.Resolve<ITestThreadExecutionEventPublisher>();
	testThreadExecutionEventPublisher.AddListener(this);
	};
	}

.