fix direct_returnn_layer_call() for multiple bases#131

vieting wants to merge 2 commits intomainrwth-i6/pytorch-to-returnn:mainfrom

peter_basesrwth-i6/pytorch-to-returnn:peter_basesCopy head branch name to clipboard