File not shown in correct directory after creation

[marten-seemann]

Steps to reproduce:
Create file with filename dir/test.md.
File is shown under /, and not under dir/. However, on the filesystem, it's created at the correct location and after reloading the site, everything works as expected.