Cleanup feature file directory before cp (#2726)

Cleanup feature file directory before cp (#2726) #849