Adds crawler directives to result and record pages#206

JPrevost merged 1 commit intomainMITLibraries/timdex-ui:mainfrom

timx-476-noindex-nofollowMITLibraries/timdex-ui:timx-476-noindex-nofollowCopy head branch name to clipboard