Robot.txt

I talked about this a few months ago, but I dont' think it ever made it into an issue. Can we populate the robot.txt for the portal with stuff that actually makes us appear in searches? Preferably ASAP. As a first pass all the full dcc names and current tissue CV terms would be a good start