save stdout and stderr to job + blob

[Nick-P-Adams]

Is your feature request related to a problem? Please describe.
When using save_logs_to_blob argument on create_job currently it redirects output to the blob when the task has completed. Which does not allow us to view the streamed output under the job in azure batch. Which contains an updating progress bar along with other information that is useful when viewed in real time.

Describe the solution you'd like
Would like to retain the streamed stdout and stderr on azure batch. When the task completes to save the full stdout and stderr to blob.

[ryanraaschCDC]

we might be able to implement the OutputFiles capability for this. We currently append an output operator ( > ) to direct the stdout. Here is some google code that could be a starting place for our solution:

from azure.batch import models

Define where the file should go in Blob Storage

destination = models.OutputFileBlobContainerDestination(
container_url="https://windows.net"
)

Define the file to upload from the node

output_file = models.OutputFile(
file_pattern="*.txt", # Uploads all .txt files created by the task
destination=models.OutputFileDestination(container=destination),
upload_options=models.OutputFileUploadOptions(
upload_condition=models.OutputFileUploadCondition.task_completion
)
)

Add to your task definition

task = models.TaskAddParameter(
id="mytask",
command_line="python myscript.py",
output_files=[output_file]
)