Skip to content

When piping stdout, output can be interlaced with status messages on stderrΒ #46

@hyfen

Description

@hyfen

When running something like `$ chronicle-etl -e shell | grep "foo", we often get this sort of race condition:

result 
result
Completed job in 2.207684 secs
  Status:	Success
  Completed:	113
result
result

Options to fix this:

  • detect when stdout is piped (and actually being used!) and don't print a final status message
  • print status message before running loader.finish (but this might print "success" even if the loader then goes on to fail)
  • adding a sleep N before the status message (hacky)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions