Skip to content

Crashes with lots of small file -- too many open files #66

@drmikecrowe

Description

@drmikecrowe

Trying to run a bunch of small tasks in parallel (trying 12x once)

Error:

Line: 193 ash /hFile: /home/wagoodman/go/src/github.com/wagoodman/bashful/screen.go s/leftcenter/the-forward/the-forward-all.html                                                                                  
 fork/exec /bin/stty: too many open files                                                                                                                                          Runtime[00:01:22] ETA[00:-1:-22]
&{0xc4200a0060} Unable to determine screen width.

yml file is built from a list:

config:
    max-parallel-commands: 12
tasks:

  - name: Download 1 of 227
    parallel-tasks:
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]

  - name: Download 2 of 227
    parallel-tasks:
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions