Error has been attempted too many times or run too long. The job may have previously timed out.

[BehroozBvk]

Hi
I have an 1800 record Excel file that I get when I import through the queue:
error:

Illuminate\Queue\MaxAttemptsExceededException: Maatwebsite\Excel\Jobs\ReadChunk has been attempted too many times or run too long. The job may have previously timed out. in /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Worker.php:750
Stack trace:
#0 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Worker.php(504): Illuminate\Queue\Worker->maxAttemptsExceededException()
#1 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Worker.php(418): Illuminate\Queue\Worker->markJobAsFailedIfAlreadyExceedsMaxAttempts()
#2 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Worker.php(378): Illuminate\Queue\Worker->process()
#3 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Worker.php(172): Illuminate\Queue\Worker->runJob()
#4 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Console/WorkCommand.php(117): Illuminate\Queue\Worker->daemon()
#5 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Queue/Console/WorkCommand.php(101): Illuminate\Queue\Console\WorkCommand->runWorker()
#6 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php(36): Illuminate\Queue\Console\WorkCommand->handle()
#7 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Container/Util.php(40): Illuminate\Container\BoundMethod::Illuminate\Container\{closure}()
#8 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php(93): Illuminate\Container\Util::unwrapIfClosure()
#9 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php(37): Illuminate\Container\BoundMethod::callBoundMethod()
#10 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Container/Container.php(653): Illuminate\Container\BoundMethod::call()
#11 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Console/Command.php(136): Illuminate\Container\Container->call()
#12 /var/www/html/project/vendor/symfony/console/Command/Command.php(299): Illuminate\Console\Command->execute()
#13 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Console/Command.php(121): Symfony\Component\Console\Command\Command->run()
#14 /var/www/html/project/vendor/symfony/console/Application.php(978): Illuminate\Console\Command->run()
#15 /var/www/html/project/vendor/symfony/console/Application.php(295): Symfony\Component\Console\Application->doRunCommand()
#16 /var/www/html/project/vendor/symfony/console/Application.php(167): Symfony\Component\Console\Application->doRun()
#17 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Console/Application.php(94): Symfony\Component\Console\Application->run()
#18 /var/www/html/project/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php(129): Illuminate\Console\Application->run()
#19 /var/www/html/project/artisan(37): Illuminate\Foundation\Console\Kernel->handle()
#20 {main}

ImportUser.php

class UsersImport implements ToCollection
    , SkipsOnFailure
    , SkipsOnError
    , SkipsEmptyRows
    , WithValidation
    , WithHeadingRow
    , WithStartRow
    , WithChunkReading
    , WithBatchInserts
    , ShouldQueue
    , WithEvents
{
    use Importable, SkipsErrors, SkipsFailures, RegistersEventListeners;

    protected $historyId;
    protected $organizationId;
    protected $groupsIds;

    /**
     * UsersImport constructor.
     * @param $historyId
     * @param $organizationId
     * @param $groupsIds
     */
    public function __construct($historyId, $organizationId, $groupsIds)
    {
        $this->historyId = $historyId;
        $this->organizationId = $organizationId;
        $this->groupsIds = $groupsIds;
    }


    public static function afterSheet(AfterSheet $event)
    {
        CustomLog::log('ImportExcel', $event->getConcernable()->failures()->toArray());
        if ($event->getConcernable()->failures()->count()) {
            $organization = $event->getConcernable()->organizationId;
            $path = "excels/userFailures/{$organization}/import_failures_" . now()->format('Y-m-d-H:i:s') . '.xlsx';
            CustomLog::log('ImportExcel', $path);
            (new UsersFailuresImportedExport($event->getConcernable()->historyId, $event->getConcernable()->failures()))->store($path);
            HistoryImport::where('id', $event->getConcernable()->historyId)->update(['status' => 'failed', 'file_path' => $path]);
        } else {
            HistoryImport::where('id', $event->getConcernable()->historyId)->update(['status' => 'done']);
        }
    }

    /**
     * @param Collection $rows
     * @throws ValidationException
     */
    public function collection(Collection $rows)
    {
        $rows = $this->validate($rows);
        if ($this->failures()->isEmpty()) {
            foreach ($rows as $row) {
                $user = User::query()->create([
                    'first_name' => $row['first_name'],
                    'last_name' => $row['last_name'],
                    'username' => $row['username'],
                    'password' => Hash::make($row['password']),
                    'mobile' => $row['mobile'],
                    'email' => $row['email'],
                ]);
                if ($user) {
                    event(new Registered($user, $this->organizationId, $this->groupsIds));
                }
            }
        }
    }

    /**
     * skip heading row and start next row.
     * @return int
     */
    public function startRow(): int
    {
        return 2;
    }

    /**
     * @return string[][]
     */
    public function rules(): array
    {
        return [
            '*.first_name' => ['required'],
            '*.last_name' => ['required'],
            '*.username' => ['required', 'unique:users,username'],
            '*.password' => ['required'],
            '*.mobile' => ['required_if:email,null', 'nullable', 'starts_with:9', 'digits:10', 'unique:users,mobile'],
            '*.email' => ['required_if:mobile,null', 'email', 'nullable', 'unique:users,email'],
        ];
    }


    /**
     * @return int
     */
    public function chunkSize(): int
    {
        return 5000;
    }

    public function batchSize(): int
    {
        return 1000;
    }


    /**
     * Validate given collection data.
     *
     * @param Collection $rows
     *
     * @return Collection
     * @throws ValidationException
     *
     */
    protected function validate(Collection $rows): Collection
    {
        $validator = Validator::make($rows->toArray(), $this->rules());

        if (!$validator->fails()) {
            return $rows;
        }

        $this->onFailure(...$this->collectErrors($validator, $rows));

        $keysCausingFailure = collect($validator->errors()->keys())->map(function ($key) {
            return Str::before($key, '.');
        })->values()->toArray();

        return $rows->except($keysCausingFailure);

        throw new ValidationException($validator);
    }

    /**
     * Get all validation errors.
     *
     * @param $validator
     * @param Collection $rows
     *
     * @return array
     */
    protected function collectErrors($validator, Collection $rows): array
    {
        $failures = [];
        foreach ($validator->errors() as $attribute => $messages) {
            $row = strtok($attribute, '.');
            $attributeName = strtok('');
            $attributeName = $attributes['*.' . $attributeName] ?? $attributeName;

            $failures[] = new Failure(
                $row,
                $attributeName,
                str_replace($attribute, $attributeName, $messages),
                $rows[$row] ?? []
            );
        }
        return $failures;
    }
}

config supervisor:

[program:project]
process_name=%(program_name)s_%(process_num)02d
command=php /var/www/html/project/artisan queue:work --timeout=0 --tries=1
autostart=true
autorestart=true
user=root
numprocs=2
redirect_stderr=true
stdout_logfile=/var/www/html/project/storage/logs/project-queue.log

Please advise how to fix the problem?
Thankful

[patrickbrouwers]

You'll have to optimize your import, try to detect with parts take long or use more memory. A good place to start is to have a look at the loop that creates 1000 users.