Laravel Excel Queue Allowed memory size

[SWAT10101]

I'm trying to export xlsx file that includes around 100,000 rows for 12 months each sheet take one month in laravel 8 using Maatwebsite Excel This process takes around 15~30 mint, So I use a queue in laravel excel in order to keep the job run in the background and notify the user when it finishes. During the process php artisan queue:work --memory=10240 it stops and it shows this error in terminal

If I run php artisan queue:work the process will stop and the job still in jobs table when I run it again it fail and it shows in failed_jobs table with this error

Illuminate\Queue\MaxAttemptsExceededException: Maatwebsite\Excel\Jobs\AppendQueryToSheet has been attempted too many times or run too long. The job may have previously timed out.

What I try to dose and not work with me

1- changing memory_limit post_max_size upload_max_filesize in php.ini I use WAMP SERVER

2- changing the memory_limit => 6000000 and chunk_size => 1100 in config/excel.php.

Also, I notice all exported files stop at size 555KB

The code to export use queue

class MarkupAccountsYears

<?php

  namespace App\Exports;

  use App\Models\markupPreCalculate;
  use Maatwebsite\Excel\Concerns\FromQuery;
  use Maatwebsite\Excel\Concerns\WithTitle;

  class MarkupAccountsYears implements FromQuery, WithTitle
  {
    

    
    private $month;
    private $year;

    public function __construct(int $year, int $month)
    {
        $this->month = $month;
        $this->year  = $year;
    }


    public function query()
    {   >orderBy('TimeMsc');
       $finalItem = ['real'];
       return markupPreCalculate::query()->select('TimeMsc', '****', 'Login', 'Full_Name', 
        'Group', '****', '****', '****', '****', '****', '****')
         ->whereYear('TimeMsc', $this->year)
         ->whereMonth('TimeMsc', $this->month)
         ->orderBy('TimeMsc')
         ->where(function ($query) use ($finalItem) {
                foreach($finalItem as $keyword){
                  

                          if(is_numeric($keyword))
                          {
                            $query->orwhere('Login', '=',  $keyword);
                          }else
                          {
                            $query->orwhere('Group', 'like',  '%' . $keyword . '%');
                          }
                }
               
            });
    }

      /**
     * @return string
     */
    public function title(): string
    {
        return 'Month ' . $this->month;
    }
}

Class MarkupAccount

<?php

namespace App\Exports;

use Illuminate\Contracts\Queue\ShouldQueue;
use Maatwebsite\Excel\Concerns\WithMultipleSheets;
use Maatwebsite\Excel\Concerns\Exportable;

class MarkupAccount implements WithMultipleSheets, ShouldQueue
{
    
    use Exportable;
 
    protected $year;
    
    public function __construct(int $year)
    {
        $this->year = $year;
    }

    /**
     * @return array
     */
    public function sheets(): array
    {
      
        $sheets = [];

       for ($month = 1; $month <= 1; $month++) {
            $sheets[] = new MarkupAccountsYears($this->year, $month);
        }
        
        return $sheets;
    }
}

Class MarkupAccount

<?php

namespace App\Exports;

use Illuminate\Contracts\Queue\ShouldQueue;
use Maatwebsite\Excel\Concerns\WithMultipleSheets;
use Maatwebsite\Excel\Concerns\Exportable;


class MarkupAccount implements WithMultipleSheets, ShouldQueue
{
    
    use Exportable;
 
    protected $year;
    
    public function __construct(int $year)
    {
        $this->year = $year;
    }

    /**
     * @return array
     */
    public function sheets(): array
    {
      
        $sheets = [];

       for ($month = 1; $month <= 1; $month++) {
            $sheets[] = new MarkupAccountsYears($this->year, $month);
        }
        
        return $sheets;
    }
}

Controller

public function downloadExcl(){  
  (new MarkupAccount(2021))->queue('test'.time().'.xlsx')->chain([dump("Done")]);
}

Is there any way to solve this issue or I'm doing something wrong?

[patrickbrouwers]

Would recommend not using the built-in queue feature, as it has to reopen the file every chunk causing much more memory than needed. Try creating your own queue job and put the export in there, extending the default timeout and memory usage in that job.

[SWAT10101]

I job itself I set timeout public $timeout = 3600; my main issue is memory size I change the memory size in server and Laravel-Excel configuration.
about ShouldQueue if I remove it from the ExportJob class the queue will not work at all

[patrickbrouwers]

You only need it on the export job

[SWAT10101]

This is what I did, the ShouldQueue only in ExportJob class.
but still, have memory size, how can I increase memory size

[patrickbrouwers]

You should check the Laravel docs for that. However I want to again remind you to really check the memory usage of your query and data. You might be able to get it down.

[SWAT10101]

I'll check, for query I use FormQuery build-in in Laravel excel it use chunk 11000 it optimize the query

[SWAT10101]

I fix the problem by increasing the memory_limit in php.ini in php folder, I was editing the php.ini in the apache folder

%wamp%\bin\php\phpx.x.x\php.ini not under %wamp%\bin\apache\apachex.x.x\php.ini