Laravel Horizon high CPU & commands

[sts-ryan-holton]

I'm using the latest Horizon v5 on Laravel v10. I have a large application running through a single Redis instance. My application anticipates to process 50 million jobs per day, or this, in production I need several queues, and around 500 max processes.

However, when running Horizon locally with the following I'm seeing almost 100% CPU usage, and hundreds of thousands of commands and needing to understand what I can do to significantly reduce this whilst still being able to process a lot of jobs quickly

'defaults' => [

    /**
     * Fast jobs
     *
     * Jobs on this queue are optimised to run as quickly as possible.
     */
    'supervisor-fast-jobs' => [
        'connection' => 'redis-short-running',
        'queue' => ['on-demand-runs-now', 'redirects', 'statistics',  'listeners', 'observers', 'notifications', 'redis-short-running'],
        'balance' => 'auto',
        'autoScalingStrategy' => 'time',
        'maxProcesses' => 1,
        'maxTime' => 60,
        'maxJobs' => 1000,
        'memory' => 128,
        'tries' => 1,
        'timeout' => 40,
        'nice' => 0,
        'sleep' => 0
    ],

    /**
     * Slow jobs
     *
     * Jobs on this queue are allowed to run for a longer period of time.
     */
    'supervisor-slow-jobs' => [
        'connection' => 'redis-long-running',
        'queue' => ['on-demand-runs-now', 'applications', 'pingtrees', 'automations', 'archive',  'csv-exports', 'redis-long-running'],
        'balance' => 'auto',
        'autoScalingStrategy' => 'time',
        'maxProcesses' => 1,
        'maxTime' => 60,
        'maxJobs' => 1000,
        'memory' => 128,
        'tries' => 1,
        'timeout' => 600,
        'nice' => 0,
        'sleep' => 0
    ],
],

'local' => [
    'supervisor-fast-jobs' => [
        'minProcesses' => 1,
        'maxProcesses' => 20,
        'balanceMaxShift' => 1,
        'balanceCooldown' => 3,
    ],
    'supervisor-slow-jobs' => [
        'minProcesses' => 1,
        'maxProcesses' => 20,
        'balanceMaxShift' => 5,
        'balanceCooldown' => 3,
    ],
],

[deefour]

@sts-ryan-holton just sharing: we don't use Horizon, and don't do anywhere near the job volume you are, but we've seen a significant increase in Redis CPU usage since moving to Laravel 10. We're just beginning to investigate.