Not all files copy

[nathanlawson16394]

I've got everything working and the backup copies off to my S3 bucket, however after the checking the bucket, the db dump doesn't appear to be there, just the copy of the application files.

Have I missed a config step to ensure the dump is also copied?

[PaolaRuby]

Yes, you probably missed a config

[nathanlawson16394]

This is my current config, it's pretty much the OOB one so I'm not sure where it could be wrong?
`<?php

return [

'backup' => [

    /*
     * The name of this application. You can use this name to monitor
     * the backups.
     */
    'name' => env('APP_NAME', 'laravel-backup'),

    'source' => [

        'files' => [

            /*
             * The list of directories and files that will be included in the backup.
             */
            'include' => [
                base_path(),
            ],

            /*
             * These directories and files will be excluded from the backup.
             *
             * Directories used by the backup process will automatically be excluded.
             */
            'exclude' => [
                base_path('vendor'),
                base_path('node_modules'),
            ],

            /*
             * Determines if symlinks should be followed.
             */
            'follow_links' => false,

            /*
             * Determines if it should avoid unreadable folders.
             */
            'ignore_unreadable_directories' => false,

            /*
             * This path is used to make directories in resulting zip-file relative
             * Set to `null` to include complete absolute path
             * Example: base_path()
             */
            'relative_path' => null,
        ],

        /*
         * The names of the connections to the databases that should be backed up
         * MySQL, PostgreSQL, SQLite and Mongo databases are supported.
         *
         * The content of the database dump may be customized for each connection
         * by adding a 'dump' key to the connection settings in config/database.php.
         * E.g.
         * 'mysql' => [
         *       ...
         *      'dump' => [
         *           'excludeTables' => [
         *                'table_to_exclude_from_backup',
         *                'another_table_to_exclude'
         *            ]
         *       ],
         * ],
         *
         * If you are using only InnoDB tables on a MySQL server, you can
         * also supply the useSingleTransaction option to avoid table locking.
         *
         * E.g.
         * 'mysql' => [
         *       ...
         *      'dump' => [
         *           'useSingleTransaction' => true,
         *       ],
         * ],
         *
         * For a complete list of available customization options, see https://github.com/spatie/db-dumper
         */
        'databases' => [
            'mysql',
        ],
    ],

    /*
     * The database dump can be compressed to decrease diskspace usage.
     *
     * Out of the box Laravel-backup supplies
     * Spatie\DbDumper\Compressors\GzipCompressor::class.
     *
     * You can also create custom compressor. More info on that here:
     * https://github.com/spatie/db-dumper#using-compression
     *
     * If you do not want any compressor at all, set it to null.
     */
    'database_dump_compressor' => null,

    /*
     * The file extension used for the database dump files.
     *
     * If not specified, the file extension will be .archive for MongoDB and .sql for all other databases
     * The file extension should be specified without a leading .
     */
    'database_dump_file_extension' => 'sql',

    'destination' => [

        /*
         * The filename prefix used for the backup zip file.
         */
        'filename_prefix' => '',

        /*
         * The disk names on which the backups will be stored.
         */
        'disks' => [
            'remotebackup',
        ],
    ],

    /*
     * The directory where the temporary files will be stored.
     */
    'temporary_directory' => storage_path('app/backup-temp'),

    /*
     * The password to be used for archive encryption.
     * Set to `null` to disable encryption.
     */
    'password' => null,

    /*
     * The encryption algorithm to be used for archive encryption.
     * You can set it to `null` or `false` to disable encryption.
     *
     * When set to 'default', we'll use ZipArchive::EM_AES_256 if it is
     * available on your system.
     */
    'encryption' => 'default',
],

/*
 * You can get notified when specific events occur. Out of the box you can use 'mail' and 'slack'.
 * For Slack you need to install laravel/slack-notification-channel.
 *
 * You can also use your own notification classes, just make sure the class is named after one of
 * the `Spatie\Backup\Events` classes.
 */
'notifications' => [

    'notifications' => [
        \Spatie\Backup\Notifications\Notifications\BackupHasFailed::class => ['mail'],
        \Spatie\Backup\Notifications\Notifications\UnhealthyBackupWasFound::class => ['mail'],
        \Spatie\Backup\Notifications\Notifications\CleanupHasFailed::class => ['mail'],
        \Spatie\Backup\Notifications\Notifications\BackupWasSuccessful::class => ['mail'],
        \Spatie\Backup\Notifications\Notifications\HealthyBackupWasFound::class => ['mail'],
        \Spatie\Backup\Notifications\Notifications\CleanupWasSuccessful::class => ['mail'],
    ],

    /*
     * Here you can specify the notifiable to which the notifications should be sent. The default
     * notifiable will use the variables specified in this config file.
     */
    'notifiable' => \Spatie\Backup\Notifications\Notifiable::class,

    'mail' => [
        'to' => 'REMOVED',

        'from' => [
            'address' => env('MAIL_FROM_ADDRESS', 'REMOVED'),
            'name' => env('MAIL_FROM_NAME', 'REMOVED'),
        ],
    ],

    'slack' => [
        'webhook_url' => '',

        /*
         * If this is set to null the default channel of the webhook will be used.
         */
        'channel' => null,

        'username' => null,

        'icon' => null,

    ],
],

/*
 * Here you can specify which backups should be monitored.
 * If a backup does not meet the specified requirements the
 * UnHealthyBackupWasFound event will be fired.
 */
'monitor_backups' => [
    [
        'name' => env('APP_NAME', 'laravel-backup'),
        'disks' => ['remotebackup'],
        'health_checks' => [
            \Spatie\Backup\Tasks\Monitor\HealthChecks\MaximumAgeInDays::class => 1,
            \Spatie\Backup\Tasks\Monitor\HealthChecks\MaximumStorageInMegabytes::class => 5000,
        ],
    ],

    /*
    [
        'name' => 'name of the second app',
        'disks' => ['local', 's3'],
        'health_checks' => [
            \Spatie\Backup\Tasks\Monitor\HealthChecks\MaximumAgeInDays::class => 1,
            \Spatie\Backup\Tasks\Monitor\HealthChecks\MaximumStorageInMegabytes::class => 5000,
        ],
    ],
    */
],

'cleanup' => [
    /*
     * The strategy that will be used to cleanup old backups. The default strategy
     * will keep all backups for a certain amount of days. After that period only
     * a daily backup will be kept. After that period only weekly backups will
     * be kept and so on.
     *
     * No matter how you configure it the default strategy will never
     * delete the newest backup.
     */
    'strategy' => \Spatie\Backup\Tasks\Cleanup\Strategies\DefaultStrategy::class,

    'default_strategy' => [

        /*
         * The number of days for which backups must be kept.
         */
        'keep_all_backups_for_days' => 7,

        /*
         * The number of days for which daily backups must be kept.
         */
        'keep_daily_backups_for_days' => 16,

        /*
         * The number of weeks for which one weekly backup must be kept.
         */
        'keep_weekly_backups_for_weeks' => 8,

        /*
         * The number of months for which one monthly backup must be kept.
         */
        'keep_monthly_backups_for_months' => 4,

        /*
         * The number of years for which one yearly backup must be kept.
         */
        'keep_yearly_backups_for_years' => 2,

        /*
         * After cleaning up the backups remove the oldest backup until
         * this amount of megabytes has been reached.
         */
        'delete_oldest_backups_when_using_more_megabytes_than' => 10000,
    ],
],

];
`

[erikn69]

Laravel version? operating system? package version?
you did not get any error in the log or on the console?

On database.connections.mysql you can add custom properties, example

    'dump' => [
            'dump_binary_path' => '/MariaDB 10.5/bin/', // only the path, so without `mysqldump` or `pg_dump`
            'use_single_transaction',
            'timeout' => 60 * 5, // 5 minute timeout
        ]

For a complete list of available customization options, see https://github.com/spatie/db-dumper

[nathanlawson16394]

@erikn69
Laravel 8.54.0
Package 6.16.2
Running on Ubuntu Server 20.04LTS

I've set the Use single transaction and the timeout in the config file, and can see the dump happen in the temp directory while the job is running, it just doesn't get copied to the final destination.

Thanks,
Nathan

[erikn69]

Try with --only-db,
Maybe files are there, on another directory

[nathanlawson16394]

@erikn69
Well, now I feel really stupid, I thought it put the DB dump at the top level, it turns out I just needed to dig into the storage folder in the ZIP file... D'oh!

Thank you so much for your time, it is much appreciated!

[erikn69]

Ok, i'm fixing that, on the next release, db-dump directory is gonna be at the top level