Addon Uploader

[garrynewman]

I just committed the new addon uploader/downloader. This allows you to upload your addon (maps only right now) via the editor instead of the website.. which means bigger uploads are supported.

The backend and the way we upload, store and download has changed.

What's the different?

Previously you'd upload a zip file and it'd be stored as a zip file. Clients would download the zip file, extract it and mount the folder.

In the new system each file is uploaded and stored individually. When uploading you send a manifest of files you have along with their sizes and crcs. The backend checks whether it's got them, and sends a list of files it needs. Once those are all uploaded a new version is made and a manifest is produced.

When a client wants to play your map it grabs the manifest, scans for files it already downloaded and downloads missing files.

What's the benefit?

• You only download files you don't have or have changed.
• Downloads are versioned - so we can potentially allow rollbacks or end user version choices
• If we change a "core" file and your map was referencing an older version - it'll download and still use that older version (should fix maps with missing materials/models)

Will the old system stay?

No. Website uploads will be disabled.

What's next?

Gamemode uploads are next on my list.

Thanks this is way better

Let me know if you have any issues with the new system in this thread

[DoctorGurke]

Is there anything special needed for the map addon setup?

[DoctorGurke]

[DoctorGurke]

a different map with the same circumstances seems to work fine

[garrynewman]

Can you drop me the .addon for the original that was giving invalid addon?

[DoctorGurke]

I made this map addon yesterday using the editor stuff, so I never touched it manually.

{
  "SharedAssets": "*.*",
  "Title": "Bank",
  "Type": "map",
  "Org": "eagleone",
  "Ident": "sd_bank",
  "Schema": 1,
  "HasAssets": true,
  "AssetsPath": "",
  "HasCode": true,
  "CodePath": "/code/",
  "RootNamespace": "Sandbox"
}

[DoctorGurke]

it seems to work now after uploading the first map? I didn't change anything about the addon config

[DoctorGurke]

enabling an addon with a lot of assets seems to just hang the editor for a while until it's donw now. Previously it showed the progress in the console and still allowed ui interaction to a degree.

[DoctorGurke]

I'm not sure if this broke with this update but it seems somewhat related. Map list doesn't seem to properly show maps and the local maps tab doesn't show map-addon maps at all

2022-01-26.17-56-59.mp4

[DoctorGurke]

the map uploading window grabs all focus, so it basically cripples the rest of the editor while it's uploading lol

2022-01-26.18-04-28.mp4

[garrynewman]

Yeah it's a modal window, it felt like the safest thing to do to stop people editing assets as they're uploading, after they've been crc'd

[DoctorGurke]

Fair enough I suppose

[DoctorGurke]

Map addons pop up as gamemodes in the games tab

[garrynewman]

I didn't consider the map listings, I'll fix that first time tomorrow

[DoctorGurke]

While I get the reason for the uploader window to block usage to the rest of the editor, it'd be nice to at least gain control of the window head elements. IE minimize, maximize etc

[DoctorGurke]

If I enable an addon with assets and try to upload a map that uses them, it won't find/include those assets until I restart the game

[Oppossome]

It would be incredibly useful for mappers if during map upload assets that are referenced by the map, that aren't in the addon's folder, are automatically packaged with the map. It would prevent the need for them to pack their personal asset repos into all of their maps.

It's somewhat possible already if they upload their personal asset pack as a separate addon to the backend. But it would be nice if it were done automatically.

[KayaDLX]

I'm confused, isn't it already doing that?
I have two separate addons, one where all my assets are and one where my maps are. The addon uploader still looks into the assets addon and pack all referenced assets by the map into that map upload. I don't need to upload the asset addon for my maps to work, only the map addon.

[Oppossome]

Do you have the asset addon uploaded as it's own addon, in my testing yesterday it seemed that it wasn't uploading the asset along with the map, just the manifest. Could be wrong though.

[DoctorGurke]

Works fine as long as your content is in a local addon

[DoctorGurke]

No need to have the assets uploaded as a separate addon