Use multistage built for container

[ZohebShaikh]

1. Use multistage build for smaller image size ( before: 1.9GB Now: 13MB(scratch) Now: 21MB with alpine as final base image)
2. Update cache stages to use mount type = cache
3. Run as nonroot user

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 49.27%. Comparing base (5eda1d2) to head (983d19e).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #102   +/-   ##
=======================================
  Coverage   49.27%   49.27%           
=======================================
  Files          13       13           
  Lines         621      621           
=======================================
  Hits          306      306           
  Misses        315      315           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[tpoliaw]

Looks ok, How does the caching using --mount=type=cache... work with the GHA level caching? Are both still needed?

[tpoliaw]

There was also some discussion about whether having a full OS environment was useful for debugging

[ZohebShaikh]

Should we publish two sets of images

1. 1.9GB as glazed:<version>-debug
2. 13MB as glazed:<version>

This will help to make the production builds to deployed faster without adding much overhead.

For the previous question about cache. They are 2 different cache there

1. GHA cache -> This is for caching the images rather than internal Dockerfile stages
   Docs about cache in the Dockerfile not getting cached here

2. Cache for the internal builds (Dockerfile Cache) -> I had a look at the documentation and this the recommended way to use the cache for compiled languages. you can see the go example here

[ZohebShaikh]

After offline discussion, It was decided that using alpine image (3.7 MB) as the final build is better than scratch as it gives us BusyBox,shell,vi,.. which is useful for debugging.