♻️ Synced dbin 📦 <-- Update README.md ⌚

Author: Azathothas

README.md

@@ -202,27 +202,37 @@ A schema of the metadata format can be found here [/misc/cmd/dbinRepoIndexGenera
 
 - [PkgForge's repos](https://docs.pkgforge.dev/repositories): External repository with __Portable__ programs that are _truly static, or otherwise self-contained_ using a wrapper format
    - Pkgcache: 203 <!-- PKGCACHE_COUNT -->
+     - Detailed repo info: https://docs.pkgforge.dev/repositories/pkgcache
+     - Package request doc: https://docs.pkgforge.dev/repositories/pkgcache/package-request
    - Bincache: 3921 <!-- BINCACHE_COUNT -->
-   - Note however that pkgforge also has dynamic (unportable) programs/packages (that only run on Debian & derivatives), `dbin` filters these out, leaving behind only the static/portable programs.
+     - Detailed repo info: https://docs.pkgforge.dev/repositories/bincache
+     - Package request doc: https://docs.pkgforge.dev/repositories/bincache/package-request
+   - Note however that pkgforge also has dynamic (unportable) programs/packages (that only run on Debian & derivatives), `dbin` filters these out, leaving behind only the static/portable programs. These are a minority of the  programs included.
 - [AppBundleHub](https://github.com/xplshn/AppBundleHUB): Only self-hosted repository: __Portable__ programs in .AppBundle format
   - 27 <!-- APPBUNDLEHUB_COUNT -->
-- URLs
-  - Lite (default): `https://d.xplshn.com.ar/misc/cmd/1.6/amd64_linux.lite.cbor.zst`: .lite version doesn't have include possible field of `dbin info`, only those which are relevant to the user & are used by `dbin`
-  - Complete: `https://d.xplshn.com.ar/misc/cmd/1.6/amd64_linux.cbor.zst`: opposite of .lite, contains all fields of the DbinItem type defined in the repository generators at [misc/cmd/dbinRepoIndexGenerators/*/generator.go](misc/cmd/dbinRepoIndexGenerators)
-  - Web: `https://d.xplshn.com.ar/misc/cmd/1.6/amd64_linux.web.cbor.zst`: so that websites can list the packages in these repositories, a .web endpoint is also provided for all of them. This version includes the URL to the program's icon file, as well as screenshots, family, etc. This data is not used in `dbin`, but someone may want it, so it was put in a separate file
+
+##### Endpoints
+
+- Lite (recommended): `https://d.xplshn.com.ar/misc/cmd/1.6/amd64_linux.lite.cbor.zst`: .lite version doesn't include all possible fields of `dbin info`, only those which are relevant to the user & are used by `dbin`. Namely: `{Web Manifest, Sha256, Screenshots, IconURL, Provides, AppsStreamID, LongDescription}`
+- NLite (default): `https://d.xplshn.com.ar/misc/cmd/1.6/amd64_linux.nlite.cbor.zst`: .nlite is like .lite, but includes all the fields that upstream forces me to. Namely: "Web Manifest"
+- Complete: `https://d.xplshn.com.ar/misc/cmd/1.6/amd64_linux.cbor.zst`: opposite of .lite, contains all fields of the DbinItem type defined in the repository generators at [misc/cmd/dbinRepoIndexGenerators/*/generator.go](misc/cmd/dbinRepoIndexGenerators)
+
+It makes no difference which endpoint you choose. `.lite` will be the best option for embedded hardware, unmarshalling the Complete endpoint is slow on embedded hardware, from experience, even for the MT7622 router.
+
+NOTE: If you're using an Opteron Venus or similar ancient CPU, it may be better to use the uncompressed .lite endpoint, as the bottleneck is your CPU, not network
 
 ## Optional repos
-- [AM repo](https://github.com/ivan-hc/am): External repository with not-so portable programs that work only on glibc-based distros.
+- [AM repo](https://docs.pkgforge.dev/repositories/external/am): External repository with not-so portable programs that work only on glibc-based distros. The packages come from the [AM](https://github.com/ivan-hc/AM) package manager
   - 2302 <!-- AM_COUNT -->
   - NOTE: Scrapped by pkgforge. Adapted to `dbin` format at `dbin-metadata`
   - URL: `https://d.xplshn.com.ar/misc/cmd/1.6/AM_amd64_linux.lite.cbor.zst`
 
-- [PkgForge Go repo](https://github.com/pkgforge-go): External repository with __Portable__ _truly static_ programs, they are the result of scrapping various sources with Go repositories and compilng them. You can read more about the process at the docs of the upstream project: https://docs.pkgforge.dev/repositories/external/pkgforge-go
+- [PkgForge Go repo](https://docs.pkgforge.dev/repositories/external/go): External repository with __Portable__ _truly static_ programs, they are the result of scrapping various sources with Go repositories and compilng them. You can read more about the process at the docs of the upstream project: https://docs.pkgforge.dev/repositories/external/pkgforge-go
   - The binaries in this repo are Go projects that have been fetched, filtered and built automagically
   - 10531 <!-- GO_COUNT -->
   - URL: `https://d.xplshn.com.ar/misc/cmd/1.6/pkgforge-go_amd64_linux.lite.cbor.zst`
 
-- [PkgForge Cargo repo](https://github.com/pkgforge-cargo): 
+- [PkgForge Cargo repo](https://docs.pkgforge.dev/repositories/external/pkgforge-cargo): 
   - The binaries in this repo are Rust projects that have been fetched, filtered and built automagically
   - 4583 <!-- CARGO_COUNT -->
   - URL: `https://d.xplshn.com.ar/misc/cmd/1.6/pkgforge-cargo_amd64_linux.lite.cbor.zst`

misc/cmd/dbinRepoIndexGenerators/1.4/generator.go

@@ -464,6 +464,18 @@ func saveMetadata(filename string, metadata DbinMetadata) error {
 		}
 	}
 	saveAll(filename+".web", webMetadata)
+	// "nlite" version
+	for _, items := range metadata {
+		for i := range items {
+			items[i].Icon = ""
+			items[i].Provides = ""
+			items[i].Shasum = ""
+			items[i].AppstreamId = ""
+			items[i].LongDescription = ""
+			items[i].Screenshots = []string{}
+		}
+	}
+	saveAll(filename+".nlite", metadata)
 	// "lite" version
 	for _, items := range metadata {
 		for i := range items {

misc/cmd/dbinRepoIndexGenerators/1.5/generator.go

@@ -464,6 +464,18 @@ func saveMetadata(filename string, metadata DbinMetadata) error {
 		}
 	}
 	saveAll(filename+".web", webMetadata)
+	// "nlite" version
+	for _, items := range metadata {
+		for i := range items {
+			items[i].Icon = ""
+			items[i].Provides = ""
+			items[i].Shasum = ""
+			items[i].AppstreamId = ""
+			items[i].LongDescription = ""
+			items[i].Screenshots = []string{}
+		}
+	}
+	saveAll(filename+".nlite", metadata)
 	// "lite" version
 	for _, items := range metadata {
 		for i := range items {

misc/cmd/dbinRepoIndexGenerators/1.6/generator.go

@@ -464,6 +464,18 @@ func saveMetadata(filename string, metadata DbinMetadata) error {
 		}
 	}
 	saveAll(filename+".web", webMetadata)
+	// "nlite" version
+	for _, items := range metadata {
+		for i := range items {
+			items[i].Icon = ""
+			items[i].Provides = ""
+			items[i].Shasum = ""
+			items[i].AppstreamId = ""
+			items[i].LongDescription = ""
+			items[i].Screenshots = []string{}
+		}
+	}
+	saveAll(filename+".nlite", metadata)
 	// "lite" version
 	for _, items := range metadata {
 		for i := range items {