v1.0.0: make it so

Author: rvagg

.gitignore

@@ -0,0 +1 @@
+node_modules

CONTRIBUTING.md

@@ -0,0 +1,33 @@
+# Contributing to nodejs-dist-indexer
+
+## Code Contributions
+
+The nodejs-dist-indexer project is managed under the governance of the
+[Build Working Group](https://github.com/nodejs/build).
+
+## Developer's Certificate of Origin 1.1
+
+By making a contribution to this project, I certify that:
+
+* (a) The contribution was created in whole or in part by me and I
+  have the right to submit it under the open source license
+  indicated in the file; or
+
+* (b) The contribution is based upon previous work that, to the best
+  of my knowledge, is covered under an appropriate open source
+  license and I have the right under that license to submit that
+  work with modifications, whether created in whole or in part
+  by me, under the same open source license (unless I am
+  permitted to submit under a different license), as indicated
+  in the file; or
+
+* (c) The contribution was provided directly to me by some other
+  person who certified (a), (b) or (c) and I have not modified
+  it.
+
+* (d) I understand and agree that this project and the contribution
+  are public and that a record of the contribution (including all
+  personal information I submit with it, including my sign-off) is
+  maintained indefinitely and may be redistributed consistent with
+  this project or the open source license(s) involved.
+

GOVERNANCE.md

@@ -0,0 +1,4 @@
+# Governance
+
+The nodejs-dist-indexer project is managed under the governance of the
+[Build Working Group](https://github.com/nodejs/build).

LICENSE.md

@@ -0,0 +1,11 @@
+The MIT License (MIT)
+=====================
+
+Copyright (c) 2016 Node.js Foundation
+-------------------------------------
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

README.md

@@ -0,0 +1,90 @@
+# nodejs-dist-indexer
+
+**An application to create [nodejs.org](https://nodejs.org) distribution index files: index.json and index.tab**
+
+Output can be seen at:
+
+ * https://nodejs.org/download/release/index.tab
+ * https://nodejs.org/download/release/index.json
+ * https://iojs.org/download/release/index.tab
+ * https://iojs.org/download/release/index.json
+
+And all subdirectories of https://nodejs.org/download/ and https://iojs.org/download/ containing downloadable tarballs and installers.
+
+## Data
+
+For the purpose of cataloguing files within each versioned subdirectory, nodejs-dist-indexer is able to:
+
+* Determine the specific version of each directory (just the directory name!)
+* Determine the date the distributables were built
+* Decode filenames to determine the OS / architecture / packaging available
+* Determine the version of dependencies bundled with Node.js, including:
+  - npm
+  - V8
+  - libuv
+  - zlib
+  - OpenSSL
+* Determine the `NODE_MODULES_VERSION` for compiled add-on compatibility
+* Determine whether the version is an LTS or not
+
+All of this data is made available in JSON and tab-separated format.
+
+OS / architecture / packaging specifiers used in the listings include:
+
+* **aix-ppc64**: normally .tar.gz and .tar.xz
+* **headers**: normally .tar.gz and .tar.xz, downloaded by [node-gyp](https://github.com/nodejs/node-gyp/)
+* **linux-arm64**: normally .tar.gz and .tar.xz (also known as AArch64 or ARMv8)
+* **linux-armv6l**: normally .tar.gz and .tar.xz
+* **linux-armv7l**: normally .tar.gz and .tar.xz
+* **linux-ppc64le**: normally .tar.gz and .tar.xz
+* **linux-x64**: normally .tar.gz and .tar.xz
+* **linux-x86**: normally .tar.gz and .tar.xz
+* **osx-x64-pkg**: OSX .pkg installer (64-bit only since io.js v1)
+* **osx-x64-tar**: normally .tar.gz and .tar.xz
+* **src**: normally .tar.gz and .tar.xz, full source used to build the distribution
+* **sunos-x64**: normally .tar.gz and .tar.xz
+* **sunos-x86**: normally .tar.gz and .tar.xz
+* **win-x64-msi**: Windows 64-bit .msi installer
+* **win-x86-msi**: Windows 32-bit .msi installer
+* **win-x64-exe**: Windows 64-bit bare node.exe, within a win-x64 directory
+* **win-x86-exe**: Windows 32-bit bare node.exe, within a win-x86 directory
+
+## Usage:
+
+Create an index.json and index.tab from a given distribution directory that contains subdirectories that contain distributable files:
+
+```text
+nodejs-dist-indexer \
+  --dist /path/to/dist/directory/
+  --indexjson /path/to/dist/directory/index.json
+  --indextab /path/to/dist/directory/index.tab
+```
+
+List the type of distributable files contained within given directories:
+
+```text
+nodejs-ls-types [-d] <directory>[ <directory> [<directory> ...]]
+```
+
+The `-d` argument is supplied if it is to only count files that have a corresponding `.done` file; this is used for promoting staged releases where the `.done` file indicates that an upload from a build server is complete.
+
+Output looks like:
+
+```text
+$ nodejs-ls-types latest*
+latest: aix-ppc64 headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
+latest-argon: headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
+latest-v0.10.x: headers linux-x64 linux-x86 osx-x64-pkg osx-x64-tar osx-x86-tar src sunos-x64 sunos-x86 win-x86-exe win-x86-msi
+latest-v0.12.x: headers linux-x64 linux-x86 osx-x64-pkg osx-x64-tar osx-x86-tar src sunos-x64 sunos-x86 win-x86-exe win-x86-msi
+latest-v4.x: headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
+latest-v5.x: headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
+latest-v6.x: aix-ppc64 headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
+```
+
+-----------------------------------
+
+Managed under the governance of the Node.js [Build Working Group](https://github.com/nodejs/build).
+
+Copyright (c) 2016 Node.js Foundation. All rights reserved.
+
+Licensed under MIT, see the LICENSE.md file for details

decode-ref.js

@@ -0,0 +1,31 @@
+const assert = require('assert')
+    , dirre  = /^(v\d+\.\d+\.\d+(?:-rc\.\d+)?)(?:-(?:(?:next-)?nightly|test)\d{8}(\w+))?$/ // get version or commit from dir name
+
+
+function decodeRef (dir) {
+  var m = dir.match(dirre)
+  return m && (m[2] || m[1])
+}
+
+
+module.exports = decodeRef
+
+
+if (module === require.main) {
+  var tests = [
+      { dir: 'v1.0.0'                                , ref: 'v1.0.0'          }
+    , { dir: 'v10.11.12'                             , ref: 'v10.11.12'       }
+    , { dir: 'v2.3.2-nightly20150625dcbb9e1da6'      , ref: 'dcbb9e1da6'      }
+    , { dir: 'v2.3.1-next-nightly201506308f6f4280c6' , ref: '8f6f4280c6'      }
+    , { dir: 'v3.0.0-rc.1'                           , ref: 'v3.0.0-rc.1'     }
+    , { dir: 'v33.22.1-rc.111'                       , ref: 'v33.22.1-rc.111' }
+    , { dir: 'v0.6.1'                                , ref: 'v0.6.1'          }
+    , { dir: 'v0.5.1'                                , ref: 'v0.5.1'          }
+    , { dir: 'v6.0.0-test20151107093b0e865c'         , ref: '093b0e865c'      }
+  ]
+
+  tests.forEach(function (test) {
+    console.log(`testing ${test.dir} -> ${test.ref}`)
+    assert.equal(decodeRef(test.dir), test.ref)
+  })
+}