codesearch (and xref) does not contain DokuWiki's test classes

[Klap-in]

In the xref (https://github.com/dokuwiki/dokuwiki-plugin-xref) the references to classes of the unit tests e.g. [[xref>TestRequest]] are missing.

downloader, for dokuwiki a download url and repo are given.
https://github.com/dokuwiki/dokuwiki-extensionmirror/blob/decb7ff91ce858a7a59b93eff6bac090e962e254/src/Downloader.php#L57-L60

If I try the download link, indeed I get a DokuWiki download without test classes, as set in https://github.com/dokuwiki/dokuwiki/blob/master/.gitattributes

Probably the tool uses the download, which means the attempt to checkout the repository does not succeed. I guess a checkout would contain the test classes.

The getDownloads() does a normalizedRepo(), after that the DokuWiki entry is added and, therefore, not normalized.

[splitbrain]

still needs to be updated on the server

[Klap-in]

Eventually, this is also partly related to #4?

[Klap-in]

I had another look.
https://codesearch.dokuwiki.org/xref/dokuwiki/ still does not contain the test classes, or the _test folder at all. Thus it does not clone with git.

In the script there is a log action missing after the checkout(), so not sure if it is already visible now in the log when running the script, I guess not.

I could not yet find a cause reading the code, however, some other minors I noticed are mentioned below.

https://github.com/dokuwiki/dokuwiki-extensionmirror/blob/983c390158cd325c4683ab52a0b33a455a986baf/src/Downloader.php#L72-L74

branch ‘master’ is set instead of the last update date.

https://github.com/dokuwiki/dokuwiki-extensionmirror/blob/983c390158cd325c4683ab52a0b33a455a986baf/src/Downloader.php#L59
Reading code it is not a branch or used as such, but it does not break things.

Bitbucket links are rewritten wrong: https://github.com/dokuwiki/dokuwiki-extensionmirror/blob/983c390158cd325c4683ab52a0b33a455a986baf/src/Downloader.php#L114-L116

[splitbrain]

I updated the script and also configured the cron job to use git checkouts. This will also make some git features available in opengrok. Indexing is in progress...