PRs not being sent in for various projects

[ckipp01]

I'm not sure if the logs are public or not since I don't see reference to them anywhere, but I noticed today that no PRs are being sent in to https://github.com/DavidGregory084/mill-tpolecat even though it's listed in https://github.com/VirtusLab/scala-steward-repos/blob/main/repos-github.md. Could this be checked to see if it's erroring out on that repo for some reason? If so, pasting the error would be super helpful as I'm happy to look into it.

[tgodzik]

Thanks for reporting! I am having issues getting full logs for Azure, it seems I need to configure logging workspace? This is a bit too complicated, it actually gives you less logs than github actions.

[tgodzik]

Ok, it all seems complicated to get logs :|

Could you maybe try running the ScalaSteward mill plugin locally to see if it breaks? Maybe it's reproducible locally?

[ckipp01]

Sure, running the extractDeps task which is what is called in the Mill plugin seems to work fine:

❯ mill --import ivy:org.scala-steward:scala-steward-mill-plugin_2.13:0.15.0 org.scalasteward.mill.plugin.StewardPlugin/extractDeps
No mill version specified.
You should provide a version via '.mill-version' file or --mill-version option.
Using mill version 0.10.8
[11/11] org.scalasteward.mill.plugin.StewardPlugin.extractDeps

So no idea really without actually seeing the logs.

[ckipp01]

Alright, so I actually just saw that this is happening on another repo. https://github.com/com-lihaoyi/scalatags isn't getting any prs sent in and it's on the repo.md.

[tgodzik]

Ok, I finally managed to get a follow on container logs. Let's see if I find the issue.

[tgodzik]

Yesterday I only got a part of it and it hasn't yielded any results, I am rerunning the whole job and should get the full logs.

[tgodzik]

Got it! I think I should actually find all errors and let the people know.
That's for scalatags

2022-12-21 09:25:07,660 ERROR Steward com-lihaoyi/scalatags failed
java.io.IOException: 'sbt -Dsbt.color=false -Dsbt.log.noformat=true -Dsbt.supershell=false ;+ stewardDependencies;reload plugins;stewardDependencies' exited with code 1
[info] Loading global plugins from /root/.sbt/1.0/plugins
[info] Compiling 1 Scala source to /root/.sbt/1.0/plugins/target/scala-2.12/sbt-1.0/classes ...
[error] /root/.sbt/1.0/plugins/StewardPlugin.scala:67:15: not found: value csrConfiguration
[error]               csrConfiguration.value.authenticationByRepositoryId.toList
[error]               ^
[error] /root/.sbt/1.0/plugins/StewardPlugin.scala:69:56: value headers is not a member of Any
[error]             (headerKey, headerValue) <- authentication.headers
[error]                                                        ^
[error] /root/.sbt/1.0/plugins/StewardPlugin.scala:70:35: type mismatch;
[error]  found   : Any
[error]  required: String
[error]           } yield Resolver.Header(headerKey, headerValue)
[error]                                   ^
[error] /root/.sbt/1.0/plugins/StewardPlugin.scala:70:46: type mismatch;
[error]  found   : Any
[error]  required: String
[error]           } yield Resolver.Header(headerKey, headerValue)
[error]                                              ^
[error] four errors found
[error] (Compile / compileIncremental) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? 
	at org.scalasteward.core.io.process$.$anonfun$slurp$9(process.scala:54)
	at org.scalasteward.core.io.process$.$anonfun$slurp$9$adapted(process.scala:50)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at modify @ fs2.internal.Scope.close(Scope.scala:262)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at rethrow$extension @ fs2.Compiler$Target.$anonfun$compile$1(Compiler.scala:157)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)
	at flatMap @ fs2.Pull$.$anonfun$compile$21(Pull.scala:1209)
	at update @ fs2.internal.Scope.releaseChildScope(Scope.scala:224)
	at flatMap @ fs2.Compiler$Target.flatMap(Compiler.scala:163)

[tgodzik]

Interestingly for mill-tpolcat it's just this:

2022-12-21 09:34:18,213 INFO  ──────────── Steward DavidGregory084/mill-tpolecat ────────────
2022-12-21 09:34:18,213 INFO  Check cache of DavidGregory084/mill-tpolecat
2022-12-21 09:34:18,697 INFO  Find updates for DavidGregory084/mill-tpolecat
2022-12-21 09:34:18,698 INFO  Found 0 updates
2022-12-21 09:34:18,698 INFO  DavidGregory084/mill-tpolecat is up-to-date
2022-12-21 09:34:18,699 INFO  ──────────── Total time: Steward DavidGregory084/mill-tpolecat: 486ms ────────────
2022-12-21 09:34:18,699 INFO  ──────────── Steward deanwampler/programming-scala-book-code-examples ────────────

I can send you the full logs if you want.

Packed size is 150 mb and unpacked 10x more 😨

[tgodzik]

Full list of failing repos to check is:

• https://github.com/9rb/rchain not actively maintained, multiple PRs waiting
• https://github.com/agustafson/cats-quartz Github token issues Scala Steward jobs are failing agustafson/cats-quartz#2
• https://github.com/akka/akka-persistence-spanner no such repository
• https://github.com/alexarchambault/mill-native-image Scala Steward job is failing alexarchambault/mill-native-image#22
• https://github.com/andyglow/caseclass-evolution not an active repo leftover PRs and CI possibly failing Update sbt-scoverage to 1.7.3 andyglow/caseclass-evolution#48
• https://github.com/andyglow/scalacheck-gen-configured Scala steward job failing andyglow/scalacheck-gen-configured#65 <- also mentioned other repositories from andyglow there, I don't think there is a need to create more issues
• https://github.com/andyglow/scala-jsonschema failed
• https://github.com/andyglow/spark-option-setter failed
• https://github.com/atnos-org/origami Scala Steward job failing on public instance atnos-org/origami#155
• https://github.com/betagouv/aplus Scala Steward public instance is failing  betagouv/aplus#1625
• https://github.com/betagouv/signalement-api doesn't exist or is private
• https://github.com/blackdoor/jose Scala Steward job is failing for the repo blackdoor/jose#55
• https://github.com/brbrown25/testcontainers-scala-kafka-utils not an active repo Scala Steward job is failing for the repo brbrown25/testcontainers-scala-kafka-utils#10
• https://github.com/broadinstitute/poolq - missing GITHUB_TOKEN
• https://github.com/caesarsdigital/zio-diffx archived
• https://github.com/che-samples/scala-sbt no issue tracker and seems to be a forked repo 🤔
• https://github.com/circe/circe-spray archived
• https://github.com/com-lihaoyi/mill both sbt and mill present
• https://github.com/com-lihaoyi/PPrint both sbt and mill present
• https://github.com/com-lihaoyi/scalatags both sbt and mill present
• https://github.com/com-lihaoyi/upickle both sbt and mill present
• https://github.com/cornerman/chameleon Scala steward job is failing cornerman/chameleon#215
• https://github.com/coursier/dependency failed
• https://github.com/coursier/jni-utils failed
• https://github.com/coursier/sbt-coursier looks like a temporary issue
• https://github.com/coursier/sbt-shading seems to have started working again
• https://github.com/debiki/talkyard failed
• https://github.com/disneystreaming/smithy4s works now
• https://github.com/domino-osgi/domino failed
• https://github.com/domino-osgi/domino-java failed
• https://github.com/enlivensystems/invoicing-hungarian failed
• https://github.com/EventStore/EventStore.JVM failed
• https://github.com/exoego/aws-sdk-scalajs-facade failed
• https://github.com/finos/morphir-scala failed
• https://github.com/foreign-language-reader/api failed
• https://github.com/freechipsproject/chisel-template failed
• https://github.com/freechipsproject/diagrammer failed
• https://github.com/freechipsproject/firrtl-interpreter failed
• https://github.com/fun-stack/example failed
• https://github.com/fun-stack/local-env failed
• https://github.com/ghostdogpr/caliban failed
• https://github.com/hajlaoui-nader/books failed
• https://github.com/hntd187/spotify failed
• https://github.com/holdenk/sparkProjectTemplate.g8 failed
• https://github.com/jcouyang/zhuyu failed
• https://github.com/joan38/kafka-streams-circe failed
• https://github.com/joan38/mill-git failed
• https://github.com/jsuereth/scala-arm failed
• https://github.com/justinhj/fp-starter-pack.g8 failed
• https://github.com/jwt-scala/jwt-scala failed
• https://github.com/Karasiq/webm-tv failed
• https://github.com/kemitix/thorp failed
• https://github.com/kinoplan/scalajs-react-material-ui failed
• https://github.com/kontainers/elastic4s-client-aws failed
• https://github.com/Ksisu/tell-me-a-secret failed
• https://github.com/lapsusHQ/templary failed
• https://github.com/laserdisc-io/eisner failed
• https://github.com/lefou/mill-aspectj failed
• https://github.com/leigh-perry/conduction failed
• https://github.com/leigh-perry/log4zio failed
• https://github.com/leigh-perry/template-cats-io-app failed
• https://github.com/leigh-perry/template-cats-zio-app failed
• https://github.com/liuhongchao/debug4s failed
• https://github.com/metabookmarks/lagom-silhouette failed
• https://github.com/metabookmarks/sbt-plantuml-plugin failed
• https://github.com/michaelmior/eson-mining failed
• https://github.com/mvillafuertem/scalajs-react-world failed
• https://github.com/nafg/css-dsl failed
• https://github.com/nightscape/scala-node-red failed
• https://github.com/novakov-alexey/http4s-spnego failed
• https://github.com/nrktkt/ninny-json failed
• https://github.com/odenzo/scala3-template failed
• https://github.com/orbeon/orbeon-forms failed
• https://github.com/ornicar/lila-search failed
• https://github.com/Philippus/base64 failed
• https://github.com/Philippus/scala-for-all failed
• https://github.com/playframework/js-engine failed
• https://github.com/playframework/netty-reactive-streams failed
• https://github.com/playframework/npm failed
• https://github.com/playframework/play-samples failed
• https://github.com/polyvariant/doobie-quill failed
• https://github.com/precog/async-blobstore failed
• https://github.com/precog/fs2-job failed
• https://github.com/precog/fs2-ssh failed
• https://github.com/precog/qdata failed
• https://github.com/precog/quasar failed
• https://github.com/precog/quasar-datasource-azure failed
• https://github.com/precog/quasar-datasource-kafka failed
• https://github.com/precog/quasar-datasource-mongo failed
• https://github.com/precog/quasar-datasource-postgres failed
• https://github.com/precog/quasar-datasource-s3 failed
• https://github.com/precog/quasar-destination-avalanche failed
• https://github.com/precog/quasar-destination-azure failed
• https://github.com/precog/quasar-destination-gbq failed
• https://github.com/precog/quasar-destination-h2 failed
• https://github.com/precog/quasar-destination-postgres failed
• https://github.com/precog/quasar-destination-redshift failed
• https://github.com/precog/quasar-destination-s3 failed
• https://github.com/precog/quasar-destination-snowflake failed
• https://github.com/precog/quasar-destination-thoughtspot failed
• https://github.com/precog/quasar-plugin-avalanche failed
• https://github.com/precog/quasar-plugin-jdbc failed
• https://github.com/precog/quasar-plugin-mariadb failed
• https://github.com/precog/quasar-plugin-sap-hana failed
• https://github.com/precog/sbt-precog failed
• https://github.com/precog/sbt-quasar-plugin failed
• https://github.com/precog/slamdata-predef failed
• https://github.com/precog/suprem failed
• https://github.com/prom3th3us/zio-actors-cassandra-journal failed
• https://github.com/ReactivePlatform/Reactive-Design-Patterns failed
• https://github.com/regadas/socco-ng failed
• https://github.com/sangria-graphql/sangria-subscriptions-example failed
• https://github.com/scalapb/scalapb-template.g8 failed
• https://github.com/scala/scala-dist-smoketest failed
• https://github.com/schrepfler/artemis failed
• https://github.com/schrepfler/crdt-kit failed
• https://github.com/schrepfler/scala-native-cli failed
• https://github.com/schrepfler/sportsml-scala failed
• https://github.com/sentenza/PureCSV failed
• https://github.com/ShiftLeftSecurity/codepropertygraph failed
• https://github.com/simao/anorm-async failed
• https://github.com/sirocchj/sbt-api-builder failed
• https://github.com/spf3000/functional-kniffle failed
• https://github.com/spotify/scio looks to be working now
• https://github.com/stripe/dagon loads of unmerged PRs <- probably unmaintained
• https://github.com/transcendent-ai-labs/DynaML failed
• https://github.com/typeness/spray-json-refined failed
• https://github.com/vaslabs/talos failed
• https://github.com/wiringbits/cazadescuentos failed
• https://github.com/xencura/kagera failed

Edit: started removing some: #136

[ckipp01]

Ah super helpful, thanks for sharing that. Regarding scalatags and a lot of the other com-lihaoyi ones, the logs make it seem like it's trying to run sbt on them, but looking at them they do indeed have a build.sbt file, only the docs, which stinks. I don't really know if there is a way to force a build tool, but this at least explains why all those are failing.

[tgodzik]

Ah super helpful, thanks for sharing that. Regarding scalatags and a lot of the other com-lihaoyi ones, the logs make it seem like it's trying to run sbt on them, but looking at them they do indeed have a build.sbt file, only the docs, which stinks. I don't really know if there is a way to force a build tool, but this at least explains why all those are failing.

We might need to try and run both 🤔 but that needs a change in the steward I guess. I updated the list, will try tackle that slowly. We can open issues in the repos that are failing.

[ckipp01]

Ah weird that it failed on Mill. Actually, do you mind dropping me the entire logs thing? I can try to take care of the mill ones.

[mtomko]

One of those repos (https://github.com/broadinstitute/poolq) "belongs" to me and I think it should work. I mean, we use it all the time. Also, it doesn't use Mill - it has a regular build.sbt, although its CI job runs a make target that does some extra integration tests as well. It's CI build passed the last time it ran: https://github.com/broadinstitute/poolq/actions/workflows/ci.yml

Anything I can do to help? I'm not sure how to see these logs.