Building times out on CiecleCI checks over an hour

[eunos-1128]

Hi,

When building on linux-aarch64, it seems that a timeout error occurs after more than an hour.

#58027 (comment)

Previously, there were no errors even after more than an hour, but has there been a recent change in the CircleCI settings?

Or is there a problem with the recipe?

Thank you,

[xrobin]

I have for instance this build for OpenStructure, which ran less than two months ago and completed in 2h53.

Promod3 should build faster than that, and I think we are just running over the 1 hour mark. (The checks on GitHub take 1h26, but seem to run a tad slower as CircleCI). But I also don't really see how to cut that down further. Any suggestions on how to proceed are welcome.

[aliciaaevans]

In my previous experience, it has always been a 1 hour timeout, so I am actually surprised by the one that went longer.

For osx-arm, unfortunately we only get 1 runner, so it can get queued behind other recipes. That can explain why the whole thing takes a while, but not why the build step is > 1 hr.

If you don't care about supporting Python 3.9, you could add skip: True # [py<310] to the build section. That might get it over the finish line.

[xrobin]

Thanks Alicia for the suggestion. Skipping Python 3.9 was just enough to bring the total build time to 59 minutes. Hopefully future builds won't fail, but it would still be good to understand where the difference comes from.

(PS: Mac builds fail at the moment unrelated to this timeout issue. We're looking into it).

[xrobin]

Now we have a problem with openstructure in #58392.
We're not going down from 3 hours to 1 by disabling checks and Python 3.9.

We never had timeouts before (the recipe has only been available for a few months). So definitely some things changed.

[eunos-1128]

Might the settings on the Circle CI side have changed?

The CI settings on the bioconda side haven't changed in nine months, so maybe there's been some change on the CircleCI side.

[eunos-1128]

It seems that even if you use the paid plan, it will not time out.

https://support.circleci.com/hc/en-us/articles/4410707277083-Context-deadline-exceeded-after-1-hour-Build-timed-out-Free-tier-only

Was it previously a paid plan, but now it's a free plan?

[xrobin]

Until this is resolved (if ever), if we have time to build openstructure for a single python version, which one should it be?

[eunos-1128]

@xrobin

With the current default settings, the build matrix for Python 3.9, 3.10, 3.11, and 3.12 is used, so I think it would be better to use only 3.12. (Skip building with py<312).

[eunos-1128]

@aliciaaevans

Not only linux-aarch64, but also osx-arm64 will result in a timeout error after more than an hour. This was not the case before, so I am certain that something has changed.