Stream: Coq devs & plugin devs

Topic: 403 in CI


view this post on Zulip Maxime Dénès (Aug 28 2023 at 17:06):

It seems we are getting a lot of 403 when downloading code from github on gitlab ci. Example https://gitlab.com/coq/coq/-/pipelines/983882236

Could it be rate limiting?

view this post on Zulip Karl Palmskog (Aug 28 2023 at 19:51):

looks like GitHub is returning 403 Forbidden for all URLs https://github.com/<org>/<repo>/archive/<SHA>.tar.gz

view this post on Zulip Karl Palmskog (Aug 28 2023 at 20:00):

ah, this happens with plain wget, but not in browser

view this post on Zulip Karl Palmskog (Aug 28 2023 at 20:01):

so they likely implemented some kind of fingerprinting or other stuff that makes plain wget fail

view this post on Zulip Karl Palmskog (Aug 28 2023 at 20:09):

This fails in Coq's CI and for me locally:

wget https://github.com/uwplse/StructTact/archive/2f2ff253be29bb09f36cab96d036419b18a95b00.tar.gz # 403 Forbidden

But apparently curl works, at least locally:

curl -O -J -L https://github.com/uwplse/StructTact/archive/2f2ff253be29bb09f36cab96d036419b18a95b00.tar.gz # get file called StructTact-2f2ff253be29bb09f36cab96d036419b18a95b00.tar.gz

view this post on Zulip Maxime Dénès (Aug 29 2023 at 06:28):

Really strange

view this post on Zulip Maxime Dénès (Aug 29 2023 at 06:29):

https://github.com/orgs/community/discussions/65227

view this post on Zulip Karl Palmskog (Aug 29 2023 at 06:35):

apparently wget is working again:

We blocked a scraper which was causing some performance impact earlier and it appears our pattern wasn't specific enough, so it accidentally flagged more clients than we wanted. We've restricted the pattern to be more specific so it shouldn't impact other parties, and things should be back to normal.


Last updated: Jun 23 2024 at 01:02 UTC