Maxime Dénès (Aug 28 2023 at 17:06): Maxime Dénès (Aug 28 2023 at 17:06):It seems we are getting a lot of 403 when downloading code from github on gitlab ci. Example https://gitlab.com/coq/coq/-/pipelines/983882236
Could it be rate limiting?
Karl Palmskog (Aug 28 2023 at 19:51):looks like GitHub is returning 403 Forbidden for all URLs https://github.com/<org>/<repo>/archive/<SHA>.tar.gz
Karl Palmskog (Aug 28 2023 at 20:00):ah, this happens with plain wget, but not in browser
Karl Palmskog (Aug 28 2023 at 20:01):so they likely implemented some kind of fingerprinting or other stuff that makes plain wget fail
Karl Palmskog (Aug 28 2023 at 20:09):This fails in Coq's CI and for me locally:
wget https://github.com/uwplse/StructTact/archive/2f2ff253be29bb09f36cab96d036419b18a95b00.tar.gz # 403 Forbidden
But apparently curl works, at least locally:
curl -O -J -L https://github.com/uwplse/StructTact/archive/2f2ff253be29bb09f36cab96d036419b18a95b00.tar.gz # get file called StructTact-2f2ff253be29bb09f36cab96d036419b18a95b00.tar.gz
Really strange
Maxime Dénès (Aug 29 2023 at 06:29):https://github.com/orgs/community/discussions/65227
Karl Palmskog (Aug 29 2023 at 06:35):apparently wget is working again:
We blocked a scraper which was causing some performance impact earlier and it appears our pattern wasn't specific enough, so it accidentally flagged more clients than we wanted. We've restricted the pattern to be more specific so it shouldn't impact other parties, and things should be back to normal.
Last updated: Nov 29 2023 at 21:01 UTC