Stream: Coq devs & plugin devs

Topic: CI artifact use


view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:06):

We are using close to 7TiB of data on gitlab for our artifacts, I think we should start thinking about a cleanup strategy.

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:17):

did you clean the registry? I remember there being a ton of images there

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:17):

also we should have a release step to change the tag name so that we can more easily recognize which images are for release branches

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:25):

Yes I did, a 200 GiB less

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:26):

there is auto-clean now

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:26):

but for artifacts I'm at a loss

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:26):

I mean there is auto-clean for the registry as a feature, but I didn't enable auto-clean

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:26):

just a clean

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:27):

I'm still playing with gitlab CI Inria, @Gaëtan Gilbert but I need for them to raise the artifact size lmit

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:27):

limit

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:27):

otherwise seems much faster

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:43):

we don't have expire on ci-template, probably why there's so much stuff

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:50):

oh but artifacts auto expire 1 month since june 2020 https://docs.gitlab.com/ee/user/gitlab_com/index.html#gitlab-cicd

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:52):

Yes, i'd be great if we could find the artifact manager and clean up a bit

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:52):

7 TiB seems a bit too much to me

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:53):

we have about 600 pipelines last 30 days so that's about 11GB / pipeline
seems plausible

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:54):

with 90 jobs / pipeline

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:55):

Coq universe took like 2 GiB artifacts

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:55):

but we are not uploading the artifacts of the leaves, right?

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:55):

we do

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:56):

  artifacts:
    name: "$CI_JOB_NAME"
    paths:
      - _build_ci
    when: always

view this post on Zulip Gaëtan Gilbert (Jun 23 2022 at 19:56):

dune ci template has 2 months expires

view this post on Zulip Emilio Jesús Gallego Arias (Jun 23 2022 at 19:57):

Aha

view this post on Zulip Jason Gross (Jun 23 2022 at 23:29):

Artifacts of the leaves need to be uploaded so that the bug minimizer works.

view this post on Zulip Emilio Jesús Gallego Arias (Jun 24 2022 at 07:45):

Ah that was the reason, thanks for the clarification @Jason Gross


Last updated: Feb 01 2023 at 16:03 UTC