Post one bot comment with screenshots, failed tests and coverage #497

New issue

Closed

opened 2026-10-21 10:07:09 +00:00 by root · 7 comments

root commented

2026-10-21 10:07:09 +00:00

(Migrated from gitlab.core-project.space)

Parent

#489

What to build

A reviewer sees a run's result on the pull request itself: one bot comment, updated on each run rather than posted again, holding the preview's screenshots, the tests that failed in checks, front-test and e2e, and the engine's statement coverage. It replaces GitLab's test widget and coverage report. A job that only reads the other jobs' reports posts it, with the bot's comment token, which no other job references.

Seam: a Forgejo Actions run (spec ## Seams).

Acceptance criteria

A pull request carries exactly one bot comment, however many runs it has had.
A failed test is named in the comment with its job.
The engine's coverage percentage appears, shown and never enforced.
The screenshots appear when a preview was deployed, and the comment still posts when none was.
The posting job runs none of the pull request's code and accepts only the expected files.

## Parent #489 ## What to build A reviewer sees a run's result on the pull request itself: one bot comment, updated on each run rather than posted again, holding the preview's screenshots, the tests that failed in `checks`, `front-test` and `e2e`, and the engine's statement coverage. It replaces GitLab's test widget and coverage report. A job that only reads the other jobs' reports posts it, with the bot's comment token, which no other job references. Seam: a Forgejo Actions run (spec `## Seams`). ## Acceptance criteria - [ ] A pull request carries exactly one bot comment, however many runs it has had. - [ ] A failed test is named in the comment with its job. - [ ] The engine's coverage percentage appears, shown and never enforced. - [ ] The screenshots appear when a preview was deployed, and the comment still posts when none was. - [ ] The posting job runs none of the pull request's code and accepts only the expected files.

root commented

2026-10-21 10:07:19 +00:00

(Migrated from gitlab.core-project.space)

mentioned in issue #498