GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — Failed SARIF testing and logging improvements by mbg · Pull Request #4249 · github/codeql-action

Conversation

@mbg

@mbg mbg commented Oct 16, 2026

Copy link
Copy Markdown
Member

Cherry-picked changes from #4223 which primarily improve our ability to test the failed SARIF upload process in init-post. These changes are in prep for #4223 to make them easier to review, but aren't all used here yet. The main changes here are:

  • For the failed SARIF upload process, the function of shouldSkipSarifUpload is now divided up between it and a new shouldSkipGenerateFailedSarif. To maintain backwards compatibility, shouldSkipSarifUpload implies shouldSkipGenerateFailedSarif by default.
    • Both can now explicitly be set to false rather than just explicitly set to true.
  • shouldSkipGenerateFailedSarif now guards whether the failed SARIF is generated rather than shouldSkipSarifUpload. This allows us to generate the failed SARIF, but not upload it. Previously not uploading it implied not generating it.
  • combineSarifFilesUsingCLI was calling getConfig itself, which made it oblivious to the new failed configuration file that was introduced in Store and restore "failed" configuration if init step aborts #4225. This is changed so that the Config is propagated to it from higher up in the call hierarchy.
    • See Include diagnostics in failed SARIF if they were created before a database was initialised #4223 (comment) for one implication of this change.
  • Some logging improvements.

Risk assessment

For internal use only. Please select the risk level of this change:

  • Low risk: Changes are fully under feature flags, or have been fully tested and validated in pre-production environments and are highly observable, or are documentation or test only.

Which use cases does this change impact?

Workflow types:

  • Advanced setup - Impacts users who have custom CodeQL workflows.
  • Managed - Impacts users with dynamic workflows (Default Setup, Code Quality, ...).

Products:

  • Code Scanning - The changes impact analyses when analysis-kinds: code-scanning.
  • Code Quality - The changes impact analyses when analysis-kinds: code-quality.
  • Other first-party - The changes impact other first-party analyses.
  • Third-party analyses - The changes affect the upload-sarif action.

Environments:

  • Dotcom - Impacts CodeQL workflows on github.com and/or GitHub Enterprise Cloud with Data Residency.
  • GHES - Impacts CodeQL workflows on GitHub Enterprise Server.

How did/will you validate this change?

  • Unit tests - I am depending on unit test coverage (i.e. tests in .test.ts files).
  • End-to-end tests - I am depending on PR checks (i.e. tests in pr-checks).

If something goes wrong after this change is released, what are the mitigation and rollback strategies?

  • Rollback - Change can only be disabled by rolling back the release or releasing a new version with a fix.

How will you know if something goes wrong after this change is released?

  • Telemetry - I rely on existing telemetry or have made changes to the telemetry.
    • Dashboards - I will watch relevant dashboards for issues after the release. Consider whether this requires this change to be released at a particular time rather than as part of a regular release.
    • Alerts - New or existing monitors will trip if something goes wrong with this change.

Are there any special considerations for merging or releasing this change?

  • No special considerations - This change can be merged at any time.

Merge / deployment checklist

  • Confirm this change is backwards compatible with existing workflows.
  • Consider adding a changelog entry for this change.
  • Confirm the readme and docs have been updated if necessary.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@mbg
mbg added this pull request to stack #4250 October 16, 2026 16:13
Copilot AI max review requested due to automatic review settings October 16, 2026 16:13
@mbg
mbg requested a review from a team as a code owner October 16, 2026 16:13
@github-actions github-actions Bot added the size/M Should be of average difficulty to review label Oct 16, 2026
Copilot started reviewing on behalf of mbg October 16, 2026 16:14
View session
@mbg
mbg requested a review from henrymercer October 16, 2026 16:14
Copilot AI reviewed Oct 16, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Warning

  • Copilot's review of this pull request may be incomplete because some of the changed files are excluded by your Copilot content exclusion settings. See Excluding content from Copilot for details.

🔵 Needs a closer look

Cross-action upload behavior needs human validation, including an unresolved processing-wait inconsistency.

1 open finding
  • Medium severity Test mode incorrectly skips SARIF processing waits · New
What changed in this PR

Improves failed-SARIF testing and logging, preparing init-post to handle diagnostics from aborted initialization.

Changes:

  • Separates failed-SARIF generation and upload controls, including explicit false overrides.
  • Propagates configuration through SARIF processing.
  • Adds test-mode artifacts and upload-aware processing waits.
File Description
src/​util.ts Adds independent generation and upload controls.
src/​util.test.ts Tests skip settings and overrides.
src/​upload-sarif.ts Forwards configuration to post-processing.
src/​upload-sarif.test.ts Updates mocks and configuration assertions.
src/​upload-sarif-action.ts Loads configuration for CLI reuse.
src/​upload-lib.ts Uses supplied configuration and skips waits when uploads are disabled.
src/​init-action-post.ts Logs aborted-configuration fallback.
src/​init-action-post-helper.ts Separates generation controls and adds testing artifacts.
src/​init-action-post-helper.test.ts Checks configuration forwarding.
src/​environment.ts Defines the generation-skip setting.
src/​analyze-action.ts Passes configuration into SARIF processing.
Files excluded by content exclusion policy (1)
  • lib/entry-points.js

🧠 Review effort: Max


💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
Comment thread src/util.ts Resolved

Uh oh!

There was an error while loading. Please reload this page.

Base automatically changed from mbg/move-diag-export-script to main October 20, 2026 16:07
mbg added 8 commits October 20, 2026 16:07
@mbg
Log when we didn't get a normal configuration file
be1223f
@mbg
Allow to explicitly not skip the SARIF upload
a9cd2f9
@mbg
Add and use shouldSkipGenerateFailedSarif
6e9aec6
@mbg
Propagate Config to combineSarifFilesUsingCLI
02fb8cc
@mbg
Skip waiting for SARIF if nothing was uploaded
e7340ee
@mbg
Upload failed SARIF as workflow artifact in test mode
1d373e0
@mbg
Improve logging in uploadSarifArtifact
5b69b28
@mbg
Ensure that rootDirectory is suitable for sarifFile in `uploadSar…
950b147
…ifArtifact`
@mbg
mbg force-pushed the mbg/upload-improvements-for-4223 branch from d6b8ed8 to 950b147 Compare October 20, 2026 16:07
henrymercer
henrymercer reviewed Oct 20, 2026
View reviewed changes
Comment thread src/upload-sarif-action.ts Resolved

Uh oh!

There was an error while loading. Please reload this page.

Comment thread src/util.ts Resolved

Uh oh!

There was an error while loading. Please reload this page.

Comment thread src/upload-lib.ts Resolved

Uh oh!

There was an error while loading. Please reload this page.

Comment thread src/environment.ts Resolved

Uh oh!

There was an error while loading. Please reload this page.

mbg added 4 commits October 20, 2026 17:59
@mbg
Fix typo in comment
74ddcd9
@mbg
Document that setting the env vars to false takes precedence
a69c7cb
@mbg
Use shouldSkipSarifUpload in analyze-action.ts
7fa4518
@mbg
Change comment for getConfig call in upload-sarif
b96e339
@mbg
mbg requested a review from henrymercer October 20, 2026 17:10
henrymercer
henrymercer approved these changes Oct 20, 2026
View reviewed changes
@mbg
mbg added this pull request to the merge queue Oct 20, 2026
Merged via the queue into main with commit 3dd33f8 Oct 20, 2026
226 checks passed

Uh oh!

There was an error while loading. Please reload this page.

@mbg
mbg deleted the mbg/upload-improvements-for-4223 branch October 20, 2026 17:48
This was referenced Oct 21, 2026
Merge main into releases/v4 #4257
Merged
Merge releases/v4 into releases/v3 #4259
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot review effort
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments
@henrymercer henrymercer henrymercer approved these changes

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

size/M Should be of average difficulty to review

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

3 participants

@mbg @henrymercer
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.