GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — tools: automate openssl update on v16 by marco-ippolito · Pull Request #48377 · nodejs/node

Conversation

@marco-ippolito

@marco-ippolito marco-ippolito commented Jun 7, 2023 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

This PR allows updating openssl 1 on v16, for this to work the scripts (also utils.sh) need to be backported to v16

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@nodejs-github-bot

nodejs-github-bot commented Jun 7, 2023

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/actions
  • @nodejs/security-wg
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito marco-ippolito changed the title Feat/automate openssl backport tools: openssl backport Jun 7, 2023
@nodejs-github-bot nodejs-github-bot added meta Issues and PRs related to the general management of the project. tools Issues and PRs related to the tools directory. labels Jun 7, 2023
@marco-ippolito marco-ippolito changed the title tools: openssl backport tools: openssl backport on v16 Jun 7, 2023
@marco-ippolito marco-ippolito mentioned this pull request Jun 7, 2023
tools: simplify update-openssl workflow #48185
Closed
@marco-ippolito marco-ippolito changed the title tools: openssl backport on v16 tools: automate openssl update on v16 Jun 7, 2023
@marco-ippolito
marco-ippolito force-pushed the feat/automate-openssl-backport branch from 2b0271b to e2ca567 Compare June 7, 2023 13:08
RafaelGSS
RafaelGSS approved these changes Jun 7, 2023
View reviewed changes
aduh95
aduh95 reviewed Jun 8, 2023
View reviewed changes
Comment thread .github/workflows/update-openssl.yml Resolved

Uh oh!

There was an error while loading. Please reload this page.

aduh95
aduh95 approved these changes Jun 8, 2023
View reviewed changes
@marco-ippolito marco-ippolito added the author ready PRs with CI started, the required approvals, and no outstanding review comments. label Jun 8, 2023
UlisesGascon
UlisesGascon approved these changes Jun 8, 2023
View reviewed changes
@baparham

baparham commented Jun 8, 2023 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown

for 3.0 stream at least, quictls isn't using releases to manage new versions so the gh api call probably needs to look more like:

edit: adding link to comment quictls/openssl#114 (comment) for context

NEW_VERSION=$(gh api repos/quictls/openssl/tags -q '.[].name|select(contains("openssl-3.0"))|ltrimstr("openssl-")' | grep quic | head -n1)

so that we query the tags from quictls instead of releases

I suspect a similar pattern is needed for the 1.x stream also

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@baparham

baparham commented Jun 8, 2023

Copy link
Copy Markdown

for 3.0 stream at least, quictls isn't using releases to manage new versions so the gh api call probably needs to look more like:

NEW_VERSION=$(gh api repos/quictls/openssl/tags -q '.[].name|select(contains("openssl-3.0"))|ltrimstr("openssl-")' | grep quic | head -n1)

so that we query the tags from quictls instead of releases

I suspect a similar pattern is needed for the 1.x stream also

I guess you refactored it to use fetch instead, so the logic needs modification from what I suggested, but the principal of checking for tags rather than releases is my main point. The fetch also results in non-quic and quic tag names, so more logic may be necessary to filter on those.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

baparham
baparham reviewed Jun 8, 2023
View reviewed changes

@baparham baparham left a comment

Copy link
Copy Markdown

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried to more precisely capture what I mean in some specific review comments, hopefully I'm not way off here and this is at least a little bit helpful.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
Comment thread tools/dep_updaters/update-openssl.sh Resolved

Uh oh!

There was an error while loading. Please reload this page.

Comment thread tools/dep_updaters/update-openssl.sh Resolved

Uh oh!

There was an error while loading. Please reload this page.

Comment thread tools/dep_updaters/update-openssl.sh Resolved

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito

marco-ippolito commented Jun 8, 2023 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member Author

@baparham could you check again now? also I think this doesnt apply for v1, I dont see v1 in https://api.github.com/repos/quictls/openssl/tags

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito marco-ippolito added the commit-queue-squash PRs the Commit Queue should land as one squashed commit. label Jun 8, 2023
@baparham

baparham commented Jun 8, 2023

Copy link
Copy Markdown

They are deleting the releases, per that comment from @richsalz, so I don't think that's correct for the 1.1 stream. What's odd is I see tags here https://github.com/quictls/openssl/tags but not in the gh api call, like you pointed out.

Perhaps they are just remnants of previous "releases" and not actual tags or something weird. Either way, I suspect that the releases route won't succeed next time they update the versions.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@richardlau

richardlau commented Jun 8, 2023

Copy link
Copy Markdown
Member

The GH API is paginated and only returns a subset of results. For me at least the tags for 1.1.1 are on https://api.github.com/repos/quictls/openssl/tags?page=4.

Alternatively git/matching-refs API, e.g. https://api.github.com/repos/quictls/openssl/git/matching-refs/tags/OpenSSL_1_1_1 will return tags beginning with "OpenSSL_1_1_1".

marco-ippolito reacted with laugh emoji
All reactions
  • 😄 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@baparham

baparham commented Jun 8, 2023

Copy link
Copy Markdown

The GH API is paginated and only returns a subset of results. For me at least the tags for 1.1.1 are on https://api.github.com/repos/quictls/openssl/tags?page=4.

Alternatively git/matching-refs API, e.g. https://api.github.com/repos/quictls/openssl/git/matching-refs/tags/OpenSSL_1_1_1 will return tags beginning with "OpenSSL_1_1_1".

I need a facepalm reaction on github comments, haha. I did not catch that it was paginated, thanks for pointing that out! the matching_refs endpoint is probably better to use then.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito

marco-ippolito commented Jun 8, 2023

Copy link
Copy Markdown
Member Author

I've used matching ref but its a bit hacky wdyt?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

richardlau
richardlau reviewed Jun 8, 2023
View reviewed changes
Comment thread tools/dep_updaters/update-openssl.sh Resolved

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito marco-ippolito added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Jun 12, 2023
marco-ippolito added 3 commits June 12, 2023 09:39
@marco-ippolito
tools: automate update openssl v16
672d946
@marco-ippolito
fix: check tags instead of release for 3.0
4965803
@marco-ippolito
fix: use git ref
bd065ae
@marco-ippolito
marco-ippolito force-pushed the feat/automate-openssl-backport branch from 5e55dc6 to bd065ae Compare June 12, 2023 07:39
@marco-ippolito marco-ippolito added the commit-queue PRs queued for automated landing through the Commit Queue. label Jun 15, 2023
@nodejs-github-bot nodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Jun 15, 2023
@nodejs-github-bot

nodejs-github-bot commented Jun 15, 2023

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/48377
✔  Done loading data for nodejs/node/pull/48377
----------------------------------- PR info ------------------------------------
Title      tools:  automate openssl update on v16 (#48377)
Author     Marco Ippolito  (@marco-ippolito)
Branch     marco-ippolito:feat/automate-openssl-backport -> nodejs:main
Labels     meta, tools, author ready, commit-queue-squash
Commits    3
 - tools: automate update openssl v16
 - fix: check tags instead of release for 3.0
 - fix: use git ref
Committers 1
 - Marco Ippolito 
PR-URL: https://github.com/nodejs/node/pull/48377
Reviewed-By: Rafael Gonzaga 
Reviewed-By: Antoine du Hamel 
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/48377
Reviewed-By: Rafael Gonzaga 
Reviewed-By: Antoine du Hamel 
--------------------------------------------------------------------------------
   ⚠  Commits were pushed since the last approving review:
   ⚠  - tools: automate update openssl v16
   ⚠  - fix: check tags instead of release for 3.0
   ⚠  - fix: use git ref
   ℹ  This PR was created on Wed, 07 Jun 2023 12:36:03 GMT
   ✔  Approvals: 2
   ✔  - Rafael Gonzaga (@RafaelGSS) (TSC): https://github.com/nodejs/node/pull/48377#pullrequestreview-1467734115
   ✔  - Antoine du Hamel (@aduh95) (TSC): https://github.com/nodejs/node/pull/48377#pullrequestreview-1469308861
   ✔  Last GitHub CI successful
   ℹ  Green GitHub CI is sufficient
--------------------------------------------------------------------------------
   ✔  Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/5280129740
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

ShogunPanda
ShogunPanda approved these changes Jun 19, 2023
View reviewed changes
@marco-ippolito marco-ippolito added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Jun 19, 2023
@nodejs-github-bot nodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Jun 19, 2023
@nodejs-github-bot
nodejs-github-bot merged commit 51ca71c into nodejs:main Jun 19, 2023
@nodejs-github-bot

nodejs-github-bot commented Jun 19, 2023

Copy link
Copy Markdown
Collaborator

Landed in 51ca71c

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito marco-ippolito mentioned this pull request Jun 19, 2023
[v16.x] tools: automate update openssl v16 #48500
Closed
marco-ippolito added a commit to marco-ippolito/node that referenced this pull request Jun 19, 2023
@marco-ippolito
tools: automate update openssl v16
dd2a467
PR-URL: nodejs#48377
Reviewed-By: Rafael Gonzaga <[email protected]>
Reviewed-By: Antoine du Hamel <[email protected]>
Reviewed-By: Paolo Insogna <[email protected]>
RafaelGSS pushed a commit that referenced this pull request Jul 3, 2023
@marco-ippolito @RafaelGSS
tools: automate update openssl v16
6c59083
PR-URL: #48377
Reviewed-By: Rafael Gonzaga <[email protected]>
Reviewed-By: Antoine du Hamel <[email protected]>
Reviewed-By: Paolo Insogna <[email protected]>
@RafaelGSS RafaelGSS mentioned this pull request Jul 3, 2023
v20.4.0 proposal #48643
Merged
@kvakil kvakil mentioned this pull request Aug 3, 2023
deps: allow updating to openssl 3.1.x #49001
Closed
Ceres6 pushed a commit to Ceres6/node that referenced this pull request Aug 14, 2023
@marco-ippolito @Ceres6
tools: automate update openssl v16
2b9dcbb
PR-URL: nodejs#48377
Reviewed-By: Rafael Gonzaga <[email protected]>
Reviewed-By: Antoine du Hamel <[email protected]>
Reviewed-By: Paolo Insogna <[email protected]>
Ceres6 pushed a commit to Ceres6/node that referenced this pull request Aug 14, 2023
@marco-ippolito @Ceres6
tools: automate update openssl v16
492b94a
PR-URL: nodejs#48377
Reviewed-By: Rafael Gonzaga <[email protected]>
Reviewed-By: Antoine du Hamel <[email protected]>
Reviewed-By: Paolo Insogna <[email protected]>
@ruyadorno

ruyadorno commented Sep 10, 2023

Copy link
Copy Markdown
Member

This commit does not land cleanly on and will need manual backport in case we want it in v18.

marco-ippolito reacted with thumbs up emoji
All reactions
  • 👍 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@ruyadorno ruyadorno added the backport-requested-v18.x label Sep 10, 2023
@RafaelGSS RafaelGSS added dont-land-on-v18.x and removed backport-requested-v18.x labels Sep 10, 2023
@RafaelGSS

RafaelGSS commented Sep 10, 2023

Copy link
Copy Markdown
Member

@marco-ippolito is the backport needed for v18 and v20? I assume no, right? We just need to revert it for main to not land it on v21.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@marco-ippolito

marco-ippolito commented Sep 11, 2023 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member Author

I dont think it is needed since it will only run on main and then we can backport security patches. we can revert it since we dont support 16 anymore

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@richardlau richardlau richardlau left review comments
@ShogunPanda ShogunPanda ShogunPanda approved these changes
@UlisesGascon UlisesGascon UlisesGascon approved these changes
@aduh95 aduh95 aduh95 approved these changes
@RafaelGSS RafaelGSS RafaelGSS approved these changes
+1 more reviewer
@baparham baparham baparham left review comments
Reviewers whose approvals may not affect merge requirements

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

author ready PRs with CI started, the required approvals, and no outstanding review comments. commit-queue-squash PRs the Commit Queue should land as one squashed commit. meta Issues and PRs related to the general management of the project. tools Issues and PRs related to the tools directory.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

9 participants

@marco-ippolito @nodejs-github-bot @baparham @richardlau @ruyadorno @RafaelGSS @ShogunPanda @UlisesGascon @aduh95
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.