GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — gh-97923: Always run Ubuntu SSL tests with others in CI by sobolevn · Pull Request #97940 · python/cpython

Conversation

@sobolevn

@sobolevn sobolevn commented Oct 5, 2022 •
edited by bedevere-bot
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

Now Ubuntu SSL tests will be run whenever other tests are run.
But, it will still ignore doc only changes (as it is now).

  • Issue: Run SSL tests on each CI run #97923

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@sobolevn
pythongh-97923: Always run Ubuntu SSL tests with others in CI
37d4f5e
@bedevere-bot bedevere-bot added the awaiting review label Oct 5, 2022
@sobolevn sobolevn added the skip news label Oct 5, 2022
@sobolevn
sobolevn requested review from gvanrossum and tiran October 5, 2022 22:44
gvanrossum
gvanrossum reviewed Oct 5, 2022
View reviewed changes

@gvanrossum gvanrossum left a comment

Copy link
Copy Markdown
Member

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm sorry, but I don't know what these rules do. Hopefully there's another reviewer you can add (IIRC @tiran is offline this week).

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

sobolevn reacted with thumbs up emoji
All reactions
  • 👍 1 reaction
@sobolevn
sobolevn requested a review from pablogsal October 6, 2022 08:21
@vstinner

vstinner commented Oct 6, 2022

Copy link
Copy Markdown
Member

Please try to fix the issue below on the OpenSSL jobs before merging this PR:

1 test altered the execution environment:
    test_asyncio
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@sobolevn

sobolevn commented Oct 6, 2022

Copy link
Copy Markdown
Member Author

Please try to fix the issue below on the OpenSSL jobs before merging this PR:

Sorry, but I don't know what is going on there, as far as I understand it is a work-in-progress by @arhadthedev

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@arhadthedev

arhadthedev commented Oct 6, 2022

Copy link
Copy Markdown
Member

Thank you, I'll dig into it in two hours.

To find the reason, I need to teach the data supplier of this code:

cpython/Lib/test/libregrtest/main.py

Lines 399 to 403 in 0ff7b99

if self.environment_changed:
print()
print("{} altered the execution environment:".format(
count(len(self.environment_changed), "test")))
printlist(self.environment_changed)

to trigger after individual test cases, not between suit files.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@arhadthedev

arhadthedev commented Oct 6, 2022

Copy link
Copy Markdown
Member

@vstinner Could you link to the log please? It looks like a misunderstanding because I looked into the checks for this PR and there're other results:

  • https://github.com/python/cpython/actions/runs/3193195105/jobs/5211517211#step:6:921 (Windows (x64)):

    2 tests altered the execution environment:
        test_distutils test_peg_generator
    
    [...]
    
    Tests result: FAILURE then SUCCESS
    
  • https://github.com/python/cpython/actions/runs/3193195105/jobs/5211516860#step:17:674 (Ubuntu):

    == Tests result: SUCCESS ==
    
    426 tests OK.
    
    10 slowest tests:
    - test_tools: 6 min
    - test_multiprocessing_spawn: 4 min 41 sec
    - test_concurrent_futures: 2 min 49 sec
    - test_multiprocessing_fork: 2 min 7 sec
    - test_asyncio: 1 min 48 sec
    - test_gdb: 1 min 34 sec
    - test_multiprocessing_forkserver: 1 min 33 sec
    - test_venv: 1 min 23 sec
    - test_signal: 1 min 3 sec
    - test_buffer: 52.4 sec
    
    11 tests skipped:
        test_devpoll test_ioctl test_kqueue test_launcher test_msilib
        test_startfile test_winconsoleio test_winreg test_winsound
        test_wmi test_zipfile64
    
    Total duration: 11 min 57 sec
    Tests result: SUCCESS
    

I also tried to reproduce it locally on Windows 10 21H2 using main (6d0a019). An output of pcbuild\clean && pcbuild\build && python -m test -v test_asyncio:

[...]

Ran 2010 tests in 111.019s

OK (skipped=64)
test_asyncio passed in 1 min 54 sec

== Tests result: SUCCESS ==

1 test OK.

Total duration: 1 min 56 sec
Tests result: SUCCESS
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@arhadthedev arhadthedev mentioned this pull request Oct 7, 2022
gh-97983: Revert "Lay the foundation for further work in asyncio.test_streams: port server cases to IsolatedAsyncioTestCase" #98015
Merged
gvanrossum pushed a commit that referenced this pull request Oct 7, 2022
@arhadthedev
gh-97983: Revert "Lay the foundation for further work in asyncio.test…
f99bb20
…_streams: port server cases to IsolatedAsyncioTestCase" (#98015)

This PR reverts gh-93369 and gh-97896 because they've made asyncio tests unstable. After these PRs were merged, random GitHub action jobs of random commits started to fail unrelated tests and test framework methods.

The reverting is necessary because such shrapnel failures are a symptom of some underlying bug that must be found and fixed first.

I had a hope that it's a server overload because we already have extremely rare disc access errors. However, one and a half day passed, and the failures continue to emerge both in PRs and commits.

Affected issue: gh-93357.
First reported in #97940 (comment).

* Revert "gh-93357: Port test cases to IsolatedAsyncioTestCase, part 2 (#97896)"

This reverts commit 09aea94.

* Revert "gh-93357: Start porting asyncio server test cases to IsolatedAsyncioTestCase (#93369)"

This reverts commit ce8fc18.
@ambv
ambv merged commit 3108fc1 into python:main Oct 7, 2022
@bedevere-bot bedevere-bot removed the awaiting review label Oct 7, 2022
carljm added a commit to carljm/cpython that referenced this pull request Oct 8, 2022
@carljm
Merge branch 'main' into typewatch
27a4980
* main: (38 commits)
  pythongh-92886: make test_ast pass with -O (assertions off) (pythonGH-98058)
  pythongh-92886: make test_coroutines pass with -O (assertions off) (pythonGH-98060)
  pythongh-57179: Add note on symlinks for os.walk (python#94799)
  pythongh-94808: Fix regex on exotic platforms (python#98036)
  pythongh-90085: Remove vestigial -t and -c timeit options (python#94941)
  pythonGH-83901: Improve Signature.bind error message for missing keyword-only params (python#95347)
  pythongh-61105: Add default param, note on using cookiejar subclass (python#95427)
  pythongh-96288: Add a sentence to `os.mkdir`'s docstring. (python#96271)
  pythongh-96073: fix backticks in NEWS entry (pythonGH-98056)
  pythongh-92886: [clinic.py] raise exception on invalid input instead of assertion (pythonGH-98051)
  pythongh-97997: Add col_offset field to tokenizer and use that for AST nodes (python#98000)
  pythonGH-88968: Reject socket that is already used as a transport (python#98010)
  pythongh-96346: Use double caching for re._compile() (python#96347)
  pythongh-91708: Revert params note in urllib.parse.urlparse table (python#96699)
  pythongh-96265: Fix some formatting in faq/design.rst (python#96924)
  pythongh-73196: Add namespace/scope clarification for inheritance section (python#92840)
  pythongh-97646: Change `.js` and `.mjs` files mimetype to conform to RFC 9239 (python#97934)
  pythongh-97923: Always run Ubuntu SSL tests with others in CI (python#97940)
  pythongh-97956: Mention `generate_global_objects.py` in `AC How-To` (python#97957)
  pythongh-96959: Update HTTP links which are redirected to HTTPS (python#98039)
  ...
mpage pushed a commit to mpage/cpython that referenced this pull request Oct 11, 2022
@arhadthedev @mpage
pythongh-97983: Revert "Lay the foundation for further work in asynci…
e75ada1
…o.test_streams: port server cases to IsolatedAsyncioTestCase" (python#98015)

This PR reverts pythongh-93369 and pythongh-97896 because they've made asyncio tests unstable. After these PRs were merged, random GitHub action jobs of random commits started to fail unrelated tests and test framework methods.

The reverting is necessary because such shrapnel failures are a symptom of some underlying bug that must be found and fixed first.

I had a hope that it's a server overload because we already have extremely rare disc access errors. However, one and a half day passed, and the failures continue to emerge both in PRs and commits.

Affected issue: pythongh-93357.
First reported in python#97940 (comment).

* Revert "pythongh-93357: Port test cases to IsolatedAsyncioTestCase, part 2 (python#97896)"

This reverts commit 09aea94.

* Revert "pythongh-93357: Start porting asyncio server test cases to IsolatedAsyncioTestCase (python#93369)"

This reverts commit ce8fc18.
mpage pushed a commit to mpage/cpython that referenced this pull request Oct 11, 2022
@sobolevn @mpage
pythongh-97923: Always run Ubuntu SSL tests with others in CI (python…
dc2c10e
…#97940)
@kumaraditya303 kumaraditya303 mentioned this pull request Nov 29, 2022
Run SSL tests on each CI run #97923
Closed
@koshaji koshaji mentioned this pull request Jul 10, 2026
fix(oneshot): shut down memory provider to prevent SIGABRT on exit NousResearch/hermes-agent#61875
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gvanrossum gvanrossum gvanrossum left review comments
@tiran tiran Awaiting requested review from tiran
@pablogsal pablogsal Awaiting requested review from pablogsal

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

skip news

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

6 participants

@sobolevn @vstinner @arhadthedev @gvanrossum @ambv @bedevere-bot
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.