GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — Add TAP reporter by WayneNani · Pull Request #1305 · utPLSQL/utPLSQL

Conversation

@WayneNani

@WayneNani WayneNani commented Jul 31, 2025

Copy link
Copy Markdown
Contributor

I added a reporter for the Test Anything Protocol . It is easy to read for humans and machines alike and supported by a wide variety of consumers. These consumers can then aggregate test results from different projects or programming languages.

I tried to include all features from the latest TAP Specification as far as utPLSQL supports them (i.e., TODO tests are not supported in utPLSQL as far as I know).

I also added some test cases that should provide a decent coverage.

Please feel free to let me know if I can add anything else.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

MaikMichel, ogobrecht, and jgebal reacted with thumbs up emoji
All reactions
  • 👍 3 reactions
WayneNani added 20 commits July 10, 2025 13:16
@WayneNani
Added TAP reporter and synonyms
933f41a
@WayneNani
Larger variables to prevent failure during reporting
c5f07a7
@WayneNani
Added TAP Reporter to install script
4ed6837
@WayneNani
Add TAP to expected reporters
5e656fe
@WayneNani
Added simple test for TAP reporter
6f47bb9
@WayneNani
Added failing test for TAP
641ef7d
@WayneNani
Added erroring Test for TAP reporter
2500604
@WayneNani
Added test for disabled TAP test
9d765a4
@WayneNani
Added boilerplate expression for shorter tests
ef7f811
@WayneNani
Added skipped test with no reason
78cc772
@WayneNani
Add explicit spaces for correct indentation
1e78987
@WayneNani
Added test for multiple test outcomes in one go
ee22669
@WayneNani
Added serverout for beforetest procedures
55d5b61
@WayneNani
Included print of serverout as comment
e451e4b
@WayneNani
Added suite name escaping
fb9ef0b
@WayneNani
Included escaped test name
f18981d
@WayneNani
Included escaped skip reason
f1c0f86
@WayneNani
Added escaped comment test
33865dd
@WayneNani
Central use of comment procedure
a477d68
@WayneNani
Comments shouldn't escape special characters
2e399fd
@lwasylow

lwasylow commented Aug 1, 2025

Copy link
Copy Markdown
Member

Hi @WayneNani,
Thank you very much for creating this.
I'm on holiday currently so will look when I'm back, possibly @jgebal will be able earlier.

One thing could you please update the documentation reporters section with screens etc.?

Kind regards Lukasz

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@WayneNani
Added TAP reporter to documentation
3193f5b
@WayneNani

WayneNani commented Aug 2, 2025

Copy link
Copy Markdown
Contributor Author

Hey @lwasylow ,
thanks for the quick reply! I changed the documentation as well, thanks for the heads-up.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@WayneNani

WayneNani commented Nov 10, 2025

Copy link
Copy Markdown
Contributor Author

Hey @lwasylow and @jgebal ,

is there anything else I can do to streamline the process for you?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@sonarqubecloud

sonarqubecloud Bot commented Mar 8, 2026

Copy link
Copy Markdown

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jgebal

jgebal commented Mar 9, 2026

Copy link
Copy Markdown
Member

Hello @WayneNani

As you have probably noticed, the project was on pause for quite some time.
I am planning to give it a small refresh and so will aim to integrate your pull-request.

Will you be available to address the review comments (if any)?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@WayneNani

WayneNani commented Mar 9, 2026

Copy link
Copy Markdown
Contributor Author

Hey @jgebal,

I am happy to address any remarks you have.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jgebal jgebal self-assigned this Mar 15, 2026
jgebal
jgebal reviewed Mar 15, 2026
View reviewed changes
Comment thread test/ut3_user/reporters/test_tap_reporter.pkb Resolved

Uh oh!

There was an error while loading. Please reload this page.

@jgebal

jgebal commented Mar 15, 2026

Copy link
Copy Markdown
Member

@WayneNani
One of widely used elements of utPLSQL is nested suites (with suitepaths) and contexts within suite.

How would the TAP reporter show results of nested suites or suite with contexts?

I would expect the report to show it as a subtest according to the TAP specification.

Even it it is already implemented in this PR, it is not mentioned in documentation of reporter and it is not expressed in the tests.

I would expect reporter to support the Commented Subtests (those are recommended).

image
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

jgebal
jgebal reviewed Mar 15, 2026
View reviewed changes
Comment thread source/reporters/ut_tap_reporter.tpb Outdated
self.lvl := 0;
end;
end;
/ No newline at end of file

@jgebal jgebal Mar 15, 2026

Copy link
Copy Markdown
Member

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, it's probably better to leave an empty newline at the end of each file.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
jgebal
jgebal requested changes Mar 15, 2026
View reviewed changes
Comment thread test/ut3_user/reporters/test_tap_reporter.pks Resolved

Uh oh!

There was an error while loading. Please reload this page.

@jgebal

jgebal commented Mar 15, 2026

Copy link
Copy Markdown
Member

@WayneNani
The PR is clean and implementation is really nice.
Thank you for the contribution.
The only concerns is around support for nested suites and contexts.
It is be required to have that tested and documented.

Once this is done. We will include this change in next release (coming soon).

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

WayneNani added 4 commits March 16, 2026 10:49
@WayneNani
Added empty lines at the end
707fadd
@WayneNani
Added tests for contexts and suites
7ddbacc
@WayneNani
Added TAP subtests to documentation
3d38fbe
@WayneNani
Added test for including context when it only contains skipped tests
18af6b0
@WayneNani

WayneNani commented Mar 17, 2026

Copy link
Copy Markdown
Contributor Author

@jgebal Thanks for the review! You are right, I forgot to include tests regarding suites and contexts and have fixed that. I decided to use the existing reporters test package which comes with a suitepath and context and left the escaping test package nearly untouched.
I also included a test to still include the subtest even when it only consists of disabled tests.

jgebal reacted with thumbs up emoji
All reactions
  • 👍 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jgebal

jgebal commented Mar 19, 2026 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

Because our pipeline doesn't seem to work with external PRs anymore, I will pull and deploy your changes locally to take a look.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jgebal

jgebal commented Mar 19, 2026

Copy link
Copy Markdown
Member

@WayneNani
The PR looks really good.
Beautiful contribution tot he framework.

Thank you 👍

Starting with next release we will be only suppoorting DB 19c and above.

Hopefully you don't need the reporter for any unsupported version of Oracle.

WayneNani reacted with heart emoji
All reactions
  • ❤️ 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jgebal
jgebal merged commit 7ce1909 into utPLSQL:develop Mar 19, 2026
2 of 6 checks passed

Uh oh!

There was an error while loading. Please reload this page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jgebal jgebal jgebal requested changes

Uh oh!

There was an error while loading. Please reload this page.

Assignees

@jgebal jgebal

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

3 participants

@WayneNani @lwasylow @jgebal
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.