Description

alisevych

opened on Sep 28, 2022

Issue body actions

Description

Test generation timeout is exceeded 15 sec approximately for every UTBot run.

To Reproduce

1. Run the 'UTBotJava' project in IntelliJ Idea 2022.1.4
2. Install one of the latest from main branch
3. Open test generation dialog for utbot-sample/src/main/java/org/utbot/examples/algorithms/ArraysQuickSort.java for example
4. Set test generation timeout to 20 sec.
5. Check when test generation finishes.

Expected behavior

Tests are supposed to be generated during the defined timeout of 20 sec.

Actual behavior

Tests are generation for about 30-35 sec. (on the exact PC)

Environment

Windows 10 Pro
RAM 32.0 GB
Processor Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz 3.60 GHz
IntelliJ IDEA 2022.1.4
Heap memory allocated for IDEA is 2 GB

Additional context

If test generation timeout is set to 60 sec, test generation continues for 75 sec approx.

As discussed with @sergeypospelov and @Markoutte :
Summaries generation and Code generation is not taken into account.
Though currently some of them seems to take much time.
Investigation is needed.

Activity

1. alisevych

   added

   ctg-bugIssue is a bugIssue is a bug

   on Sep 28, 2022
2. korifey

   added this to UTBot Javaon Sep 28, 2022
3. korifey

   moved this to Todo in UTBot Javaon Sep 28, 2022
4. alisevych

   added

   status-help-wantedExtra attention is neededExtra attention is needed

   on Sep 28, 2022
5. alisevych

   added this to the 2022.10.1 Release milestone on Oct 7, 2022
6. alisevych

   assigned

   denis-fokin

   on Oct 10, 2022
7. alisevych commented on Oct 10, 2022

   

   alisevych

   on Oct 10, 2022

   MemberAuthor

   More actions

   Reproducing on one of the latest builds from main - unit-test-bot/rc10102022

   ArraysQuickSort

   Test generation timeout was set to 20 sec. Progress-bar was running up to the end during 20 sec.
   Then after 15-17 seconds the test class was created.

   ArrayCastExample

   Test generation timeout was set to 60 sec. Progress-bar was running up to the end during 20 sec.
   Then after 15 seconds the test class was created.

   Heap

   Test generation timeout was set to 20 sec. Progress-bar was running up to the end during 20 sec.
   Then after 50-55 seconds more the test class is created. Checked twice.
8. alisevych commented on Oct 10, 2022

   

   alisevych

   on Oct 10, 2022

   MemberAuthor

   More actions

   For testability:
   it would be great to add info log records for different phases of UnitTestBot test generation.

   • Test generation initiated
   • Collecting information (classes)
   • Fuzzing phase
   • Symbolic analysis phase
   • Minimization
   • Summaries
   • Code generation
9. alisevych

   changed the title [-]Test generation timeout is exceeded 15 sec. approx. for every run[/-] [+]Test generation timeout is exceeded 15 sec - 1 min for every run[/+] on Oct 10, 2022
10. alisevych

    assigned

    Vassiliy-Kudryashov

    and

    alisevych

    and unassigned

    denis-fokin

    and

    Vassiliy-Kudryashov

    on Oct 10, 2022
11. alisevych

    added

    status-verifiedBug fix is verifiedBug fix is verified

    and removed

    status-help-wantedExtra attention is neededExtra attention is needed

    on Oct 17, 2022
12. alisevych commented on Oct 17, 2022

    

    alisevych

    on Oct 17, 2022

    MemberAuthor

    More actions

    The issue was fixed by #1151
    Verified it on build from the latest main.
13. alisevych

    closed this as completedon Oct 17, 2022
14. Repository owner moved this from Todo to Done in UTBot Javaon Oct 17, 2022

Issue actions