RobotFramework: Aggregate report by grouping test suites using Rebot

Question

I have a test suite "my_test_suite.robot" like this:

*** Test Cases ***
Test Case 1
    Log  Test 1

Test Case 2
    Log  Test 2

Then I run the pybot command twice as like this:

pybot --timestampoutputs my_test_suite.robot

So I get the reports two times. Now after that I ran the rebot command as follows:

rebot --name RebotCombined *.xml

It produced the neat combined report.html file where the high-level test suite is RebotCombined and two child test suites with the same name as "My Test Suite". i.e.,

RebotCombined
|
--- My Test Suite
|   |
|   --- Test Case 1
|   --- Test Case 2
--- My Test Suite
|   |
|   --- Test Case 1
|   --- Test Case 2

But what I was expecting is:

RebotCombined
|
--- My Test Suite
|   |
|   --- Test Case 1
|   --- Test Case 1
|   --- Test Case 2
|   --- Test Case 2

How can I achieve this?

In your scenario you're running Test Case 1 twice. However, in the "what I was expecting" section you show the test case listed only once. How does rebot decide which test case to show in the merged report? Or do you actually expect to see Test Case 1 twice in the merged report? — Bryan Oakley
– Bryan Oakley, Commented Oct 6, 2014 at 15:45
Sorry @BryanOakley, did a mistake in the output. Now update it. — Vimalraj Selvam
– Vimalraj Selvam, Commented Oct 6, 2014 at 15:50

Bryan Oakley · Accepted Answer · 2014-10-06 15:29:40Z

1

Short answer: you can't. Rebot merely creates a new top-level suite and makes each output.xml file a child of that new top-level suite. It doesn't do any merging of data beyond that, except for updating the statistics.

All of the command line options for rebot are in the section Command line options for post-processing outputs in the user guide. It doesn't show any options that would give you the output you desire.

answered Oct 6, 2014 at 15:29

Bryan Oakley

389k53 gold badges582 silver badges739 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Vimalraj Selvam Over a year ago

Thanks Bryan, it seems that this feature is going to be a part of RF 2.9. (github.com/robotframework/robotframework/issues/1687)

Bryan Oakley Over a year ago

@Vimal: possibly. It's not clear how that issue will handle the same test being run twice; it looks to be more about merging different subsets of tests.

Vimalraj Selvam Over a year ago

Is there anyway to change the test case name during run time? So in my scenario, I want to change my Test Case 1 to Test Case 1_1. But it should happen during run time.

Bryan Oakley Over a year ago

@Vimal: no, there is not.

Pekka Klärck Over a year ago

We implemented issue #1687 mentioned above in RF 2.8.6. It does't alone provide functionality needed to support this use case, though, because tests with same name will be merged together when using --merge. Adding a separate cli option to control this behavior would be possible, however, so please submit a separate issue (preferably with a pull request) if you consider this important.

Collectives™ on Stack Overflow

RobotFramework: Aggregate report by grouping test suites using Rebot

1 Answer 1

5 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

5 Comments

Your Answer

Sign up or log in

Post as a guest

Related