[Ltp-coverage] compare 2 trace files

[Roman Grigoryev-2]

Hi,

Is it any tool or way to compare 2 and more trace files? I want to sort
test on duplication level based on this comparison.

Thanks,
        Roman
______________________________________________________________________
This email may contain privileged or confidential information, which should only be used for the purpose for which it was sent by Xyratex. No further rights or licenses are granted to use such information. If you are not the intended recipient of this message, please notify the sender by return and delete it. You may not use, copy, disclose or rely on the information contained in it.
 
Internet email is susceptible to data corruption, interception and unauthorised amendment for which Xyratex does not accept liability. While we have taken reasonable precautions to ensure that this email is free of viruses, Xyratex does not accept liability for the presence of any computer viruses in this email, nor for any losses caused as a result of viruses.
 
Xyratex Technology Limited (03134912), Registered in England & Wales, Registered Office, Langstone Road, Havant, Hampshire, PO9 1SA.
 
The Xyratex group of companies also includes, Xyratex Ltd, registered in Bermuda, Xyratex International Inc, registered in California, Xyratex (Malaysia) Sdn Bhd registered in Malaysia, Xyratex Technology (Wuxi) Co Ltd registered in The People's Republic of China and Xyratex Japan Limited registered in Japan.
______________________________________________________________________
 


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Ltp-coverage mailing list
Ltp-coverage@...
https://lists.sourceforge.net/lists/listinfo/ltp-coverage

[Peter Oberparleiter-4]

Hi,

On 28.05.2012 09:54, Roman Grigoryev wrote:
> Is it any tool or way to compare 2 and more trace files? I want to sort
> test on duplication level based on this comparison.

There is no such tool that I know of. At one time someone posted a patch
to add something similar to lcov but integration of the functionality
stalled.

What you can do is add files and see if the resulting coverage changes.
If it does not change, the test that contributed to the most recently
added file does not add to the total coverage.


Regards,
   Peter Oberparleiter


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Ltp-coverage mailing list
Ltp-coverage@...
https://lists.sourceforge.net/lists/listinfo/ltp-coverage

[Roman Grigoryev-2]

On 05/29/2012 03:34 PM, Peter Oberparleiter wrote:

> Hi,
>
> On 28.05.2012 09:54, Roman Grigoryev wrote:
>> Is it any tool or way to compare 2 and more trace files? I want to sort
>> test on duplication level based on this comparison.
>
> There is no such tool that I know of. At one time someone posted a patch
> to add something similar to lcov but integration of the functionality
> stalled.
>
> What you can do is add files and see if the resulting coverage changes.
> If it does not change, the test that contributed to the most recently
> added file does not add to the total coverage.
>

Hmm.. Looks like this way give big overhead(and time consuming, f.e.
10^3 tests should  be 10^6-10^3 times compared) and don't shows
precision results where  tests are different (exclude case of generating
html report and parse it).

Is it good idea to write this functionality based on current lcov base?
I think, manipulating with only line coverage is good enough for this
task. How hard implement test1 - test2 and get result as number of lines
which covered by test 1 and don't covered by test 2 as trace file?

Thanks,
        Roman
______________________________________________________________________
This email may contain privileged or confidential information, which should only be used for the purpose for which it was sent by Xyratex. No further rights or licenses are granted to use such information. If you are not the intended recipient of this message, please notify the sender by return and delete it. You may not use, copy, disclose or rely on the information contained in it.
 
Internet email is susceptible to data corruption, interception and unauthorised amendment for which Xyratex does not accept liability. While we have taken reasonable precautions to ensure that this email is free of viruses, Xyratex does not accept liability for the presence of any computer viruses in this email, nor for any losses caused as a result of viruses.
 
Xyratex Technology Limited (03134912), Registered in England & Wales, Registered Office, Langstone Road, Havant, Hampshire, PO9 1SA.
 
The Xyratex group of companies also includes, Xyratex Ltd, registered in Bermuda, Xyratex International Inc, registered in California, Xyratex (Malaysia) Sdn Bhd registered in Malaysia, Xyratex Technology (Wuxi) Co Ltd registered in The People's Republic of China and Xyratex Japan Limited registered in Japan.
______________________________________________________________________
 


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Ltp-coverage mailing list
Ltp-coverage@...
https://lists.sourceforge.net/lists/listinfo/ltp-coverage

[Peter Oberparleiter-4]

Hi,

On 29.05.2012 14:34, Roman Grigoryev wrote:

> On 05/29/2012 03:34 PM, Peter Oberparleiter wrote:
>> Hi,
>>
>> On 28.05.2012 09:54, Roman Grigoryev wrote:
>>> Is it any tool or way to compare 2 and more trace files? I want to sort
>>> test on duplication level based on this comparison.
>>
>> There is no such tool that I know of. At one time someone posted a patch
>> to add something similar to lcov but integration of the functionality
>> stalled.
>>
>> What you can do is add files and see if the resulting coverage changes.
>> If it does not change, the test that contributed to the most recently
>> added file does not add to the total coverage.
>>
> Hmm.. Looks like this way give big overhead(and time consuming, f.e.
> 10^3 tests should  be 10^6-10^3 times compared) and don't shows
> precision results where  tests are different (exclude case of generating
> html report and parse it).

I agree that the mentioned approach may not be feasible for large
numbers of tests.

> Is it good idea to write this functionality based on current lcov base?
> I think, manipulating with only line coverage is good enough for this
> task. How hard implement test1 - test2 and get result as number of lines
> which covered by test 1 and don't covered by test 2 as trace file?

genhtml provides the option to specify a base file. If such a file is
specified, the resulting output shows execution counts as

        DATA - BASE

This is almost what you want:

        DATA - (BASE > 0 ? DATA : 0)

that should be a good starting point.


Regards,
   Peter


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Ltp-coverage mailing list
Ltp-coverage@...
https://lists.sourceforge.net/lists/listinfo/ltp-coverage