Filtering TOBIAS combinatorial test suites

4 downloads 23 Views 288KB Size Report
Software testing appears nowadays as one of the major techniques to evaluate .... test case initializes the bu ff er system, adds two elements and removes one of.

Filtering TOBIAS combinatorial test suites Y. Ledru, L. du Bousquet, O. Maury, P. Bontron Laboratoire Logiciels, Systèmes, Réseaux - IMAG B.P. 72 - F-38402 - Saint Martin d'Hères Cedex – France Yves.Ledru, [email protected] Abstract TOBIAS is a combinatorial testing tool, aimed at the production of large test suites. In this paper, TOBIAS is applied to conformance tests for model-based specifications (expressed with assertions, pre and post-conditions) and associated implementations. The tool takes advantage of the executable character of VDM or JML assertions which provide an oracle for the testing process. Executing large test suites may require a lot of time. This paper shows how assertions can be exploited at generation time to filter the set of test cases, and at execution time to detect inconclusive test cases. Keywords: combinatorial testing, model-based specifications, VDM, JML Y. Ledru, L. du Bousquet, O. Maury, and P. Bontron. Filtering TOBIAS combinatorial test suites. In Proceedings of ETAPS/FASE’04 - Fundamental Approaches to Software Engineering, pp. 281-294, Vol. 2984 of LNCS, Springer-Verlag, Barcelona, 2004

LNCS proceedings are available at : http://www.springer.de/comp/lncs/index.html

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. ©2004 Springer-Verlag. The copyright for this contribution is held by Springer.

    "!# $%& $&')(*(,+-.( /%0213)451687:[email protected]%689#CED2983:FG981HI;[email protected][email protected]7 MONP987Q>G;8R@L17Q7:1&CED2SGHQ7:D2S T=UWV8XYQU Z[X\]YQ^%T_XI`W\ba:\b^:cbdegfihid[Z^j k%^de?ln^om d[^UWp?qsrutwvyx{z |E} ~}8 € r_rƒ‚ „I… †‡€ˆr fiUW\]‰2Z{vyUWYQZŠ\]‰‹8Œ )^:j YQ^d{Ž^‹2^q%rYQU‰Gao^ W‘i’2“i”•[–i“ —i˜ ™5š%› œi—8“•Š— ™2žWŸ? ™?”W¡ ™?“¢2£ ¤G¦¥?§ ¨g•Š© ˜ ¬ª «_­®¯°2±i® ²%³{´E| tµx fs\bd)UnaXIkˆV2\]‰GUIZ[XWY[\bUc Z[^d[ZŠ\]‰?`yZ[XiXWcµe=UW\bk%^o‹¶UIZ ZŠ·G^)¸YQXr ‹ipGaZŠ\bX‰¹Xº,cbUYQ` ^yZ[^d[Z)dŠp2\bZ[^d}-t»‰¼ZŠ·\bd)¸GU¸8^:YenD2SAKB> ë=1yH:D2HNiKLKL>Oä29=NP7oNPS?H:116¹ëG>¶âƒD27:çêNiKå87:DGDiâo;1Wï?æ_Ni983:[email protected]:13QH:@BSAä¼D7¬N#éDçyë[email protected]=NiH:@BDS#Diâ ë=DHQænHQ1éæ[email protected]îGð)SÍâƒD27:HQ98S=NPHQ1KL>G; 3Q98éæH:1éæ[email protected]3 Ni7:1 DiâƒH:1Sy0217:>¬[email protected]ñéW98KLH-H:D&Niå8å8KL>Gî ò[Só3:98éæôé Ni3Q1W3I; H:13QH:@LS8ä¹çêN >OéWD2SGHQ7:@BëA98HQ1#HQDõ@LS8é7:1INi3:1êH:æ81#éD2SÍì=681S8éW1OHQæ=NPHyHQæ81#@Lçyö å8KL1ç1WS?HNiH:@BDS&éDSGâƒD27:ç3 H:[email protected]å_1é@íì=é[email protected]*î8÷ED2SGì=6A1S8é1.çêN >&7:13Q98KLH,âƒ7QDçøéDi0217Niä1 ç1INP3Q987:1ç1WS?H:3I;Aâƒ7:D2çùHQæA1yå[email protected]é@Lå8KL13sDiâ{H:æ81yHQ13:H&3Q>GSGHQæA1[email protected]%3Q1KL1é[email protected]¹H:1éæ[email protected]; âƒ7QDçúHQæA1Ä3:@Lû1&DiâHQæ81sHQ13:H [email protected];8D27EâŠ7QD2çÉHQæ81&1Wï?å_17:[email protected]âHQæ81%HQ1W3QH)1WS8ä[email protected]1W7Q3Iî ò[S868983:[email protected]µNPK81ïGå[email protected]ç1SGH:3½ü]ý‡þ=æ=N 021E3QæADiã S¬H:æ=NiH H:13QH,éINi3:13{ã @LH:æ[email protected]¬N.K»NP7Qä1{H:1[email protected]:1 DiâƒH:1S¾âƒ1INPHQ987:1ÿNnæ[email protected]äæêKL101KGî2MONPSG>HQ1W3QH)é Ni3Q1W3ÄéWD27Q7:13Qå_D2SA6¹HQDyHQæA1&3oNPç1 3Q1FG981WS8é1nDiâ ç1H:æ8DG6éINPKLKB3 ;Gã @LHQæ#[email protected] g1W7Q1SGH%å=Ni7Niç¾1HQ17:3Iî8R7:DG6898é@LS8ä¾HQæ813:1¬H:13QH.éINi3:13 @L3½Nn7:1å[email protected]@L021sHoNi3 H:æ=NiH 7:1021INPKL3 HQæ81%S811W6#âƒD27)NPå8å87:D2å87:@»NPHQ1%HQDGDK3Q98å8å_D27:HIî 87:D2çH:æ813Q1õD2ëA3Q17:[email protected]S83I;,ã{1#æ=N 01O68101KLD2å_16 HQæA1 )J.CEò á HQ13:Hä1S817NiHQD7 ã æ[email protected]éæ¼@[email protected]ç1W6¼NiH%HQæA1yå87QDG6898é[email protected]¹DPâˆN¾KµNi7:ä21n3Q1H&DPâ½3:@Lç@LKµNi7 HQ1W3QH&éINP3Q13 î )J.C{ò á 3QHNi7QH:3 âƒ7:D2çùNnHQ13:H%å=NiH:HQ17:S¼NiS86õNn6813Qé[email protected]å[email protected]SODiâ @[email protected]@µNiH:@BDS83Iî æA1&HQDGD2K*HQæ81WS 98SGâƒDKL683{H:æ81%å=NiH:HQ17:[email protected]»NP7Qä1)3Q1WH)DiâHQ13:H)éINP3Q13.ã æ[email protected]éæêé NiS#ë=1%D98HQå89AH)NiééD[email protected]ä HQDnHQæ81.âƒD7Qç#NiH DPâ-3Q1W0217NiKGå[email protected]éINiK1WïÍNPçå8KL1.Diâ-éWD2çyë[email protected]=NPHQD27:@µNiK8H:13QH:@BSAäyHQDGD2K[îGò[HQ3 D[email protected]ä[email protected][email protected][>[email protected] HQD%681INPKGã @BH:æ¬3:1FG981S8éW13 Diâç1H:æ8DG6&éINPKBKL3 ;[email protected]:HQ1INP6yDiâ=DS8KL>&éDçyë[email protected]=NiH:@BDS)DPâgå=NP7oNPç1H:17 02NiKL9813 î æ[email protected] NiKLKLDiã 3-H:D&983:1ÄH:æ81)H:DGD2K8ã @LHQæ¾3Q>G3QH:1ç3,HQæ=NPH{7:1[email protected])3:1021W7oNiK@LSGHQ1W7oNié[email protected] ë=1ÔâƒD27:1¬7:1INiéæ[email protected]ä#3QDç 1 :@LS?H:1[email protected]ä #3QHoNPHQ13 îò[H&NiKL3QD#NiKLKLDiã 3 HQD#6813:@Lä2SõHQ13:H&éINi3:1[email protected] HQ17:ç3EDiâHQæ81&ë_1æ=N [email protected] H:æ=NiH æ_Ni3 HQDnë_1&1ïG17Qé[email protected]:16?3:HQ1çõ; Ni686A3¬H[ãED¼1WKB1Wç1SGHQ3yNiSA6ô7:1çDi013&DS81#Diâ HQæ81Wç¼î  , =¢  2 3 —i-— )  2 < “W¥?  ’2“  Niéæ¹D2å_17[email protected]S¼éINPKLK çêN >¾KB1 Ni6¹HQDON ~8x f2f ; x½twT D27 t ½Ž ´ ŽQT ½ftµÇEË 01[email protected]éWHIî )3%3QDGDS NP3ÃN x½twT D27 t ½Ž ´ ŽQT ½ftµÇEË [email protected]éH&æ_Niå8å_1S83 ;ã{1yéæ8DGD3Q1yHQD¾3QH:D2å¹HQæA1 HQ13:H éINi3:1%1ïG1é98H:@BDSêNPS86ç#Ni7 [email protected]{ã @LH:æyHQæ[email protected]7:[email protected]éHIî H:13QH éINP3Q1%HQæ[email protected]é[email protected]6#D98H éD2ç¾å8KL1HQ1WKB>n7Q1Wé1@L0213&N ~8x f2f 01[email protected]éWHIî 8D7&1ï8Niç¾å8KL12;[email protected]¹H:æ81éWD2SGHQ1ïGHnDiâ)H:æ81Nië_Di021y3:å=1é[email protected]ì_éINiH:@BDS@@ î æA1Äå_NiHQH:17QS * @L3 98SGâƒDKL6816@LSGHQDyýnHQ1W3QH)3:1FG981S8éW13  ž   , =-¢  2 3 —i-—   ž  , =-¢  2 3 —i-— )  •i•i•  ž #  , =-¢  2 3 —i-— )# %7QD98å83nçêN >¼NPKB3:[email protected]1y3Q1017oNPK D2å_1[email protected] î 41H + iN S86 + ë_1H[ãED¼DHQæ817 1ï8Niç¾å8KL13 Diâ 3:éoæA1çêNP3 %



>@[email protected]/),+.-



 



%

%



 %   % ++ 0

7 9 ;3=CB6F 'K@@@CB  b F  54 76 c 8 /8V/8  8 .:: K@@[email protected] 2 2 HIOJKL-I

ã @LHQæ

:ý b c  V ý @L3¬N#3:1H¬DPâ bŠý `5 c [email protected]:HoNiSGH:@»[email protected]î æ81y1Wï?åA7Q13:[email protected] *  +  ç1INPS83 [email protected] ; HQæ=NPH)H:æ81&ä27:D298å¶@B3.7Q1å_1INPHQ16 &H:D yH:@Lç13 î æ81¬å_NiHQH:17QSA3 + NiS86 +   NP7Q1n98SGâƒDKL6816 @LS?H:D `Mb] ) c &H:13QH.3Q1FG981WS8é13  iž   , =¢- 2 3 —i-—  •i•i•  iž   , =¢- 2 < “W¥?  ’2“ )#  iž   , =-¢  2 3 —i-—  2 3 —i-—  •i•i•  iž   , =-¢  2 < “W¥?  ’2“ )# 2 < “W¥?  ’2“ )# žižižižižižižižiž žižIžižiž žiž žižižIžižiž  !ƒž   , =-¢  2 3 —i-— )  2 3 —i-—  •i•i•  !ƒž   , =-¢  2 3 —i-— )  2 < “W¥?  ’2“ )# 2 < “W¥?  ’2“ )# %7QD98å¹681ì[email protected]@LD2S83yç#N >Oë_1ê7:1983:16@BS'3Q1017oNPK)3:éoæA1çêNP3I;*KB1 [email protected]äõHQDõ3QDç1yKL1021WK Diâ çDG6898KµNP7 éD2SA3QHQ7:98éH:@BDS

Suggest Documents