www.digitalmars.com         C & C++   DMDScript  

digitalmars.D.bugs - DMD-0.151 regressions

reply Thomas Kuehne <thomas-dloop kuehne.cn> writes:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

155 new regressions
PASS -> ERROR: run/c/catch_05_A.d
FAIL -> ERROR: run/c/catch_05_A.d (-g)
PASS -> ERROR: run/c/catch_05_A.d (-inline)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-O)
PASS -> ERROR: run/c/catch_05_A.d (-release)
FAIL -> ERROR: run/c/catch_05_A.d (-g -inline)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-g -O)
FAIL -> ERROR: run/c/catch_05_A.d (-g -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-inline -O)
PASS -> ERROR: run/c/catch_05_A.d (-inline -release)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-O -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_A.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC -O -release)
FAIL -> ERROR: run/c/catch_05_B.d
FAIL -> ERROR: run/c/catch_05_B.d (-g)
FAIL -> ERROR: run/c/catch_05_B.d (-inline)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-O)
FAIL -> ERROR: run/c/catch_05_B.d (-release)
FAIL -> ERROR: run/c/catch_05_B.d (-g -inline)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-g -O)
FAIL -> ERROR: run/c/catch_05_B.d (-g -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-inline -O)
FAIL -> ERROR: run/c/catch_05_B.d (-inline -release)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-O -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_B.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d
PASS -> ERROR: run/c/catch_05_E.d (-g)
PASS -> ERROR: run/c/catch_05_E.d (-inline)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-O)
PASS -> ERROR: run/c/catch_05_E.d (-release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-g -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-inline -O)
PASS -> ERROR: run/c/catch_05_E.d (-inline -release)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-O -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d
FAIL -> ERROR: run/c/catch_05_F.d (-g)
PASS -> ERROR: run/c/catch_05_F.d (-inline)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-O)
PASS -> ERROR: run/c/catch_05_F.d (-release)
FAIL -> ERROR: run/c/catch_05_F.d (-g -inline)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-g -O)
FAIL -> ERROR: run/c/catch_05_F.d (-g -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-inline -O)
PASS -> ERROR: run/c/catch_05_F.d (-inline -release)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-O -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_F.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC -O -release)
FAIL -> ERROR: run/c/catch_05_H.d
FAIL -> ERROR: run/c/catch_05_H.d (-g)
FAIL -> ERROR: run/c/catch_05_H.d (-inline)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-O)
FAIL -> ERROR: run/c/catch_05_H.d (-release)
FAIL -> ERROR: run/c/catch_05_H.d (-g -inline)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-g -O)
FAIL -> ERROR: run/c/catch_05_H.d (-g -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-inline -O)
FAIL -> ERROR: run/c/catch_05_H.d (-inline -release)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-O -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_H.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC -O -release)

Summary: (392K)
http://dstress.kuehne.cn/www/dstress.html

Details: (650K)
http://dstress.kuehne.cn/www/dmd-0.151.html

Log: (1.2M)
http://dstress.kuehne.cn/raw_results/linnux-amd64_dmd-0.151.log.gz

Thomas


-----BEGIN PGP SIGNATURE-----

iD4DBQFEM1/Y3w+/yD4P9tIRAuJbAJY/YX8bttrMUNQEYBJ/FuujTGBEAJ93asI9
PDYIaBZBtJCZyQA45uBlVA==
=+u3I
-----END PGP SIGNATURE-----
Apr 04 2006
parent reply Stewart Gordon <smjg_1998 yahoo.com> writes:
I've finally updated my statistics file for the first time in ages!

http://pr.stewartsplace.org.uk/d/dstress.xls

Success rate up from 63.2% to 63.5%
(best 64.6% DMD 0.113)

Stability rate up from 97.3% to 97.7%

There seems to have been a surge of error results between 0.138 and 
0.144 - weird.  The regression report for 0.138 doesn't show any such 
surge.  Have the numbers become mixed up?

Stewart.

-- 
-----BEGIN GEEK CODE BLOCK-----
Version: 3.1
GCS/M d- s:-  C++  a->--- UB  P+ L E  W++  N+++ o K-  w++  O? M V? PS- 
PE- Y? PGP- t- 5? X? R b DI? D G e++++ h-- r-- !y
------END GEEK CODE BLOCK------

My e-mail is valid but not my primary mailbox.  Please keep replies on 
the 'group where everyone may benefit.
Apr 06 2006
parent reply Thomas Kuehne <thomas-dloop kuehne.cn> writes:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Stewart Gordon schrieb am 2006-04-06:
 There seems to have been a surge of error results between 0.138 and 
 0.144 - weird.  The regression report for 0.138 doesn't show any such 
 surge.  Have the numbers become mixed up?
0.138 introduced "-fPIC" (neither documented in the changelog nor in DMD's help message, but listed on http://www.digitalmars.com/d/html/d/dcompiler.html) See also: http://www.digitalmars.com/d/changelog.html#new0145 The numbers are correct - compare the summaries from http://dstress.kuehne.cn/www/dmd-0.137.html and http://dstress.kuehne.cn/www/dmd-0.138.html Thomas -----BEGIN PGP SIGNATURE----- iD8DBQFENUt73w+/yD4P9tIRAl3SAJ9igXKBQzo2+wZfXivwib8ETtx+hACeKjHa 8dIA+o3OIhCg2dKeFYOnYWQ= =pAA1 -----END PGP SIGNATURE-----
Apr 06 2006
next sibling parent reply Stewart Gordon <smjg_1998 yahoo.com> writes:
Thomas Kuehne wrote:
 -----BEGIN PGP SIGNED MESSAGE-----
 Hash: SHA1
 
 Stewart Gordon schrieb am 2006-04-06:
 There seems to have been a surge of error results between 0.138 and 
 0.144 - weird.  The regression report for 0.138 doesn't show any such 
 surge.  Have the numbers become mixed up?
0.138 introduced "-fPIC" (neither documented in the changelog nor in DMD's help message, but listed on http://www.digitalmars.com/d/html/d/dcompiler.html)
<snip> I see. But what does "position independent code" mean?
 The numbers are correct - compare the summaries from
 http://dstress.kuehne.cn/www/dmd-0.137.html and
 http://dstress.kuehne.cn/www/dmd-0.138.html
Looking at 0.138, the lowest number of passes is 1299, but you've taken 1304 as the figure for that version. Time to investigate the formula.... Stewart. -- -----BEGIN GEEK CODE BLOCK----- Version: 3.1 GCS/M d- s:- C++ a->--- UB P+ L E W++ N+++ o K- w++ O? M V? PS- PE- Y? PGP- t- 5? X? R b DI? D G e++++ h-- r-- !y ------END GEEK CODE BLOCK------ My e-mail is valid but not my primary mailbox. Please keep replies on the 'group where everyone may benefit.
Apr 06 2006
parent Thomas Kuehne <thomas-dloop kuehne.cn> writes:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Stewart Gordon schrieb am 2006-04-06:
 Thomas Kuehne wrote:
 Stewart Gordon schrieb am 2006-04-06:
<snip>
 I see.  But what does "position independent code" mean?
from GCC's man page:
 -fPIC
	If supported for the target machine, emit position-independent
	code, suitable for dynamic linking and avoiding any limit on the
	size of the global offset table. 
<snip>
 Looking at 0.138, the lowest number of passes is 1299, but you've taken 
 1304 as the figure for that version.  Time to investigate the formula....
You are looking at revision 1108 (2006-03-21) instead of the current 1133 (2006-04-05) one. The formula looks for the worst test result of each test case. Naturaly "untested" isn't considered a bad result. There are 44 untested cases in the "-g -fPIC -O" configuration, thus the highest possible number of global passes could have been 1343 (1299+44). 1343 >= 1304 >= 1299: sanity check passed Thomas -----BEGIN PGP SIGNATURE----- iD4DBQFENY6L3w+/yD4P9tIRAtj8AKCxnkwyfeLwvDG5I7/NyVPhlkUVxACY7kom QZy15zaSRYo1A4S4zof38Q== =ERet -----END PGP SIGNATURE-----
Apr 06 2006
prev sibling parent Justin C Calvarese <technocrat7 gmail.com> writes:
Thomas Kuehne wrote:
 -----BEGIN PGP SIGNED MESSAGE-----
 Hash: SHA1
 
 Stewart Gordon schrieb am 2006-04-06:
 There seems to have been a surge of error results between 0.138 and 
 0.144 - weird.  The regression report for 0.138 doesn't show any such 
 surge.  Have the numbers become mixed up?
0.138 introduced "-fPIC" (neither documented in the changelog nor in DMD's help message, but listed on http://www.digitalmars.com/d/html/d/dcompiler.html)
"http://www.digitalmars.com/d/dcompiler.html" is the link here. -- jcc7
Apr 06 2006