www.digitalmars.com         C & C++   DMDScript  

digitalmars.D - My codebase have reached the critical size

reply "deadalnix" <deadalnix gmail.com> writes:
And that critical size isn't very large.

I cannot compile anymore :
Unable to fork: Cannot allocate memory

I cannot use separate compilation to mitigate the problem as some 
symbol are not emitted properly (so I get linker errors).

Hopefully, dmd is fast because it doesn't use any GC.
Feb 16 2013
next sibling parent reply Walter Bright <newshound2 digitalmars.com> writes:
On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as some symbol are
not
 emitted properly (so I get linker errors).


Are there bugzilla entries for these?
Feb 16 2013
next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as 
 some symbol are not
 emitted properly (so I get linker errors).


 Are there bugzilla entries for these?


They are for released version of dmd. For the new beta, things 
have changed, but it didn't reduced them to a simple test case 
yet.
Feb 16 2013
prev sibling parent reply "deadalnix" <deadalnix gmail.com> writes:
On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as 
 some symbol are not
 emitted properly (so I get linker errors).


 Are there bugzilla entries for these?


So reduced thing with dmd from git, and this still boils down to 
that : http://d.puremagic.com/issues/show_bug.cgi?id=8997
Feb 16 2013
next sibling parent reply kenji hara <k.hara.pg gmail.com> writes:
2013/2/17 deadalnix <deadalnix gmail.com>


 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright wrote:


 On 2/16/2013 1:37 AM, deadalnix wrote:


 I cannot use separate compilation to mitigate the problem as some symbol
 are not
 emitted properly (so I get linker errors).


 Are there bugzilla entries for these?


 So reduced thing with dmd from git, and this still boils down to that :
 http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>


Just now, I posted another fix for bug 8997.
https://github.com/D-Programming-Language/dmd/pull/1667

Kenji Hara
Feb 16 2013
next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:

 Just now, I posted another fix for bug 8997.
 https://github.com/D-Programming-Language/dmd/pull/1667


I have to go now, but will test it this evening. Thank a lot for 
your hard work !
Feb 16 2013
prev sibling parent reply "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:

 2013/2/17 deadalnix <deadalnix gmail.com>


 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
 wrote:


 On 2/16/2013 1:37 AM, deadalnix wrote:


 I cannot use separate compilation to mitigate the problem as 
 some symbol
 are not
 emitted properly (so I get linker errors).


 Are there bugzilla entries for these?


 So reduced thing with dmd from git, and this still boils down 
 to that :
 http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>


 Just now, I posted another fix for bug 8997.
 https://github.com/D-Programming-Language/dmd/pull/1667


OK, tested and it does work ! otsukare sama !

But . . . This issue was hidding another one. I still have 
linking issue. I'm dustmiting it right now, but this will take a 
while !
Feb 17 2013
parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 12:20:15 UTC, deadalnix wrote:

 On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:

 2013/2/17 deadalnix <deadalnix gmail.com>


 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
 wrote:


 On 2/16/2013 1:37 AM, deadalnix wrote:


 I cannot use separate compilation to mitigate the problem 
 as some symbol
 are not
 emitted properly (so I get linker errors).


 Are there bugzilla entries for these?


 So reduced thing with dmd from git, and this still boils down 
 to that :
 http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>


 Just now, I posted another fix for bug 8997.
 https://github.com/D-Programming-Language/dmd/pull/1667


 OK, tested and it does work ! otsukare sama !

 But . . . This issue was hidding another one. I still have 
 linking issue. I'm dustmiting it right now, but this will take 
 a while !


http://d.puremagic.com/issues/show_bug.cgi?id=9571
Feb 22 2013
prev sibling parent Alexander Tankeev <atankeev gmail.com> writes:
On 17.02.2013 8:27, deadalnix wrote:

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as some
 symbol are not
 emitted properly (so I get linker errors).


 Are there bugzilla entries for these?


 So reduced thing with dmd from git, and this still boils down to that :
 http://d.puremagic.com/issues/show_bug.cgi?id=8997


I think http://d.puremagic.com/issues/show_bug.cgi?id=9485 is about this 
bug too.
Feb 17 2013
prev sibling next sibling parent reply "Maxim Fomin" <maxim maxim-fomin.ru> writes:
On Saturday, 16 February 2013 at 09:37:12 UTC, deadalnix wrote:

 And that critical size isn't very large.

 I cannot compile anymore :
 Unable to fork: Cannot allocate memory

 I cannot use separate compilation to mitigate the problem as 
 some symbol are not emitted properly (so I get linker errors).

 Hopefully, dmd is fast because it doesn't use any GC.


Wasn't this a problem long before? My D environment on linux 
fails to unittest Phobos code with exactly same error message and 
I remember this was discussed in newsgroups.
Feb 16 2013
parent "H. S. Teoh" <hsteoh quickfur.ath.cx> writes:
On Sat, Feb 16, 2013 at 12:12:38PM +0100, Maxim Fomin wrote:

 On Saturday, 16 February 2013 at 09:37:12 UTC, deadalnix wrote:

And that critical size isn't very large.

I cannot compile anymore :
Unable to fork: Cannot allocate memory

I cannot use separate compilation to mitigate the problem as some
symbol are not emitted properly (so I get linker errors).

Hopefully, dmd is fast because it doesn't use any GC.


 
 Wasn't this a problem long before? My D environment on linux fails
 to unittest Phobos code with exactly same error message and I
 remember this was discussed in newsgroups.


This is still the situation, depending on how much memory your machine
has. I used to run the Phobos unittests with make -j6 to speed things
up, but recently I can't do it anymore without getting the above error
message, because std.algorithm will consume all the memory, leaving no
room for the others.

I remember having DMD do that on me as well, when one time I used
std.regex.ctRegex a bit too eagerly. I think (part of?) the problem is
that CTFE allocates memory but never frees it, so too much CTFE will
cause DMD to run out of memory.


T

-- 
Spaghetti code may be tangly, but lasagna code is just cheesy.
Feb 16 2013
prev sibling parent Arlen <arlen.ng gmx.com> writes:
I have the same issue with my Boost.units port:
https://github.com/Arlen/phobos/blob/std_units/std/units.d

DMD runs out of memory and that's why I've had to comment out most of the
definitions.  I haven't tried separate compilation, yet.

Arlen

On Sat, Feb 16, 2013 at 3:37 AM, deadalnix <deadalnix gmail.com> wrote:


 And that critical size isn't very large.

 I cannot compile anymore :
 Unable to fork: Cannot allocate memory

 I cannot use separate compilation to mitigate the problem as some symbol
 are not emitted properly (so I get linker errors).

 Hopefully, dmd is fast because it doesn't use any GC.
Feb 22 2013