• CJS (4/4) Dec 10 2013 I'd like to use cython to wrap a D library. It's possible to do
• FreeSlave (7/11) Dec 11 2013 I'm not Cython guy, but as I know, Cython generates C code,
• Chris (4/8) Dec 11 2013 Have you had a look at this:
• John Colvin (3/11) Dec 11 2013 both of those are out of date, this is where development is now:
• Russel Winder (21/29) Jan 19 2014 Sorry to be late coming to this.
• CJS (12/31) Jan 19 2014 For future reference, I tried but wasn't able to make calling D
• Ellery Newcomer (15/20) Jan 23 2014 python wants shared libs, not static libs. but this is very
• Russel Winder (15/33) Jan 24 2014 On Fri, 2014-01-24 at 02:29 +0000, Ellery Newcomer wrote:
• Ellery Newcomer (5/9) Jan 25 2014 you can also do
• Russel Winder (23/39) Jan 26 2014 OK, that works for me, at least as far as installing is concerned. You
• Russel Winder (30/46) Jan 26 2014 Of course using the far superior Python 3:
• Ellery Newcomer (4/12) Feb 01 2014 This all sounds suspiciously like stuff I thought I'd already
• Russel Winder (13/27) Feb 01 2014 The problem was the source → sources edit: Python 2 does not give a
• Ellery Newcomer (4/8) Feb 01 2014 It wouldn't by any chance be related to
• Russel Winder (28/40) Feb 02 2014 Possibly but I am working with the trivial hello world:
• Artem Tarasov (3/6) Feb 03 2014 You should call Runtime.initialize() prior to calling any other D
• Russel Winder (42/50) Feb 04 2014 Hummm… obvious once pointed out :-) Thanks for doing exactly that.
• Artem Tarasov (13/14) Feb 04 2014 Pointing out obvious things, part 2: wrap it into a C function
• Russel Winder (12/29) Feb 04 2014 I had thought of this and rejected it as an API fail. (Possibly wrongly,
• Ellery Newcomer (8/10) Feb 06 2014 Any particular reason you aren't using CeleriD to build this
• John Colvin (8/12) Dec 11 2013 1) have you declared the functions you want to call with

"CJS" <Prometheus85 hotmail.com> writes:

I'd like to use cython to wrap a D library. It's possible to do 
this with a statically compiled C library, but it fails when I 
try with a statically compiled D library. Any suggestions on how 
to do this successfully?

"FreeSlave" <freeslave93 gmail.com> writes:

On Wednesday, 11 December 2013 at 05:30:49 UTC, CJS wrote:
 I'd like to use cython to wrap a D library. It's possible to do 
 this with a statically compiled C library, but it fails when I 
 try with a statically compiled D library. Any suggestions on 
 how to do this successfully?

I'm not Cython guy, but as I know, Cython generates C code, 
right? Then probably at first you should learn how to call D 
functions from C side. I don't know how to do it correctly. It's 
easily to call those D functions which don't use 'new' operation 
and garbage collection (explicitly or implicitly). But when they 
do that, I get segmentation fault.

"Chris" <wendlec tcd.ie> writes:

On Wednesday, 11 December 2013 at 05:30:49 UTC, CJS wrote:
 I'd like to use cython to wrap a D library. It's possible to do 
 this with a statically compiled C library, but it fails when I 
 try with a statically compiled D library. Any suggestions on 
 how to do this successfully?

Have you had a look at this:

http://pyd.dsource.org/
https://github.com/dansanduleac/pyd

"John Colvin" <john.loughran.colvin gmail.com> writes:

On Wednesday, 11 December 2013 at 11:41:11 UTC, Chris wrote:
 On Wednesday, 11 December 2013 at 05:30:49 UTC, CJS wrote:
 I'd like to use cython to wrap a D library. It's possible to 
 do this with a statically compiled C library, but it fails 
 when I try with a statically compiled D library. Any 
 suggestions on how to do this successfully?

 Have you had a look at this:

 http://pyd.dsource.org/
 https://github.com/dansanduleac/pyd

both of those are out of date, this is where development is now: 
https://bitbucket.org/ariovistus/pyd

Russel Winder <russel winder.org.uk> writes:

On Wed, 2013-12-11 at 12:56 +0100, John Colvin wrote:
 On Wednesday, 11 December 2013 at 11:41:11 UTC, Chris wrote:

[…]
 Have you had a look at this:

 http://pyd.dsource.org/
 https://github.com/dansanduleac/pyd

 
 both of those are out of date, this is where development is now: 
 https://bitbucket.org/ariovistus/pyd

Sorry to be late coming to this.

It would great to be able to push D as a CPython extension language.
However the state of pyd.dsource.org and places reached from it do make
it seem that the project died in 2009.

ariovistus' GitHub project on Bitbucket is moving but everything else
appears to be a problem.

Is it possible to decide on a location for activity, create some
infrastructure, and then get the old stuff cleaned out.

My start point is to get PyD working in virtualenvs for Python 2.7 and
Python 3.3. Findout out what the SCons and Tup stuff is for would be
useful. On the side I could help with documentation and stuff, but only
if it can be done by DVCS and pull requests with email, I am not
interested in non DVCS wikis nor forums.

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"CJS" <Prometheus85 hotmail.com> writes:

 Sorry to be late coming to this.

 It would great to be able to push D as a CPython extension 
 language.
 However the state of pyd.dsource.org and places reached from it 
 do make
 it seem that the project died in 2009.

 ariovistus' GitHub project on Bitbucket is moving but 
 everything else
 appears to be a problem.

 Is it possible to decide on a location for activity, create some
 infrastructure, and then get the old stuff cleaned out.

 My start point is to get PyD working in virtualenvs for Python 
 2.7 and
 Python 3.3. Findout out what the SCons and Tup stuff is for 
 would be
 useful. On the side I could help with documentation and stuff, 
 but only
 if it can be done by DVCS and pull requests with email, I am not
 interested in non DVCS wikis nor forums.

For future reference, I tried but wasn't able to make calling D 
from python work. I tried to just compile D to an .a library, 
including statically linking phobos, and then wrapping it with 
cython like I would with C code. (I've made this work before with 
C.)

My thinking was that there's already been a lot of work in the 
Python world in the past 4-6 years to make calling C fairly 
straight forward. So D should be able to piggy back on that work.

(Though to a lot of Python people a legitimate question would be, 
"is this worth it?" You can just profile python code to find the 
hot spots and then use ctypes/cython to pass objects allocated by 
Python to C-level functions to do the time-intensive stuff.)

"Ellery Newcomer" <ellery.newcomer utulsa.edu> writes:

On Monday, 20 January 2014 at 02:30:46 UTC, CJS wrote:
 For future reference, I tried but wasn't able to make calling D 
 from python work. I tried to just compile D to an .a library, 
 including statically linking phobos, and then wrapping it with 
 cython like I would with C code. (I've made this work before 
 with C.)

python wants shared libs, not static libs. but this is very 
fiddly. so use pyd.

1. clone the ariovistus/pyd repo
2. from top dir, type

python setup install
python runtests.py hello

(or
cd examples/hello
python setup.py build
python test.py)

this will run the code found in examples/hello (it's a simple 
python calls D)

use python 2.7 and have dmd 2.064 on your path somewhere. It 
should just work.

Russel Winder <russel winder.org.uk> writes:

On Fri, 2014-01-24 at 02:29 +0000, Ellery Newcomer wrote:
[…]

I have just tried a trivial D source shared object on Debian Unstable
using DMD 2.064.2 from d-apt. Compile up the shared object with entries
C linkage, try to use ctypes or CFFI from Python just gives a
segmentation violation :-(

 python wants shared libs, not static libs. but this is very 
 fiddly. so use pyd.
 
 1. clone the ariovistus/pyd repo
 2. from top dir, type
 
 python setup install
 python runtests.py hello

Probably want to use a virtualenv for this rather than install into the
base installation

 (or
 cd examples/hello
 python setup.py build
 python test.py)
 
 this will run the code found in examples/hello (it's a simple 
 python calls D)
 
 use python 2.7 and have dmd 2.064 on your path somewhere. It 
 should just work.

It needs to work for Python 3.3 as well!

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"Ellery Newcomer" <ellery-newcomer utulsa.edu> writes:

On Friday, 24 January 2014 at 10:55:34 UTC, Russel Winder wrote:
 Probably want to use a virtualenv for this rather than install 
 into the
 base installation

you can also do

python setup.py build
python runtests.py -b hello

 It needs to work for Python 3.3 as well!

try the latest commit

Russel Winder <russel winder.org.uk> writes:

On Sun, 2014-01-26 at 01:33 +0000, Ellery Newcomer wrote:
 On Friday, 24 January 2014 at 10:55:34 UTC, Russel Winder wrote:
 Probably want to use a virtualenv for this rather than install 
 into the
 base installation

 
 you can also do
 
 python setup.py build
 python runtests.py -b hello
 
 It needs to work for Python 3.3 as well!

 
 try the latest commit

OK, that works for me, at least as far as installing is concerned. You
probably want to reject my pull request given the boundary conditions
you want to work with.

However with Python 2 the example from:

   https://bitbucket.org/ariovistus/pyd/wiki/QuickStart

leads to:

|> python setup.py build
Traceback (most recent call last):
  File "setup.py", line 11, in <module>
    d_lump=True
  File
"/home/users/russel/PythonEnvironments/Fedora_Python2_PyD/lib/python2.7/site-packages/
elerid/support.py", line 53, in __init__
    std_Extension.__init__(self, *args, **kwargs)
TypeError: __init__() takes at least 3 arguments (2 given)

on Fedora 20 using a virtualenv created from the standard Python 2.
 

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

Russel Winder <russel winder.org.uk> writes:

On Sun, 2014-01-26 at 12:11 +0000, Russel Winder wrote:
[…]
 However with Python 2 the example from:
 
    https://bitbucket.org/ariovistus/pyd/wiki/QuickStart
 
 leads to:
 
 |> python setup.py build
 Traceback (most recent call last):
   File "setup.py", line 11, in <module>
     d_lump=True
   File
 "/home/users/russel/PythonEnvironments/Fedora_Python2_PyD/lib/python2.7/site-packages/
elerid/support.py", line 53, in __init__
     std_Extension.__init__(self, *args, **kwargs)
 TypeError: __init__() takes at least 3 arguments (2 given)
 
 on Fedora 20 using a virtualenv created from the standard Python 2.

Of course using the far superior Python 3:

|> python setup.py build
Traceback (most recent call last):
  File "setup.py", line 13, in <module>
    d_lump=True
  File
"/home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/
elerid/support.py", line 53, in __init__
    std_Extension.__init__(self, *args, **kwargs)
TypeError: __init__() missing 1 required positional argument: 'sources'

so srcs → sources cures the problem.

I get a dmd error thought:


dmd -property -c -fPIC -version=PydPythonExtension
-version=Python_2_4_Or_Later -version=Python_2_5_Or_Later
-version=Python_2_6_Or_Later -version=Python_2_7_Or_Later
-version=Python_3_0_Or_Later -version=Python_3_1_Or_Later
-version=Python_3_2_Or_Later -version=Python_3_3_Or_Later
-version=Python_Unicode_UCS4 -debug
-I/home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/ce
erid/infrastructure -ofbuild/temp.linux-x86_64-3.3/infra/temp.o hello.d
/home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruct
re/pyd/class_wrap.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/pyd/ctor_wrap.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infr
structure/pyd/def.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastru
ture/pyd/embedded.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/pyd/exception.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infras
ructure/pyd/extra.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/pyd/func_wrap.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructu
e/pyd/make_object.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructur
/pyd/make_wrapper.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastr
cture/pyd/op_wrap.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infr
structure/pyd/pyd.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/pyd/pydobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruct
re/pyd/references.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructu
e/pyd/struct_wrap.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infras
ructure/util/conv.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/util/typeinfo.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/util/typelist.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructur
/util/multi_index.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastru
ture/util/replace.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastruc
ure/meta/Demangle.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastr
cture/meta/Nameof.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/abstract_.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure
deimos/python/ast.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/boolobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/p
thon/bufferobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/pyth
n/bytearrayobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/bytesobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/cellobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/d
imos/python/ceval.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/classobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/cobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/de
mos/python/codecs.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/
eimos/python/code.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/compile.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/py
hon/complexobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/cStringIO.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/datetime.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/descrobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/dictobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/enumobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/errcode.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/
eimos/python/eval.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/fileobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/floatobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/frameobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/funcobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/genobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/grammar.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/import_.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/intobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/intrcheck.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/iterobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/listobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/longintrepr.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/longobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/marshal.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/p
thon/memoryobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/p
thon/methodobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos
python/modsupport.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/p
thon/moduleobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/
eimos/python/node.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/de
mos/python/object.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/objimpl.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/parsetok.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/pgenheaders.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/pyarena.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/pyatomic.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/pycapsule.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/pydebug.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/pyerrors.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/d
imos/python/pymem.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/de
mos/python/pyport.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/dei
os/python/pystate.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/pystrcmp.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/pystrtod.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/de
mos/python/Python.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/pythonrun.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/pythread.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/rangeobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/setobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/sliceobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/p
thon/stringobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/p
thon/structmember.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/structseq.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deim
s/python/symtable.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/sysmodule.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/timefuncs.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimo
/python/traceback.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/
ython/tupleobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/py
hon/unicodeobject.d /home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/deimos/py
hon/weakrefobject.d build/temp.linux-x86_64-3.3/infra/pydmain.d
/home/users/russel/PythonEnvironments/Fedora_Python3_PyD/lib/python3.3/site-packages/celerid/infrastructure/d/python_so_linux_boilerplate.d
in here!
def: hello_func
hello.d(9): Error: not a property def
error: command 'dmd' failed with exit status 1



-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"Ellery Newcomer" <ellery-newcomer utulsa.edu> writes:

On Sunday, 26 January 2014 at 14:17:18 UTC, Russel Winder wrote:
 On Sun, 2014-01-26 at 12:11 +0000, Russel Winder wrote:
 […]
 However with Python 2 the example from:
 
    https://bitbucket.org/ariovistus/pyd/wiki/QuickStart
 
 leads to:
 


This all sounds suspiciously like stuff I thought I'd already 
fixed. see

https://bitbucket.org/ariovistus/pyd/issue/15/some-issues-getting-pyd-to-work

Russel Winder <russel winder.org.uk> writes:

On Sat, 2014-02-01 at 20:58 +0000, Ellery Newcomer wrote:
 On Sunday, 26 January 2014 at 14:17:18 UTC, Russel Winder wrote:
 On Sun, 2014-01-26 at 12:11 +0000, Russel Winder wrote:
 […]
 However with Python 2 the example from:
 
    https://bitbucket.org/ariovistus/pyd/wiki/QuickStart
 
 leads to:
 


 
 This all sounds suspiciously like stuff I thought I'd already 
 fixed. see
 
 https://bitbucket.org/ariovistus/pyd/issue/15/some-issues-getting-pyd-to-work

The problem was the source → sources edit: Python 2 does not give a
reasonable error message, Python 3 does and leads to an immediate
fix :-)

My problem of the moment is segmentation faults during execution, and I
have no model of how to go about providing useful data to debug
this :-((

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"Ellery Newcomer" <ellery-newcomer utulsa.edu> writes:

On Saturday, 1 February 2014 at 22:02:24 UTC, Russel Winder wrote:
 My problem of the moment is segmentation faults during 
 execution, and I
 have no model of how to go about providing useful data to debug
 this :-((

It wouldn't by any chance be related to

https://bitbucket.org/ariovistus/pyd/issue/17/it-seems-py_incref-missed-when-pydobject

would it?

Russel Winder <russel winder.org.uk> writes:

On Sun, 2014-02-02 at 01:07 +0000, Ellery Newcomer wrote:
 On Saturday, 1 February 2014 at 22:02:24 UTC, Russel Winder wrote:
 My problem of the moment is segmentation faults during 
 execution, and I
 have no model of how to go about providing useful data to debug
 this :-((

 
 It wouldn't by any chance be related to
 
 https://bitbucket.org/ariovistus/pyd/issue/17/it-seems-py_incref-missed-when-pydobject
 
 would it?

Possibly but I am working with the trivial hello world:

        import std.stdio ;
        
        extern(C) {
            void sayHello() {
                writeln("Hello World.");
            }
        }

is compiled into a shared object and the python is:

        import ctypes
        
        if __name__ == '__main__':
            module = ctypes.cdll.LoadLibrary('lib_helloWorld.so')
            module.sayHello()
        
result is:

        |> LD_LIBRARY_PATH=. python execute.py 
        Segmentation fault

I am not sure how I should go about getting a stack trace that is
meaningful. I am on Debian Unstable the above is with a Python 2
virtualenv with PyD installed.

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"Artem Tarasov" <lomereiter gmail.com> writes:

On Sunday, 2 February 2014 at 15:31:30 UTC, Russel Winder wrote:
 result is:

         |> LD_LIBRARY_PATH=. python execute.py
         Segmentation fault

You should call Runtime.initialize() prior to calling any other D 
functions.

Russel Winder <russel winder.org.uk> writes:

On Tue, 2014-02-04 at 07:13 +0000, Artem Tarasov wrote:
 On Sunday, 2 February 2014 at 15:31:30 UTC, Russel Winder wrote:
 result is:

         |> LD_LIBRARY_PATH=. python execute.py
         Segmentation fault

 
 You should call Runtime.initialize() prior to calling any other D 
 functions.

Hummm… obvious once pointed out :-) Thanks for doing exactly that.

The question is how to get this run. I tried a module initializer:

        static this() {
          Runtime.initialize();
        }

but this module never actually gets loaded per se, so that is never
going to work. So this means calling a C linkage function to do the
initialization in every entry point:

        import core.runtime: Runtime;
        import std.stdio: writeln;
        
        auto initialized = false;
        
        extern (C) void initializeIfNotAlreadyDone() {
          if (!initialized) {
            Runtime.initialize();
            initialized = true;
          }
        }
        
        extern(C) {
          void sayHello() {
            initializeIfNotAlreadyDone();
            writeln("Hello World.");
          }
        }

works a treat:

        scons: Building targets ...
        dmd -I. -fPIC -c -fPIC -ofhelloWorld.o helloWorld.d
        dmd -shared -defaultlib=libphobos2.so -oflib_helloWorld.so helloWorld.o
-fPIC -L-L.
        LD_LIBRARY_PATH=. python execute.py
        Hello World.
        scons: done building targets.

So D extensions to CPython are possible without PyD!

Now to continue with PyD anyway so as to compare and contrast.

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"Artem Tarasov" <lomereiter gmail.com> writes:

On Tuesday, 4 February 2014 at 11:33:40 UTC, Russel Winder wrote:
 The question is how to get this run.

Pointing out obvious things, part 2: wrap it into a C function 
and call that function when loading the Python module.

library.d:
...
extern (C) export void attach() { Runtime.initialize(); }

library/__init__.py:
...
lib = ctypes.CDLL("myawesomelib.so")
lib.attach()

def foo():
     lib.foo()
...

Russel Winder <russel winder.org.uk> writes:

On Tue, 2014-02-04 at 12:45 +0000, Artem Tarasov wrote:
 On Tuesday, 4 February 2014 at 11:33:40 UTC, Russel Winder wrote:
 The question is how to get this run.

 
 Pointing out obvious things, part 2: wrap it into a C function 
 and call that function when loading the Python module.

I had thought of this and rejected it as an API fail. (Possibly wrongly,
but…)

 library.d:
 ...
 extern (C) export void attach() { Runtime.initialize(); }
 
 library/__init__.py:
 ...
 lib = ctypes.CDLL("myawesomelib.so")
 lib.attach()

This violates the principle of least surprise: you don't have to do this
with C or C++ extensions so it is an API fail for D to have to do this.

 def foo():
      lib.foo()
 ...
 

But it does lead to a working system :-)

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

"Ellery Newcomer" <ellery-newcomer utulsa.edu> writes:

On Tuesday, 4 February 2014 at 16:17:30 UTC, Russel Winder wrote:
 On Tue, 2014-02-04 at 12:45 +0000, Artem Tarasov wrote:

 But it does lead to a working system :-)

Any particular reason you aren't using CeleriD to build this 
shared lib? CeleriD uses some hooks to call rt_init when the 
library loads.

https://bitbucket.org/ariovistus/pyd/src/92b9962b429ed33afa7048cf1923fd76d0fe8977/infrastructure/d/?at=default

see so_ctor.c and python_so_linux_boilerplate.d

Also, note however you do it, if you have multiple shared libs, 
don't call initialize/term more than once. segfaults happen.

"John Colvin" <john.loughran.colvin gmail.com> writes:

On Wednesday, 11 December 2013 at 05:30:49 UTC, CJS wrote:
 I'd like to use cython to wrap a D library. It's possible to do 
 this with a statically compiled C library, but it fails when I 
 try with a statically compiled D library. Any suggestions on 
 how to do this successfully?

1) have you declared the functions you want to call with 
extern(C)?

2) you will need to compile the D code as a shared library.

3) you will need to call rt_init / rt_term to start / stop the 
runtime in order to use some features of D. There are problems 
with the runtime when using multiple D shared libraries, so it's 
best to link everything you need as a single shared lib.