digitalmars.D - D std.regex is so slow
- Daniel Kozak (6/6) Sep 19 2017 https://github.com/mariomka/regex-benchmark#performance
- rikki cattermole (2/10) Sep 19 2017 Most likely everything below D is being JIT'd.
- Dmitry Olshansky (5/11) Sep 19 2017 Well I'd be interested in getting the data. The benchmark looks
- John Colvin (4/19) Sep 19 2017 As mentioned in the REAME:
- Jon Degenhardt (4/10) Sep 19 2017 Might get some gain by compiling with '-flto-full'. Was faster on
- Daniel Kozak (3/16) Sep 19 2017 I have tried it, but does not change anything
- jmh530 (5/11) Sep 19 2017 Looks like they added ldc to it. I'm seeing 3x slower than PHP on
- Dmitry Olshansky (4/19) Sep 19 2017 IP is detected to be "semi-fixed" thus hitting a nice fast path.
- Daniel Kozak (4/24) Sep 19 2017 Is there a plan to make BitNFA back? Is possible that newCTFE will impro...
- Dmitry Olshansky (8/11) Sep 19 2017 It should but it doesn't support classes and exceptions. I need
- Daniel Kozak (13/26) Sep 20 2017 Hmm. I have tested old version od dmd and ldc with BitNFA, but it does n...
- Dmitry Olshansky (5/19) Sep 20 2017 I'm going to test BitNFA myself but for the curious, the phobos
- 12345swordy (2/8) Sep 19 2017 Irc a rewrite is in the work.
https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHP
Sep 19 2017
rikki cattermole <rikki cattermole.co.nz> On 19/09/2017 8:53 AM, Daniel Kozak wrote:https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPMost likely everything below D is being JIT'd.
Sep 19 2017
On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPWell I'd be interested in getting the data. The benchmark looks fine. --- Dmitry Olshansky
Sep 19 2017
On Tuesday, 19 September 2017 at 10:14:05 UTC, Dmitry Olshansky wrote:On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:As mentioned in the REAME: https://raw.githubusercontent.com/mariomka/regex-benchmark/master/input-text.txthttps://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPWell I'd be interested in getting the data. The benchmark looks fine. --- Dmitry Olshansky
Sep 19 2017
On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPMight get some gain by compiling with '-flto-full'. Was faster on a regex test I ran, though not nearly the deltas shown. --Jon
Sep 19 2017
I have tried it, but does not change anything On Tue, Sep 19, 2017 at 6:05 PM, Jon Degenhardt via Digitalmars-d < digitalmars-d puremagic.com> wrote:On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPMight get some gain by compiling with '-flto-full'. Was faster on a regex test I ran, though not nearly the deltas shown. --Jon
Sep 19 2017
On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPLooks like they added ldc to it. I'm seeing 3x slower than PHP on Email and URI, but roughly par on IP. It really stands out on the DMD one how much better it does on the IP one than the Email/URI ones.
Sep 19 2017
On Tuesday, 19 September 2017 at 16:27:51 UTC, jmh530 wrote:On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:IP is detected to be "semi-fixed" thus hitting a nice fast path. Others would have worked with BitNFA, a patch that we had to revert because auto-tester run out of memory.https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPLooks like they added ldc to it. I'm seeing 3x slower than PHP on Email and URI, but roughly par on IP. It really stands out on the DMD one how much better it does on the IP one than the Email/URI ones.
Sep 19 2017
Is there a plan to make BitNFA back? Is possible that newCTFE will improve problem with memory? Or it is possible to improve those slow cases? On Tue, Sep 19, 2017 at 8:12 PM, Dmitry Olshansky via Digitalmars-d < digitalmars-d puremagic.com> wrote:On Tuesday, 19 September 2017 at 16:27:51 UTC, jmh530 wrote:On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:IP is detected to be "semi-fixed" thus hitting a nice fast path. Others would have worked with BitNFA, a patch that we had to revert because auto-tester run out of memory.https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPLooks like they added ldc to it. I'm seeing 3x slower than PHP on Email and URI, but roughly par on IP. It really stands out on the DMD one how much better it does on the IP one than the Email/URI ones.
Sep 19 2017
On Tuesday, 19 September 2017 at 19:52:57 UTC, Daniel Kozak wrote:Is there a plan to make BitNFA back?Yes, the moment we have CTFE that doesn't leak.Is possible that newCTFE will improve problem with memory?It should but it doesn't support classes and exceptions. I need them.Or it is possible to improve those slow cases?There are many other things but BitNFA is a nobrainer - all the work has been already done and it is super fast where applicable. --- Dmitry Olshansky
Sep 19 2017
Hmm. I have tested old version od dmd and ldc with BitNFA, but it does not help much with those two cases actual version of ldc: 240.964 - 92 211.433 - 5301 6.76683 - 5 ldc 1.2: 215.158 - 92 190.255 - 5301 6.58155 - 5 So there is some improvments but not as much as I would expected. On Wed, Sep 20, 2017 at 6:54 AM, Dmitry Olshansky via Digitalmars-d < digitalmars-d puremagic.com> wrote:On Tuesday, 19 September 2017 at 19:52:57 UTC, Daniel Kozak wrote:Is there a plan to make BitNFA back?Yes, the moment we have CTFE that doesn't leak. Is possible that newCTFE will improve problem with memory?It should but it doesn't support classes and exceptions. I need them. Or it is possible to improve those slow cases?There are many other things but BitNFA is a nobrainer - all the work has been already done and it is super fast where applicable. --- Dmitry Olshansky
Sep 20 2017
On Wednesday, 20 September 2017 at 10:29:45 UTC, Daniel Kozak wrote:Hmm. I have tested old version od dmd and ldc with BitNFA, but it does not help much with those two cases actual version of ldc: 240.964 - 92 211.433 - 5301 6.76683 - 5 ldc 1.2: 215.158 - 92 190.255 - 5301 6.58155 - 5 So there is some improvments but not as much as I would expected.I'm going to test BitNFA myself but for the curious, the phobos branch is: https://github.com/DmitryOlshansky/phobos/tree/ctfe-bitnfa?files=1--- Dmitry Olshansky
Sep 20 2017
On Tuesday, 19 September 2017 at 07:53:27 UTC, Daniel Kozak wrote:https://github.com/mariomka/regex-benchmark#performance Do you know why? Here is a code: https://github.com/mariomka/regex-benchmark/blob/master/d/benchmark.d I have try it with ldc too, but is still much slower (10x) than PHPIrc a rewrite is in the work.
Sep 19 2017