digitalmars.D - ANTLR grammar
- Andy Friesen (13/13) Sep 01 2004 ANTLR is ANother Tool for Language Recognition. It's the same idea as
- resistor AT mac DOT com (1/14) Sep 01 2004
- resistor AT mac DOT com (28/41) Sep 01 2004 Awesome...
- Andy Friesen (4/33) Sep 01 2004 Curious. It looks as though it doesn't like the use of 'typeof' as an
- resistor AT mac DOT com (7/40) Sep 02 2004 resistor$ gcc -v
- Andy Friesen (5/13) Sep 02 2004 It looks like g++ defines 'typeof' as a keyword. You can fix it by
- resistor AT mac DOT com (25/38) Sep 02 2004 OK. Fixed that by running G++ with the -ansi flag. For future referenc...
ANTLR is ANother Tool for Language Recognition. It's the same idea as Lex and YACC, but has (I think) better syntax, and directly supports the way, as I understand it. Anybody want to take a crack at D support?) You can get it at <http://antlr.org> I haven't run this through the complete gauntlet just yet, but preliminary tests suggest that it handles a respectable subset of D, if not the whole thing. :) <http://andy.tadan.us/d/d.g> There isn't much else going on in this parser just yet, it's little more than a syntax checker, but that also means that it's easier to gut it if you want to use the grammar for something else. :) -- andy
Sep 01 2004
resistor AT mac DOT com <resistor_member pathlink.com> In article <ch3st2$1scq$1 digitaldaemon.com>, Andy Friesen says...ANTLR is ANother Tool for Language Recognition. It's the same idea as Lex and YACC, but has (I think) better syntax, and directly supports the way, as I understand it. Anybody want to take a crack at D support?) You can get it at <http://antlr.org> I haven't run this through the complete gauntlet just yet, but preliminary tests suggest that it handles a respectable subset of D, if not the whole thing. :) <http://andy.tadan.us/d/d.g> There isn't much else going on in this parser just yet, it's little more than a syntax checker, but that also means that it's easier to gut it if you want to use the grammar for something else. :) -- andy
Sep 01 2004
Awesome... Except, I can't get it to compile. Attempting to compile the generated DParser.cpp and DLexer.cpp files gives me: In file included from DParser.cpp:2: DParser.hpp:84: warning: declaration does not declare anything DParser.hpp:84: error: parse error before `typeof' DParser.cpp:1927: error: parse error before `typeof' DParser.cpp:1931: error: `LPAREN' was not declared in this scope DParser.cpp:1931: warning: ISO C++ forbids declaration of `match' with no type DParser.cpp:1932: warning: ISO C++ forbids declaration of `expression' with no type DParser.cpp:1933: error: `RPAREN' was not declared in this scope DParser.cpp:1933: warning: ISO C++ forbids declaration of `match' with no type DParser.cpp:1933: error: redefinition of `int match' DParser.cpp:1931: error: `int match' previously defined here DParser.cpp:1934: error: parse error before `}' token DParser.cpp:1938: warning: ISO C++ forbids declaration of `consume' with no type DParser.cpp:1939: error: `_tokenSet_35' was not declared in this scope DParser.cpp:1939: warning: ISO C++ forbids declaration of `consumeUntil' with no type DParser.cpp:1940: error: parse error before `}' token DParser.cpp: In member function `void DParser::basicType()': DParser.cpp:2133: error: parse error before `)' token I'm using ANTLR 2.7.4, so I don't know what I could be doing wrong. Any ideas? -Owen In article <ch3st2$1scq$1 digitaldaemon.com>, Andy Friesen says...ANTLR is ANother Tool for Language Recognition. It's the same idea as Lex and YACC, but has (I think) better syntax, and directly supports the way, as I understand it. Anybody want to take a crack at D support?) You can get it at <http://antlr.org> I haven't run this through the complete gauntlet just yet, but preliminary tests suggest that it handles a respectable subset of D, if not the whole thing. :) <http://andy.tadan.us/d/d.g> There isn't much else going on in this parser just yet, it's little more than a syntax checker, but that also means that it's easier to gut it if you want to use the grammar for something else. :) -- andy
Sep 01 2004
resistor AT mac DOT com wrote:Awesome... Except, I can't get it to compile. Attempting to compile the generated DParser.cpp and DLexer.cpp files gives me: In file included from DParser.cpp:2: DParser.hpp:84: warning: declaration does not declare anything DParser.hpp:84: error: parse error before `typeof' DParser.cpp:1927: error: parse error before `typeof' DParser.cpp:1931: error: `LPAREN' was not declared in this scope DParser.cpp:1931: warning: ISO C++ forbids declaration of `match' with no type DParser.cpp:1932: warning: ISO C++ forbids declaration of `expression' with no type DParser.cpp:1933: error: `RPAREN' was not declared in this scope DParser.cpp:1933: warning: ISO C++ forbids declaration of `match' with no type DParser.cpp:1933: error: redefinition of `int match' DParser.cpp:1931: error: `int match' previously defined here DParser.cpp:1934: error: parse error before `}' token DParser.cpp:1938: warning: ISO C++ forbids declaration of `consume' with no type DParser.cpp:1939: error: `_tokenSet_35' was not declared in this scope DParser.cpp:1939: warning: ISO C++ forbids declaration of `consumeUntil' with no type DParser.cpp:1940: error: parse error before `}' token DParser.cpp: In member function `void DParser::basicType()': DParser.cpp:2133: error: parse error before `)' token I'm using ANTLR 2.7.4, so I don't know what I could be doing wrong. Any ideas?Curious. It looks as though it doesn't like the use of 'typeof' as an identifier. What compiler are you using? -- andy
Sep 01 2004
resistor$ gcc -v Reading specs from /usr/libexec/gcc/darwin/ppc/3.3/specs Thread model: posix gcc version 3.3 20030304 (Apple Computer, Inc. build 1666) -Owen P.S. I've never had trouble building ANTLR grammars before. In article <ch6b2g$bo$1 digitaldaemon.com>, Andy Friesen says...resistor AT mac DOT com wrote:Awesome... Except, I can't get it to compile. Attempting to compile the generated DParser.cpp and DLexer.cpp files gives me: In file included from DParser.cpp:2: DParser.hpp:84: warning: declaration does not declare anything DParser.hpp:84: error: parse error before `typeof' DParser.cpp:1927: error: parse error before `typeof' DParser.cpp:1931: error: `LPAREN' was not declared in this scope DParser.cpp:1931: warning: ISO C++ forbids declaration of `match' with no type DParser.cpp:1932: warning: ISO C++ forbids declaration of `expression' with no type DParser.cpp:1933: error: `RPAREN' was not declared in this scope DParser.cpp:1933: warning: ISO C++ forbids declaration of `match' with no type DParser.cpp:1933: error: redefinition of `int match' DParser.cpp:1931: error: `int match' previously defined here DParser.cpp:1934: error: parse error before `}' token DParser.cpp:1938: warning: ISO C++ forbids declaration of `consume' with no type DParser.cpp:1939: error: `_tokenSet_35' was not declared in this scope DParser.cpp:1939: warning: ISO C++ forbids declaration of `consumeUntil' with no type DParser.cpp:1940: error: parse error before `}' token DParser.cpp: In member function `void DParser::basicType()': DParser.cpp:2133: error: parse error before `)' token I'm using ANTLR 2.7.4, so I don't know what I could be doing wrong. Any ideas?Curious. It looks as though it doesn't like the use of 'typeof' as an identifier. What compiler are you using? -- andy
Sep 02 2004
resistor AT mac DOT com wrote:resistor$ gcc -v Reading specs from /usr/libexec/gcc/darwin/ppc/3.3/specs Thread model: posix gcc version 3.3 20030304 (Apple Computer, Inc. build 1666) -Owen P.S. I've never had trouble building ANTLR grammars before.It looks like g++ defines 'typeof' as a keyword. You can fix it by changing the name of the typeof rule to typeofType or some such. There may also be a compile flag to disable that particular extension. -- andy
Sep 02 2004
OK. Fixed that by running G++ with the -ansi flag. For future reference, however, it might help to change that identifier, as G++ is a pretty common compiler. Anyways, I got it compiled and hooked up with a simple driver main.cpp. I ran this against the wc.d test file, with these results: wc.d:9:13: unexpected token: " lines words bytes file\n" wc.d:9:46: expecting SEMI, found ')' wc.d:16:37: unexpected token: . wc.d:16:46: expecting SEMI, found ')' wc.d:24:21: unexpected token: ! wc.d:34:17: unexpected token: "%8lu%8lu%8lu %.*s\n" wc.d:34:38: expecting SEMI, found ',' wc.d:34:52: expecting SEMI, found ',' wc.d:34:64: expecting SEMI, found ')' wc.d:41:17: unexpected token: "--------------------------------------\n%8lu%8lu%8lu total" wc.d:41:77: expecting SEMI, found ',' wc.d:42:29: expecting SEMI, found ',' wc.d:42:31: unexpected token: c_total Looks like it parsed most of the program quite well, with only some problems with string literals as function parameters. Overall, though, great work!! -Owen In article <ch7t3t$n04$1 digitaldaemon.com>, Andy Friesen says...resistor AT mac DOT com wrote:resistor$ gcc -v Reading specs from /usr/libexec/gcc/darwin/ppc/3.3/specs Thread model: posix gcc version 3.3 20030304 (Apple Computer, Inc. build 1666) -Owen P.S. I've never had trouble building ANTLR grammars before.It looks like g++ defines 'typeof' as a keyword. You can fix it by changing the name of the typeof rule to typeofType or some such. There may also be a compile flag to disable that particular extension. -- andy
Sep 02 2004