Commit Graph

29 Commits

Author SHA1 Message Date
z7zmey
4989d31874 #51 saving optional tokes and tokens that have different representation as meta 2018-08-09 11:46:56 +03:00
z7zmey
0138749c6d Merge branch 'master' into dev 2018-07-24 22:24:32 +03:00
z7zmey
623a90a418 #56: now, __halt_compiler(); terminates parsing process 2018-07-24 21:49:26 +03:00
z7zmey
f89d7d3a17 Merge branch 'master' into dev 2018-07-14 18:38:10 +03:00
z7zmey
867095823d fixed bug when heredoc starts by \; removing \n from a heredoc value end 2018-07-14 18:00:48 +03:00
Imuli
3ba2d2a91b distinguish unknown unicode characters from EOF 2018-07-14 08:06:00 -04:00
z7zmey
4da7b36056 created TokenPool 2018-07-12 10:53:36 +03:00
z7zmey
15a1a81924 #13: the printer prints nodes with meta(comments and whitespaces) saved by the parser 2018-07-08 01:48:52 +03:00
z7zmey
c4c0934c51 tokens constants moved to lexer_tokens.go 2018-07-08 01:06:49 +03:00
z7zmey
e90df8ef5f #33 comment package has renamed to meta and parser now saves whitespaces 2018-06-30 23:23:19 +03:00
z7zmey
1ebb0c6fad #25: save position within node 2018-06-25 23:30:10 +03:00
z7zmey
bfc346ebab #40 reduce memory allocations for position.Position by using sync.Pool 2018-06-12 21:14:11 +03:00
z7zmey
2737e98559 #27 reduce memory allocations for scanner.Token by using sync.Pool 2018-06-12 19:37:22 +03:00
z7zmey
af379a61dd Merge branch 'comments3' 2018-06-07 15:06:54 +03:00
z7zmey
d72d3b7980 refactor tokenString 2018-06-05 15:20:23 +03:00
z7zmey
788628d902 #21 scanner.Lexer.charsToBytes optimization 2018-06-05 01:52:04 +03:00
z7zmey
e396f81eea php7: save all comments 2018-05-27 18:07:26 +03:00
z7zmey
e7a9de3dfc #18 replace heredocLabel variable from global 2018-05-24 12:14:30 +03:00
Imuli
d73ea72530 the simple fix for #14 (panic on 32-bit)
FileSet starts `base` at 1, and adds `size+1` for every file.
  So with 32 bit ints, anything larger than 2³¹-3 overflows.
2018-05-15 09:59:04 -04:00
z7zmey
435dc5c706 scanner.NewToken returns pointer, and scanner.Token saves position as position.Position 2018-04-15 22:59:06 +03:00
z7zmey
781a55659b save comment position 2018-04-15 21:39:26 +03:00
z7zmey
c2f938e55c merge DocComment and PlainComment 2018-04-15 15:55:33 +03:00
z7zmey
e65ace8984 merge token package into scanner package 2018-04-15 14:47:40 +03:00
z7zmey
7a0e5fc758 update package comments 2018-02-20 20:22:15 +02:00
z7zmey
ac6432b6c9 fmt scanner/lexer.go 2018-02-19 13:36:12 +02:00
z7zmey
ae3f612879 Add simple comments to scanner exported methods 2018-02-19 13:34:44 +02:00
z7zmey
aee54762aa Add simple comments to scanner exported methods 2018-02-19 13:33:51 +02:00
z7zmey
70c091d323 fix token consts 2018-01-29 16:11:45 +02:00
z7zmey
b93d24f95f split scanner and parser 2018-01-24 18:42:23 +02:00