3 Commits

Author	SHA1	Message	Date
asiva@google.com	08c662b1c0	Represent tokens as a compressed stream instead of an array. ... On x86: Original sizes: Size of isolate snapshot = 925655 New space (0k of 32768k) Old space (1700k of 1792k) Code space (0k of 0k) out/ReleaseIA32/run_vm_tests --benchmarks CorelibCompileAll(RunTime): 80944 CorelibIsolateStartup(RunTime): 5636 UseDartApi(RunTime): 404620 Dart2JSCompileAll(RunTime): 1379683 FrameLookup(RunTime): 45 Size with the new TokenStream implementation: Size of isolate snapshot = 851352 New space (0k of 32768k) Old space (1368k of 1536k) Code space (0k of 0k) out/ReleaseIA32/run_vm_tests --benchmarks CorelibCompileAll(RunTime): 76918 CorelibIsolateStartup(RunTime): 4056 UseDartApi(RunTime): 502111 Dart2JSCompileAll(RunTime): 1251646 FrameLookup(RunTime): 45 (saves about 332k out of the original TokenStream size of 410k) On x64: Original sizes: Size of isolate snapshot = 924865 New space (0k of 32768k) Old space (3234k of 3444k) Code space (0k of 0k) out/ReleaseX64/run_vm_tests --benchmarks CorelibCompileAll(RunTime): 109660 CorelibIsolateStartup(RunTime): 3985 UseDartApi(RunTime): 463009 Dart2JSCompileAll(RunTime): 2170309 FrameLookup(RunTime): 35 Size with the new TokenStream implementation: Size of isolate snapshot = 849675 New space (0k of 32768k) Old space (2436k of 2560k) Code space (0k of 0k) out/ReleaseX64/run_vm_tests --benchmarks CorelibCompileAll(RunTime): 98716 CorelibIsolateStartup(RunTime): 2938 UseDartApi(RunTime): 509149 Dart2JSCompileAll(RunTime): 2042273 FrameLookup(RunTime): 39 (saves about 798k out of the original TokenStream size of 810k) Token stats: Number of tokens: 101470 Literal tokens: 4550 Ident tokens: 33020 Review URL: https://chromiumcodereview.appspot.com//10697055 git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@9539 260f80e4-7a28-3924-810f-c04153c831b5	2012-07-11 00:11:58 +00:00
asiva@google.com	9e6f43e6e3	Prepare for writing token streams directly into a snapshot and reading it directly from the snapshot using memmove. ... Review URL: https://chromiumcodereview.appspot.com//10665035 git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@9098 260f80e4-7a28-3924-810f-c04153c831b5	2012-06-26 00:18:14 +00:00
asiva@google.com	5cbd276939	Make the parser agnostic to the TokenStream implementation. This is the first step towards compacting the token stream. ... Pull the data stream writer/reader code out of snapshot into a generic file so that it can be reused into the token stream compaction implementation. Review URL: https://chromiumcodereview.appspot.com//10632009 git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@9043 260f80e4-7a28-3924-810f-c04153c831b5	2012-06-22 20:37:01 +00:00