375c4a9657
[vm/fuzzer] Disable CC for most types
...
Change-Id: I7ab01cd7ca2d5f9ec23f5be9dfbe7c4dfc7b46a8
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119768
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-10-03 00:12:02 +00:00
22479a17ff
[vm/fuzzer] Sort generated tables.
...
Change-Id: I5f8cac14ffeb05f12889a42706de02a40b72cd75
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119727
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-10-02 23:27:41 +00:00
9050e28bf0
[vm/fuzzer] Avoid STRING *= large number in loops
...
Change-Id: I2048b1c888a9656107bcee6a966f4658c9bab4a2
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119740
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-10-02 23:25:01 +00:00
f46e5ee44e
[vm/fuzzer] Make num type non instantiable
...
Change-Id: I7ea37b58f1a3464ff4565219268f1a8bf3b04672
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119720
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-10-02 21:04:04 +00:00
1b911958a5
[vm/fuzzer] split analyzer import from nightly run
...
Rationale:
Table generation uses the analyzers, but bots don't.
Change-Id: I75cda624244493e7bb81657add9e7401480971ba
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119528
Commit-Queue: Aart Bik <ajcbik@google.com >
Reviewed-by: Felicitas Hetzelt <felih@google.com >
2019-10-01 17:52:26 +00:00
63b5fa1709
[dart/vm] Extend dartfuzz type system
...
Rationale:
Enable extraction of dart type information from the dart analyzer to aid
dart program generation for fuzzing.
Change-Id: Ic8df02460dae49b116069e2f7ca4eb49517bd7a8
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/112161
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-10-01 01:02:29 +00:00
d2897ff85f
[vm/fuzzer] Catch oom error on last block
...
Rationale:
VM might run out of memory when printing global vaiables at the last
step.
Change-Id: I4450e05d71218582003e8e3eb56be0e68cb39002
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119167
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-27 19:54:20 +00:00
7263b9aa9d
[vm/fuzzer] rename dartfuzz_ffiapi
...
Change-Id: I19ed3716c40e9a80f18045dcab77ece4cb2f6e35
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/119064
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-26 21:11:45 +00:00
c6a14f4459
[vm/fuzzer] Fix heapsize
...
Change-Id: Ib6d61d35e9c5e4b556d0d9d9d6cf7da18e8670fd
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118907
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-26 01:06:12 +00:00
80c045ee82
[vm/fuzzer] Fix non minimized test runs
...
Rationale:
On normal runs the minimization fields are set to null, therefore
any access to them should be avoided.
Change-Id: I03bb56345f0ec8466eba0ae38d6affb030d1c175
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118906
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-25 22:05:02 +00:00
3e71f286f6
[vm/fuzzer] Add auto minimization tool
...
Change-Id: I23929e67da1efd2853137816c5bc1d039264f296
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115541
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-25 18:51:21 +00:00
326c00c6d7
[vm/fuzzer] Reduce number of methods per class
...
Rationale:
Reducing codesize to avoid timeouts on SIMARM builds.
Change-Id: I0f3ec773470ed2c60a9bc6f1c4ac65b7b4089a1e
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118466
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
2019-09-23 21:50:59 +00:00
60c2bb9f5b
[vm/fuzzer] Disable controlflow collections
...
Change-Id: I17d3bd882697a9e167177a5ae104d77405487bd7
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118360
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-20 22:19:47 +00:00
5aafee5196
[vm/fuzzer] Fix Analyser
...
Change-Id: I324a6957aa972fb12d0541a84509f7bd71e6c1f9
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118201
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-19 22:09:44 +00:00
ccd19cd94d
[vm/fuzzer] Decrease collection size
...
Rationale:
Control flow collections might contain multiple elements constructed
by loops. We should reduce the number of elements produced by each loop
to avoid creating too large collections.
Change-Id: Ib923b5a702fd246ff8a6d1a7f0926d7f791af610
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118107
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
2019-09-19 20:32:28 +00:00
b2a9dc16ec
[vm/fuzzer] Allow no recursion within collections
...
Change-Id: Ia8453f5981461c8cc57cffef66dfec14f9d43714
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/118105
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-19 19:09:57 +00:00
0c23664c8f
[vm/fuzzer] Reduce number of methods per class
...
Rationale:
Decrease avarage runtime.
Change-Id: Ia6821c82942eb06efbc09025e667fa0a84b3b6ab
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117641
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-19 02:06:50 +00:00
5fc5c68c87
[vm/fuzzer] Deprecate DBC from DartFuzz tools
...
Change-Id: Ib6a829e2def34258b8aa48cfea44ef052eaa3f3a
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117582
Reviewed-by: Felicitas Hetzelt <felih@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-17 19:38:51 +00:00
963b98715d
[vm/fuzzer] Reduce limit on emitted classes
...
Rationale:
Reduce the limit on emitted classes to hopefully reduce timeouts
on simarm builds again.
Change-Id: I562e2880bfa0df2fac9fcd0b74b85ba6cf5ae53b
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117289
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-16 18:27:49 +00:00
4512b22595
[vm/fuzzer] Call all virtual methods
...
Change-Id: I1dd0d36720091904e2b2ff6db435fb233933dace
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117101
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-09-14 00:51:05 +00:00
f7638fc2fb
[vm/fuzzer] Filter exponential assigments
...
Change-Id: I6c7e947632637b17ff847c86f39aa576972cebb3
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116482
Reviewed-by: Aart Bik <ajcbik@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-13 23:47:05 +00:00
bded2e015e
[vm/fuzzer] fix newline when printing timeouts
...
Change-Id: Ic2a88d5d3ada4f48dfb55640ae917a0d6944e77e
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117207
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-13 22:11:56 +00:00
683dca0e9a
[vm/fuzzer] Fix an inconsistency with local names
...
Rationale:
Some expression have the property that a variable has been declared
but cannot be used yet (viz. T x = .... no x ....). The old
fuzzer would avoid this by only introducing x after the declaration.
However, now that we also allow for-loops inside expressions
due to control flow collections, this mechanism would start
to hide local names since the bookkeeping was off. This PS
fixes that by introducing "typeless" locals, which are in
scope, but cannot be lvalled yet.
Change-Id: I11f752dc8b85305644901faad1ac7814424a9c1e
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117120
Reviewed-by: Felicitas Hetzelt <felih@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-13 00:27:40 +00:00
a09845fe3d
[vm/fuzzer] Track and print invalid test cases
...
Rationale:
To make debugging timeouts and skipped test cases easier, we
print them at the end of each isolate run.
Change-Id: I953c9103341dcf23616e2b550af5ebb5ce17739b
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/117060
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-12 23:49:17 +00:00
c8e389ff62
[vm/fuzzer] List versions for each git commit
...
Rationale:
Go through all git commits and list dartfuzz versions.
Change-Id: I2d6ac23fcff51631a40a97bb53289fd60e65000c
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116747
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-11 22:54:29 +00:00
1e9a065dad
[vm/fuzzer] Restrict depth of ... operator
...
Rationale:
Causes bugs in compiler
Change-Id: I11039e0efa8ea97d576b7527554dc26499c492d8
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116700
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-09-11 01:08:54 +00:00
a0fd607d10
[vm/fuzzer] add missing space
...
Change-Id: I39e4bf30a908a77dc96b2a1fb81f2251705de3be
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116543
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-11 00:40:44 +00:00
5303538a09
[vm/fuzzer] re-enable control flow collections
...
Rationale:
Let's stress test this feature again. Note
that this will increase the number of skipped
tests quite a bit since the CFE complains
about a lot of the generated constructs.
It is still TBD to find out if this is
in the grammar or in the FE.
https://github.com/dart-lang/sdk/issues/38231
Change-Id: Iec4bcb2aa9039f5b01293f82e3e156cc2e35414f
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116663
Reviewed-by: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-10 23:09:58 +00:00
ca7baa4013
[vm/fuzzer] Add virtual methods
...
Rationale:
Randomly overvwrite some methods of the parent in the child classes.
Change-Id: I64533c255915d3c1614ba41883ed6b5fd319c5c7
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115009
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-09-10 18:38:01 +00:00
2b966a9743
[vm/fuzzer] Fix reproduction output
...
Rationale:
Add space between fp and seed parameter. Check whether generate variable
is set in TestRunnerKBC.
Change-Id: I3f1b21b65e75286d2ca560d9fa8c05ed3e4e5f55
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116542
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-10 18:30:51 +00:00
424ef3646e
[vm/fuzzer] Print steps to reproduce on divergence
...
Change-Id: I0bf112e42c3b1d2575fac89adab0462b0fe34ded
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116420
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-10 00:35:54 +00:00
e1dc432102
[vm/fuzzer] Update rerun output and parser script
...
Change-Id: I893d54d04d6ac8ef7b8fa730b9d29a5e2783b27f
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116052
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-06 23:06:56 +00:00
254d0776d4
[vm/fuzzer] Fix bug where FFI caused dart crash
...
Rationals:
Default return values for FFI functions can not be negative.
Change-Id: I054522f473a601c239a262884ba9b779dc648772
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/116049
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-06 22:12:48 +00:00
e55a1e0f3a
[vm/fuzzer] Add filter keywords to collect_data
...
Rationale:
If we see many duplicated errors, the filter keywords can be used to
remove these from the output.
Change-Id: I7cf5c035a92aad465aa4dbfec99a03b5a64ca69d
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115820
Reviewed-by: Ben Konyi <bkonyi@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-06 18:41:30 +00:00
c6a6add465
[vm/fuzzer] Count re-runs
...
Change-Id: Ia12c0eec966e93aec5210372dd294837cfc100ce
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115841
Reviewed-by: Ben Konyi <bkonyi@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-06 18:38:19 +00:00
fb14babf59
[vm/fuzzer] disable control flow collections again
...
Rationale:
I need a bit more time to investigate the failures.
No need to have massive amounts of divergences in
our nightly in the meantime.
https://github.com/dart-lang/sdk/issues/38231
Change-Id: I2fee0ba36292a2a38fce1d9a4727e5c4b74f0f1c
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115842
Reviewed-by: Felicitas Hetzelt <felih@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-06 16:24:30 +00:00
bbe6624074
[vm/fuzzer] Enable control-flow collections, cleanup
...
Rationale:
Control flow collections are already the default for
a while, but this TODO was still there. We are now
testing all features of CFC fully. Also did some
comment cleanup and removed old-style "new" syntax.
Moved constructors into try-catch just in case
we will add code into constructors in the future.
Change-Id: I557650575f41d7501a0c6f37c07756ca47ad54fd
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115444
Reviewed-by: Ben Konyi <bkonyi@google.com >
Commit-Queue: Aart Bik <ajcbik@google.com >
2019-09-04 19:30:36 +00:00
a5ca7e9177
[vm/fuzzer] Fix loading of FFI C-library
...
Bug: https://github.com/dart-lang/sdk/issues/38146
Change-Id: Id067f8fb77b5d8a57682c9058a4764292e1ecb0d
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115274
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-09-03 22:25:27 +00:00
5db9c6f6cd
[vm/fuzzer] Separate iteration limit
...
Rationale:
The limit on the number of classes is the same as the number of methods
per class, leading to exponential growth of the generated program if
this limit is raised. This patch introduces an optional parameter to
increase the limit separately for different use cases.
Change-Id: Id74d00a47494162a67fd980c163243690c5c1ebb
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115004
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-09-03 22:20:27 +00:00
cb0abfef47
[vm/fuzzer] Avoid recursive assignments in foreach
...
Rationale:
Adding a new element to a Map while iterating over the same Map
will cause an exception. This patch should avoid such assignments.
Change-Id: I82e461deabcf41291fe0d584905fbb03da2c8b08
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114752
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-09-03 18:33:15 +00:00
d258ca96b0
[fuzzer/vm] Simple mixins
...
Change-Id: If1f09284ee6f6af1252443aadc4ebb24502c608f
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114592
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-08-30 23:54:48 +00:00
8468f1435c
[vm/fuzzer] Produce FFI testcases only sometimes
...
Change-Id: Id8d711362efedcc835e72066c8579c5859d67978
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115120
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-08-30 21:49:48 +00:00
6a8b75ff8d
[vm/fuzzer] Call each generated method once
...
Rationale:
Compiling takes time, so we should make sure that most of the compiled
code is actually executed.
Change-Id: I9c4af7e1940035a7ee2518f5b905dc204d8d0d8e
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115007
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-08-30 00:26:43 +00:00
6c38345818
[vm/fuzzer] Add FFI calls to C library
...
Rationale:
Uses a simple C library to test FFI interface.
Bug: https://github.com/dart-lang/sdk/issues/38008
https://github.com/dart-lang/sdk/issues/37606
Change-Id: I0bb57db5a9977e2300dcace8fef85a2a92d50e41
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114556
Commit-Queue: Felicitas Hetzelt <felih@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-08-29 22:45:33 +00:00
fd48ea3432
[vm/fuzzer] Randomly choose intervals for flags
...
Rationale:
Trigger garbage collection, de-optimization and stacktrace at random
intervals.
Change-Id: Icc2295d8c28babf43949dea4c90b44467adc901d
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/115001
Reviewed-by: Ben Konyi <bkonyi@google.com >
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-08-29 21:59:33 +00:00
4e4ec6082c
[vm/fuzzer] Add '=>' functions
...
Change-Id: I8ca61e382279c7176bf210134ff9fa97d205b41c
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114925
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-08-29 18:15:29 +00:00
ef36f1ba0d
[vm/fuzzer] Reduce limit on methods and classes
...
Rationale:
Due to recent performance degradation, we reduce the limit on emitted
methods and classes back to its old value.
Change-Id: Icd3c6bb65a380ded5b0a72b2a569c47d1d67e5c6
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114749
Reviewed-by: Aart Bik <ajcbik@google.com >
Reviewed-by: Ben Konyi <bkonyi@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-08-28 20:52:01 +00:00
86ad613bf7
[vm/fuzzer] Enable package:pedantic analysis options
...
Change-Id: I2a1bf49f614a127c00f441f58d2eb687421a0314
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114566
Reviewed-by: Aart Bik <ajcbik@google.com >
2019-08-27 18:37:07 +00:00
69c6bea18f
[ fuzzer ] Fixed analysis warnings in dartfuzz, enabled analysis as part of bot checks
...
Also ran dartfmt -w --fix on runtime/tools/dartfuzz.
Change-Id: I2b5154590300889a7da35eb0ed3ee20a8e14c606
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114551
Reviewed-by: Aart Bik <ajcbik@google.com >
Reviewed-by: Felicitas Hetzelt <felih@google.com >
2019-08-26 21:22:12 +00:00
a5c961d50b
[vm/fuzzer] Simple class hierarchies
...
Rationale:
Allow multiple classes to inherit from the same parent and to call
arbitrary methods of the direct parent.
Change-Id: I2db20811c252b1f9008154632f16b625333f4b56
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/114050
Reviewed-by: Aart Bik <ajcbik@google.com >
Commit-Queue: Felicitas Hetzelt <felih@google.com >
2019-08-26 20:23:01 +00:00
Felicitas Hetzelt