Commit Graph

6631 Commits

Author SHA1 Message Date
Johnni Winther 9abec74aaf Fix index bug in readResults
R=floitsch@google.com

Review-Url: https://codereview.chromium.org/2996013002 .
2017-08-16 14:28:41 +02:00
William Hesse 0f89db24f3 Add all core tests to DDC linux bots
BUG=
R=athom@google.com

Review-Url: https://codereview.chromium.org/2997863002 .
2017-08-16 10:07:53 +02:00
Johnni Winther d2676d2f16 Use Bot in compare_failures
R=floitsch@google.com

Review-Url: https://codereview.chromium.org/3000953002 .
2017-08-15 14:52:47 +02:00
Johnni Winther aa7f14aed3 Use timeout to read most recent build from http
R=floitsch@google.com

Review-Url: https://codereview.chromium.org/2998993002 .
2017-08-15 14:36:27 +02:00
Zachary Anderson 734beef062 [infra] Translate _sources.gypi files to _sources.gni files
Also deletes code that becomes dead as a result.

R=rmacnak@google.com

Review-Url: https://codereview.chromium.org/2996903002 .
2017-08-14 21:54:36 -07:00
Janice Collins d2f2b0f44d Add cases to all configs and allow for running a single test.
This adds analyzer-strong-checked as distinct from analyzer-strong,
which seems to be how the bots run it.  Also adds the d8 runtime to dart2js as that was the cause of some bot breakage.

Finally, you can now run one test by just passing a single parameter.

BUG=
R=bkonyi@google.com, jmesserly@google.com

Review-Url: https://codereview.chromium.org/2997673002 .
2017-08-14 07:48:11 -07:00
Stephen Adams 88388cb5ca Revert "Remove support for "packages" URL from testing server."
This reverts commit f38f91bb7e.

Lots of browser bots are red with this change.
Hopefully it can be recommitted atomically with changes that fix the redness.

TBR=whesse@google.com

BUG=

Review-Url: https://codereview.chromium.org/2997753002 .
2017-08-10 17:04:21 -07:00
William Hesse f38f91bb7e Remove support for "packages" URL from testing server.
This support was only needed for testing Dartium.
This also removes the dependency upon package_resolver from test.py.

BUG=
R=eernst@google.com, mkroghj@google.com

Review-Url: https://codereview.chromium.org/2994073002 .
2017-08-10 14:33:07 +02:00
Zachary Anderson 63b9312e1b Invoke copy_tree.py only once to collect all input file lists.
fixes #30105

R=rmacnak@google.com

Review-Url: https://codereview.chromium.org/2992353002 .
2017-08-09 11:14:01 -07:00
Jennifer Messerly a77f151461 fix #30330, don't ignore cast failures in DDC for language/lib tests
R=leafp@google.com

Review-Url: https://codereview.chromium.org/2999593002 .
2017-08-08 21:57:45 -07:00
Alexander Aprelev 1d50f112dc Flutter and Fuchsia build stripped down [platform] version of dart sdk, so make it default(while standalone builds full dart sdk)
Both Flutter and Fuchsia expect stripped dart in standard out directory, so make that default too(while standalone build puts stripped into exe.stripped/).

BUG=
R=zra@google.com

Review-Url: https://codereview.chromium.org/2998503002 .
2017-08-08 14:42:11 -07:00
Johnni Winther 798577d188 Add filtering to 'summary'
- and include positive result summary in the output.

R=floitsch@google.com

Review-Url: https://codereview.chromium.org/2993913002 .
2017-08-08 16:26:41 +02:00
Johnni Winther 494d2c623e Improve output of current-summary gardening tool.
R=floitsch@google.com

Review-Url: https://codereview.chromium.org/3000493002 .
2017-08-08 16:25:42 +02:00
Johnni Winther c54869c648 Include passing tests in BuildResult.results
R=floitsch@google.com

Review-Url: https://codereview.chromium.org/2990363002 .
2017-08-08 16:24:27 +02:00
Johnni Winther 803ec54d1c Improve compare-failures output for multiple [BuildUri] results
R=floitsch@google.com

Review-Url: https://codereview.chromium.org/2999623002 .
2017-08-08 16:23:16 +02:00
Sigmund Cherem b48584d3d0 Switch FE to use the libraries.json format.
This CL:
  * introduces the Dart API to operate over libraries specifications and describes
    the format we intend to use (see libraries_spec.dart)

  * implements serialization/deserialization for this API

  * switches over the front_end to use these APIs
    * public options accept a URI to the JSON file and no longer
       accept a `dartLibraries` map
    * internal code uses the LibrariesSpecification API

  * switches other dependencies on these APIs (resynthesizer_test and patch_sdk.dart)

This is the first step in migrating over to use the libraries.json format and
eventually remove the patched_sdk step. In particular, some of the next steps
include:
  * add a build step to generate .json files from .yaml files
  * add a libraries.yaml file for the sdk
  * split the patched_sdk step in two:
     * patching files
     * generating .dill files
  * add any missing support for patch-files in fasta
  * finally remove the patching files step, and only have a build step for generating
   .dill files

BUG=
R=ahe@google.com, paulberry@google.com, scheglov@google.com

Committed: https://github.com/dart-lang/sdk/commit/abf2d23af2315fae6dc688741147ef677ec34835
Review-Url: https://codereview.chromium.org/2986303003 .
2017-08-07 08:41:28 -07:00
Zach Anderson 0394d3a0cf [infra] Begin removing gyp
This CL begins removing gyp from Dart's tree.

Removing gyp will go in three stages:
1. Remove unused .gyp and .gypi files.
2. Translate *_sources.gypi files to *_sources.gni files
3. Remove //third_party/gyp from DEPS

This CL is stage 1.

R=asiva@google.com

Review-Url: https://codereview.chromium.org/2992593002 .
2017-08-04 22:19:35 -07:00
Sigmund Cherem b6d08264a3 Revert "Switch FE to use the libraries.json format."
This reverts commit abf2d23af2.

Reason for revert:
 - win build failed in patched_sdk (likely storing paths and not uris)
 - dart2js bots failed (missing flag)

Will fix the issues and reland shortly.

Review-Url: https://codereview.chromium.org/2993113003 .
2017-08-04 19:46:17 -07:00
Bob Nystrom 850b80a84e Fix analyzer status for cast_test.
Also add another configuration in the migration test runner to catch
this in the future.

Review-Url: https://codereview.chromium.org/2993123003 .
2017-08-04 18:37:18 -07:00
Sigmund Cherem abf2d23af2 Switch FE to use the libraries.json format.
This CL:
  * introduces the Dart API to operate over libraries specifications and describes
    the format we intend to use (see libraries_spec.dart)

  * implements serialization/deserialization for this API

  * switches over the front_end to use these APIs
    * public options accept a URI to the JSON file and no longer
       accept a `dartLibraries` map
    * internal code uses the LibrariesSpecification API

  * switches other dependencies on these APIs (resynthesizer_test and patch_sdk.dart)

This is the first step in migrating over to use the libraries.json format and
eventually remove the patched_sdk step. In particular, some of the next steps
include:
  * add a build step to generate .json files from .yaml files
  * add a libraries.yaml file for the sdk
  * split the patched_sdk step in two:
     * patching files
     * generating .dill files
  * add any missing support for patch-files in fasta
  * finally remove the patching files step, and only have a build step for generating
   .dill files

BUG=
R=ahe@google.com, paulberry@google.com, scheglov@google.com

Review-Url: https://codereview.chromium.org/2986303003 .
2017-08-04 17:41:27 -07:00
Bob Nystrom f2b8669a0b Output test results in diff mode.
R=jmesserly@google.com

Review-Url: https://codereview.chromium.org/2996563002 .
2017-08-04 17:16:45 -07:00
Bob Nystrom 6b7819ec5a Handle migration status entries into split up status files.
R=jcollins@google.com

Review-Url: https://codereview.chromium.org/2994573002 .
2017-08-04 13:49:30 -07:00
Bob Nystrom 9a0c11c26b Split language_2.status into multiple files.
This mainly splits along compiler lines, but uses runtime for a couple
of things -- VM and Flutter mainly.

I did most of the work automatically by hacking up the migration script
to re-migrate the existing file, but I also went through and manually
cleaned the result up as best I could.

R=bkonyi@google.com, jcollins@google.com

Review-Url: https://codereview.chromium.org/2993043002 .
2017-08-04 11:33:01 -07:00
Kevin Moore d53e53c568 Fix path to pkg/path – .packages resolution works to the root of repo 2017-08-04 11:14:23 -07:00
Bob Nystrom 526245b565 Run DDC tests on Chrome on the bots.
Taking over this patch since Bill is out: https://codereview.chromium.org/2991343004/

R=sigmund@google.com

Review-Url: https://codereview.chromium.org/2992333002 .
2017-08-04 10:45:39 -07:00
Florian Loitsch 83fcb7aa94 Small improvements to bot summary.
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2996503002 .
2017-08-04 15:13:07 +02:00
Florian Loitsch aaf67e5050 Fix bot summary when URIs couldn't be read.
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2999433002 .
2017-08-04 14:46:57 +02:00
Jennifer Messerly 62303b6711 enable batch mode for dartdevc tests, also fix status so ddc bots pass
R=rnystrom@google.com

Review-Url: https://codereview.chromium.org/2987393002 .
2017-08-03 14:39:45 -07:00
Janice Collins 481ce5813c Add more targets to run_tests based on experience in blocks 7 and 8
BUG=
R=rnystrom@google.com

Review-Url: https://codereview.chromium.org/2988423002 .
2017-08-03 11:39:47 -07:00
Johnni Winther 771415a7c0 Add tests for change in https://codereview.chromium.org/2987403002/
R=dmitryas@google.com

Review-Url: https://codereview.chromium.org/2988403002 .
2017-08-03 14:01:11 +02:00
Johnni Winther baed658109 Allow multiple inputs to compare-failures
- and ensure that TestFailure is created with the BuildResult.buildUri

R=dmitryas@google.com

Review-Url: https://codereview.chromium.org/2987403002 .
2017-08-03 12:24:36 +02:00
Bob Nystrom dbd48de07d Fix a couple of things causing bot redness:
- Migrate over built_in_identifier_test since it imports a helper
  library that was migrated.
- Fix some status file entries.

Also:

- Removed some old commented out status entries.
- Fix a bug in migration script.

R=jcollins@google.com

Review-Url: https://codereview.chromium.org/2992903002 .
2017-08-02 14:54:07 -07:00
Dmitry Stefantsov b5aeeb5b25 [Gardening Tool] Allow filtering groups by names in current_summary.dart
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2989263002 .
2017-08-02 16:49:03 +02:00
Dmitry Stefantsov 39e43776d7 Change backslashes to forward slashes in pubspec.yaml of gardening tool
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2988313002 .
2017-08-02 13:56:15 +02:00
Johnni Winther f22caf4028 Add tests for BuildGroup names
R=dmitryas@google.com

Review-Url: https://codereview.chromium.org/2986223002 .
2017-08-02 12:18:34 +02:00
Johnni Winther dc83f62199 Add test to compare-failures
+ support build group names as command-line argument

R=dmitryas@google.com

Review-Url: https://codereview.chromium.org/2987253002 .
2017-08-02 09:38:53 +02:00
Bob Nystrom 95693b30a3 Add a script to run the tests in a migration block.
R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2987223002 .
2017-08-01 13:52:20 -07:00
Siva Annamalai f1689b6eb0 Migrate first block of tests in standalone to standalone_2
R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2984363004 .
2017-08-01 09:05:01 -07:00
Sigmund Cherem 62d1d28428 Remove warnings when building the dart2js sdk.
Also make the script exit with error code if any other warnings of this kind are
seen.

Fixes #30282 #30157

R=sra@google.com

Review-Url: https://codereview.chromium.org/2993493002 .
2017-07-31 15:47:53 -07:00
Florian Loitsch ee46026671 Don't use LinkedList in the core libraries anymore.
R=lrn@google.com

Committed: https://github.com/dart-lang/sdk/commit/fe17b5b2bc24454dd2f596d8ce6e2e7661e87f10
Reverted: https://github.com/dart-lang/sdk/commit/5d4a786f4466ebcb06c36ed44f262c9e120a7273
Review-Url: https://codereview.chromium.org/2975443002 .
2017-07-28 21:14:11 +02:00
Bob Nystrom 385b88f289 Migrate status file entries when migrating files. Yay!
This looks at all the files in the batch being migrated. It goes through
the status files in the 1.0 and strong directories. If it sees an entry
that matches that file, it adds it to the resulting "_2" status file.

It handles adding entries to an existing section if already present in
the new status file. Otherwise, it adds a new section at the end with
the entries.

R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2989033002 .
2017-07-28 11:10:30 -07:00
Sigmund Cherem b1065335cd Use dart2js_plaform.dill from the sdk.
This will enable --use-kernel tests in the dart2js bots.

After this change, running our tests will change a little bit, either of these
would work:

Option A: --use-sdk (host-checked not allowed)

python tools/test.py -m release \
   -c dart2js -r d8 --dart2js-batch --report \
   --dart2js-with-kernel --use-sdk \
   language corelib library_2 corelib_2 \
   dart2js_native dart2js_extra

Option B: pass --library-root, --host-check works here.
python tools/test.py -m release \
   -c dart2js -r d8 --dart2js-batch --report \
   --dart2js-with-kernel --host-checked \
   --dart2js_options="--library-root=out/ReleaseX64/dart-sdk/" \
   language corelib library_2 corelib_2 \
   dart2js_native dart2js_extra

In the future, when fasta supports compiling sdk with @patch files, we will
be able to remove the --library-root option and simply compile the SDK from
sources at that point.

BUG=
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2988063002 .
2017-07-28 10:07:08 -07:00
William Hesse 56d58fe65e Add two swarming trybots to configuration
BUG=
R=erikcorry@google.com

Review-Url: https://codereview.chromium.org/2988073002 .
2017-07-28 14:05:11 +02:00
Bob Nystrom 1419935fa6 Better support for re-running in the middle of a migration.
- Track files that only exist in the "_2" directories. That way we can
  show what work still remains to be done even if the unmigrated files
  are gone.

- Friendlier matching of command line arguments. Pass in any substring
  of the test path and if only one test matches, it will be used.

- Make --dry-run not crash.

R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2988973002 .
2017-07-27 12:07:21 -07:00
William Hesse c3ae54c019 Update buildbucket name for Gerrit commit queue
BUG=
R=dnj@chromium.org

Review-Url: https://codereview.chromium.org/2985153003 .
2017-07-27 15:35:44 +02:00
Bob Nystrom cc8ae6b723 Add some more validation of things in expect that should not be used.
Also add some helper functions in expect.

R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2989743002 .
2017-07-26 16:52:18 -07:00
Bob Nystrom 158e95a940 Report more heuristics for tests that require manual work.
If the contents of a test mention "checked", "TypeError", or
"AbstractClassInstantiationError", they will need some work. Tell the
user about those.

R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2991803003 .
2017-07-26 12:57:30 -07:00
Ben Konyi caf87da9ed Added functionality to dump relevant status file entries to a single file to make it easier to see which tests have which status file entries. Future work: remove entries from original status files.
BUG=
R=jcollins@google.com, rnystrom@google.com

Review-Url: https://codereview.chromium.org/2987633002 .
2017-07-25 17:48:09 -07:00
Bob Nystrom 796eb21071 Move the status file parser into its own package.
This required munging a bit of test.dart code too to tease out some
dependencies, but the changes are minor. I considered moving all of
test.dart out into a package and making the status file library a
public one that other packages in the repo could import but this seemed
like the less intrusive change.

R=bkonyi@google.com

Review-Url: https://codereview.chromium.org/2984203002 .
2017-07-25 15:29:59 -07:00
Zachary Anderson c0319c8399 [Fuchsia] Update prebuilt SDK sha only after a successful download
R=rmacnak@google.com

Review-Url: https://codereview.chromium.org/2988813002 .
2017-07-25 14:08:22 -07:00