Commit Graph

1446 Commits

Author SHA1 Message Date
Martin Kustermann 0de8c02b6c Try work around issues executing powershell scripts on windows on the bots
R=ricow@google.com

Review-Url: https://codereview.chromium.org/2817553005 .
2017-04-12 12:28:20 +02:00
Martin Kustermann a3e9cd8ff6 Attempt at capturing screenshot on IE if tests time out
The hypothesis is that a modal dialog from Internet Explorer causes
the currently running test to hang until test.dart kills the browser.

Capturing a screenshot might give an insight into there is a dialog showing up.

BUG=https://github.com/dart-lang/sdk/issues/28955
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2811093003 .
2017-04-12 10:57:58 +02:00
Erik Corry 782fbee690 Improve test script help output for --compiler
R=kustermann@google.com
BUG=

Review-Url: https://codereview.chromium.org/2811973002 .
2017-04-11 14:54:51 +02:00
William Hesse ac23816bb7 Fix an error where html_test (which is usually null) is used without checking for null, when reporting status back to the test controller.
BUG=
R=ahe@google.com

Review-Url: https://codereview.chromium.org/2804543004 .
2017-04-06 17:16:38 +02:00
William Hesse 87f38760e6 Add retry to test scripts' attempt to delete temporary Chrome config dirs.
BUG=https://github.com/dart-lang/sdk/issues/29282
R=sortie@google.com

Review-Url: https://codereview.chromium.org/2803613005 .
2017-04-06 16:05:59 +02:00
William Hesse c3d4674a8c Remove unused call to discoverPackagesInRepository from test scripts.
Rewrite StandardTestSuite.forEachTest using async/await.

BUG=
R=kustermann@google.com

Review-Url: https://codereview.chromium.org/2793333002 .
2017-04-04 17:31:42 +02:00
Ryan Macnak 21e9a4fc65 Use -no_compact_unwind when creating dylibs on Mac.
Instructs the linker not to attempt generating _eh_frame from the DWARF info, avoiding warnings like

R=vegorov@google.com

ld: warning: could not create compact unwind for _kDartVmSnapshotInstructions: register saved more than once (might be shrink wrap)
Review-Url: https://codereview.chromium.org/2784253003 .
2017-03-31 13:37:09 -07:00
Jacob Richman 88eb557b65 Fix warnings_checker.dart handling of multitests
Update all tests

Support //# multitests for better dartfmt compatibility and fewer multitest false positives

All files under tests were manually updated with

find . -iregex '.*\.dart$' -print0 | xargs -0 perl -pi -e 's/(\S\s+)\/\/\/ /$1\/\/# /'

For now both old and new styles are allowed to accommodate CO19 tests.

R=efortuna@google.com
BUG=

Review-Url: https://codereview.chromium.org/2765693002 .
Review-Url: https://codereview.chromium.org/2765893003 .
2017-03-21 17:29:56 -07:00
Jacob Richman bf2b545150 Revert "Update all tests"
This reverts commit ce76e9c30beaf9a193d3677b88c20a1ebb3fae8c.
2017-03-21 16:33:18 -07:00
Jacob Richman 3c7353d987 Update all tests
Support //# multitests for better dartfmt compatibility and fewer multitest false positives

All files under tests were manually updated with

find . -iregex '.*\.dart$' -print0 | xargs -0 perl -pi -e 's/(\S\s+)\/\/\/ /$1\/\/# /'

For now both old and new styles are allowed to accommodate CO19 tests.

R=efortuna@google.com

Review-Url: https://codereview.chromium.org/2765693002 .
2017-03-21 12:39:28 -07:00
Ryan Macnak 25282fbf64 test.py: Push dart_precompiled_runtime and process_test once per device instead of once per test.
R=kustermann@google.com, vegorov@google.com

Review-Url: https://codereview.chromium.org/2750403006 .
2017-03-21 09:45:35 -07:00
William Hesse 2095fc382e Update name of content-shell flag --run-layout-test in test scripts
BUG=
R=sortie@google.com

Review-Url: https://codereview.chromium.org/2768493002 .
2017-03-21 13:05:05 +01:00
Ryan Macnak 9c69417a41 Add support to test.py for running Android AOT with dylibs.
R=fschneider@google.com

Review-Url: https://codereview.chromium.org/2754263003 .
2017-03-17 15:08:32 -07:00
Florian Schneider b7359ace36 test.dart: Cope with errors when locating the VS toolchain on Windows.
R=whesse@google.com

Review-Url: https://codereview.chromium.org/2723263002 .
2017-03-09 12:35:08 -08:00
Vyacheslav Egorov 021f933f69 VM: Make use_osr an Isolate flag, similar to how we made use_field_guards.
In Debug mode we have assertions checking that we don't attempt OSR when
FLAG_use_osr is disabled - however app-jit snapshots are compiled with OSR
enabled and still contain countining and OSR attempting code, which causes
assertions to fail.

Refactor how getters for isolate flags are defined, consolidate all flags into
a single list.

Update test expectations and switch -c dartk configuration to use app-jit snapshot.

BUG=
R=rmacnak@google.com

Review-Url: https://codereview.chromium.org/2728163002 .
2017-03-03 19:02:23 +01:00
Martin Kustermann c00f2f0d00 Correct help message for --write-test-outcome-log
R=whesse@google.com

Review-Url: https://codereview.chromium.org/2729153002 .
2017-03-03 11:28:16 +01:00
Zach Anderson 7af47d5ea9 [test.dart]: Fix output encoding in case of non-utf8 test output
R=kustermann@google.com

Review-Url: https://codereview.chromium.org/2721683002 .
2017-02-28 07:50:28 -08:00
Vyacheslav Egorov b026aed3cf Remove dartk and DFE workers support from testing scripts and kernel-service.
We only support running -c dark and -c dartkp configuration through Kernel isolate and fasta in non-batch mode.

R=kustermann@google.com
BUG=

Review-Url: https://codereview.chromium.org/2721543003 .
2017-02-27 13:31:03 +01:00
Vyacheslav Egorov de56824429 Switch -c dartk/dartkp configuration to use fasta.
R=kustermann@google.com
BUG=

Review-Url: https://codereview.chromium.org/2721443002 .
2017-02-26 20:39:02 +01:00
Ben Konyi 2b81624bb2 Revert "Revert "[test.dart] Complain if there is non-utf8 formatted data in test output""
This reverts commit 7af8f320a7.

TBR=zra@google.com
BUG=

Review-Url: https://codereview.chromium.org/2710603009 .
2017-02-23 17:08:15 -08:00
Ben Konyi 7af8f320a7 Revert "[test.dart] Complain if there is non-utf8 formatted data in test output"
This reverts commit c294dec5e6.

TBR=zra@google.com
BUG=

Review-Url: https://codereview.chromium.org/2705213006 .
2017-02-23 16:57:31 -08:00
Zach Anderson c294dec5e6 [test.dart] Complain if there is non-utf8 formatted data in test output
related #28872

R=ahe@google.com

Review-Url: https://codereview.chromium.org/2710003005 .
2017-02-23 14:15:26 -08:00
Devon Carew 1da570c215 Remove and hide analyzer cli flags.
BUG=
R=brianwilkerson@google.com

Review-Url: https://codereview.chromium.org/2713723003 .
2017-02-22 14:09:41 -08:00
Devon Carew 6e9adf2624 Remove older deprecated flags; more cleanup to the cli help args.
BUG=
R=brianwilkerson@google.com

Review-Url: https://codereview.chromium.org/2692203010 .
2017-02-17 13:30:37 -08:00
William Hesse 389fa95320 Remove two flags from dartanalyzer running in test.dart
BUG=
R=devoncarew@google.com

Review-Url: https://codereview.chromium.org/2691393004 .
2017-02-16 01:55:59 +01:00
Jens Johansen 7b11ede8c2 [Kernel] Replace --use-dfe with --no-dfe
Replace --use-dfe (defaulting to true) with --no-dfe (defaulting to false)
so that it is still used by default, but it is actually possible to
_not_ run with the kernel isolate and instead use dartk.

BUG=
R=vegorov@google.com

Review-Url: https://codereview.chromium.org/2689213006 .
2017-02-15 11:08:31 +01:00
Sigmund Cherem 91796be231 Add mode to test.dart to run dart2js with kernel, and include initial set of
failures in status files

BUG=
R=efortuna@google.com, whesse@google.com

Review-Url: https://codereview.chromium.org/2688413004 .
2017-02-14 14:37:23 -08:00
Martin Kustermann affb786582 Enable support for coredump archiving on windows
BUG=https://github.com/dart-lang/sdk/issues/28648
R=vegorov@google.com

Review-Url: https://codereview.chromium.org/2692883002 .
2017-02-14 16:34:31 +01:00
Martin Kustermann d93928a6ce Make dartk-{release,debug} builders work properly again
R=vegorov@google.com

Review-Url: https://codereview.chromium.org/2696613003 .
2017-02-14 14:01:58 +01:00
Peter von der Ahé cb10fc984b Add a new kind of suite to ease test.dart integration.
R=johnniwinther@google.com

Review-Url: https://codereview.chromium.org/2693893002 .
2017-02-14 10:45:44 +01:00
Zach Anderson 8a9a98073f [dart:io] flush() stdin before close()ing
Calls to close() on an IOSink do not imply that writes buffered by the
underlying StreamConsumer have been flushed. This CL adds a note
indicating this to the IOSink docs, and adds calls to flush() before
calls to close() for some calls to stdin.close() for spawned
processes in our tests.

related #28737

R=fschneider@google.com

Review-Url: https://codereview.chromium.org/2687963003 .
2017-02-10 09:55:16 -08:00
Martin Kustermann a00684d6c0 Run pub get with --verbose to debug flaky timeouts on pkg tests
BUG=https://github.com/dart-lang/sdk/issues/28734
R=vegorov@google.com

Review-Url: https://codereview.chromium.org/2683353003 .
2017-02-10 13:41:51 +01:00
Martin Kustermann be2942a279 Significantly reduce the timeout app_jit is given on the buildbot
Currently tests in the app_jit-debug configuration are given 16 minutes
timeout. This caused us to run into a global timeout of test.dart (it's
"debug timer" which is set to 10 minutes of inactivity).

Even the slowest tests run in the app_jit-debug configuration within around 1:30 m on the buildbot.

This CL changes the timeout from 16 minutes to 4 minutes.

R=vegorov@google.com

Review-Url: https://codereview.chromium.org/2685303002 .
2017-02-10 12:56:44 +01:00
Florian Schneider eccfcdf787 Remove left-over from bad merge.
BUG=
R=rmacnak@google.com

Review-Url: https://codereview.chromium.org/2687943003 .
2017-02-09 16:17:28 -08:00
Florian Schneider 20e736e6ca test.dart: Dump stack traces for child processes on timeout.
This should help flaky timeout debugging for tests that spawn child processes.

R=zra@google.com

Review-Url: https://codereview.chromium.org/2682373004 .
2017-02-09 15:34:24 -08:00
Vyacheslav Egorov d5a11f3d34 [Kernel] Enable Kernel Isolate to use Fasta instead of DartK.
We are not switching yet, but now everybody can try fasta by doing:

$ dart -DDFE_USE_FASTA=true --dfe=utils/kernel-service.dart hello.dart

Note that when using fasta we expect that patched_sdk contains platform.dill
Kernel binary containing compiled patched sdk. This file can be obtained by
doing:

$ export DART_AOT_SDK=<path-to-patched_sdk>
$ dart pkg/front_end/lib/src/fasta/bin/compile_platform.dart \
  ${DART_AOT_SDK}/platform.dill

We are also adding --use-fasta to testing script to allow end-to-end testing
of fasta (though platform.dill file needs to be generated manually prior to
running tests):

$ tools/test.py -c dartk -m release -a x64 --nobatch --use-fasta

Current test status:

$ tools/test.py -c dartk -m release -a x64 --nobatch --use-fasta
[27:34 | 100% | +12566 | - 1941]

BUG=
R=ahe@google.com, kustermann@google.com

Review-Url: https://codereview.chromium.org/2684943003 .
2017-02-08 16:48:35 +01:00
Florian Schneider 973adc3ea5 Fix failure of test_runner_test on Windows.
test_runner_test does not set up the configuration like a regular test
run with test.dart.

R=zra@google.com

Review-Url: https://codereview.chromium.org/2686453003 .
2017-02-07 11:34:49 -08:00
Florian Schneider f1d76fce1c test.dart: Find cdb.exe automatically from depot_tools when running Windows tests
cdb is used to dump a stack trace when a test times out.

Instead of relying on cdb.exe being in the PATH, find it from the installed
depot_tools.

BUG=
R=kustermann@google.com, zra@google.com

Review-Url: https://codereview.chromium.org/2672243005 .
2017-02-07 10:21:04 -08:00
Bob Nystrom e826303741 Get rid of --use-repository-packages and --use-public-packages.
The former doesn't seem to tell us anything useful, and is broken. The
latter is no longer needed as a flag without the former. The pkgbuild
suite implies it and other suites don't support it.

R=whesse@google.com

Review-Url: https://codereview.chromium.org/2673133002 .
2017-02-06 10:40:53 -08:00
William Hesse 33e89e66be Update status for analyze_libraries suite, and make it work with --use-sdk
BUG=https://github.com/dart-lang/sdk/issues/28620
R=fschneider@google.com

Review-Url: https://codereview.chromium.org/2671913002 .
2017-02-03 03:20:57 +01:00
Florian Schneider d8054eaabe Print stack traces of tests timing out on Windows
Uses cdb.exe (part of Windows SDK, comes with depot_tools) to dump stack traces of all threads when a test times out similar
to what we already do on Linux and MacOS.

Note that cdb.exe comes in two version (32- and 64-bit). For proper stacktraces the correct version must be in the PATH.

Fixes #28242.

R=kustermann@google.com

Review-Url: https://codereview.chromium.org/2670763002 .
2017-02-02 10:25:30 -08:00
Asger Feldthaus 14c6b27533 Put tree-shaking behind a flag in dartk.
BUG=
R=jensj@google.com

Review-Url: https://codereview.chromium.org/2669783002 .
2017-02-02 15:10:10 +01:00
Ryan Macnak 6b1315a06f Revert "Delete app jit or aot snapshots as each test is completed to reduce the amount of disk space required to run the test suite."
This reverts commit 302e54a55d.

Review-Url: https://codereview.chromium.org/2671503002 .
2017-02-01 10:51:28 -08:00
Ryan Macnak 302e54a55d Delete app jit or aot snapshots as each test is completed to reduce the amount of disk space required to run the test suite.
R=whesse@google.com

Review-Url: https://codereview.chromium.org/2666833004 .
2017-02-01 09:20:48 -08:00
Ryan Macnak 9eb216a495 Reapply "Create an app snapshot of the Dart front end."
Skip training on Windows, issue #28532.

R=hausner@google.com

Review-Url: https://codereview.chromium.org/2665753002 .
2017-01-31 09:47:51 -08:00
Vyacheslav Egorov a7ffe24177 VM: [Kernel] Switch to DFE for testing -c dartk configuration.
R=kustermann@google.com

Review-Url: https://codereview.chromium.org/2668503003 .
2017-01-31 18:25:02 +01:00
Vyacheslav Egorov e8f456edd5 Buildbot: Only archive core dumps from unexpected crashes.
Change UnexpectedCrashDumpArchiver to generate coredumps file in the current
directory. Each line of this file specifies a core and a binary to be
uploaded in the following format:

              test-name,core-file,binary-file

CoreDumpArchiver reads this file and uploads the first 10 crash dumps.

R=kustermann@google.com
BUG=

Review-Url: https://codereview.chromium.org/2645963004 .
2017-01-20 17:44:51 +01:00
Zachary Anderson 306b0ec249 Fuchsia: Build an OS image that includes Dart's test suite.
Guarded by a GN argument, this CL builds a Fuchsia OS image
that includes Dart tree, including the test suite, packages,
test harness, and sufficient build output to run through the
test suite.

R=asiva@google.com

Review-Url: https://codereview.chromium.org/2547013003 .
2017-01-19 10:11:27 -08:00
Vyacheslav Egorov 84820ba05e Fix analyzer warnings in tools/testing/dart/test_progress.dart
R=kustermann@google.com
BUG=

Review-Url: https://codereview.chromium.org/2642153002 .
2017-01-19 17:49:52 +01:00
Vyacheslav Egorov 6c9ca0cd2b Buildbot: Change --copy-crashdumps to do the actual archiving to CloudStorage.
This flag now both enables core dump collection by setting appropriate rlimits
and takes care of archiving cores and crashed binaries.

R=kustermann@google.com

Review-Url: https://codereview.chromium.org/2640093005 .
2017-01-19 17:25:39 +01:00