c8de060c54
Revert "Revert "Use native async/await support in pub.""
...
The VM now fully supports all the weird async stuff pub is doing, and all the
tests pass with native async/await!
Previous CLs were r43484 and r43483.
R=rnystrom@google.com
Review URL: https://codereview.chromium.org//937243002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43897 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-19 22:28:54 +00:00
952a4124fe
Include environment overrides when building repro command.
...
This is important since flags to the Dart VM are passed through an environment variable.
R=whesse@google.com
Review URL: https://codereview.chromium.org//909603003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43765 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-13 15:41:05 +00:00
0c21c996db
Add SkipSlow marker
...
This is to be used temporarily until we can start running slow tests on seperate bots.
R=whesse@google.com , kevmoo@google.com
BUG=22402
Review URL: https://codereview.chromium.org//924793002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43751 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-13 10:02:30 +00:00
37f9165c0b
Revert "Remove test retrying for Safari, in test scripts."
...
TBR=whesse@google.com
BUG=
Review URL: https://codereview.chromium.org//902083004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43542 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-06 06:44:08 +00:00
10595e509d
Make standalone tests not dependent on current working directory.
...
This also simplifies DartOptions - could we simply remove it, the only usage is the arguments test which could simply call the vm on another file, and validate the output?
R=iposva@google.com , sgjesse@google.com
BUG=
Review URL: https://codereview.chromium.org//899243002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43511 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-05 16:29:39 +00:00
c859d25679
- Return exit code 253 in case of API errors during loading. This
...
will trigger for example when loading outdated snapshots.
R=ricow@google.com
Review URL: https://codereview.chromium.org//899523005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43505 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-05 14:30:24 +00:00
1c8158500c
Remove test retrying for Safari, in test scripts.
...
BUG=dartbug.com/21434
R=ricow@google.com
Review URL: https://codereview.chromium.org//884073003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43503 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-05 13:05:47 +00:00
bbe0d9325c
Revert "Use native async/await support in pub."
...
This caused SDK compilation issues that may have obscured pub test failures as
well.
R=rnystrom@google.com
Review URL: https://codereview.chromium.org//887223007
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43484 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-04 21:15:44 +00:00
1835c63d0a
Use native async/await support in pub.
...
R=rnystrom@google.com
Review URL: https://codereview.chromium.org//896623005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43483 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-04 20:45:49 +00:00
e39f5e5ab0
Cache a computed directory in test_suite.dart.
...
BUG=dartbug.com/22221
R=ricow@google.com
Review URL: https://codereview.chromium.org//877403003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43402 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-03 15:29:24 +00:00
3103024ab2
Fix bad code in test_suite.dart
...
BUG=dartbug.com/22221
R=ricow@google.com
Review URL: https://codereview.chromium.org//900443004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43390 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-03 12:04:47 +00:00
8257b1874e
Restart ie11 browser while running tests. Update status files.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//888013002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43329 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-30 10:33:07 +00:00
5406811398
Restart IE 10 browser as we do with Android browsers on buildbot, to improve stability
...
BUG=22203
Review URL: https://codereview.chromium.org//867083003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43294 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-29 16:24:00 +00:00
24cac2a7f6
cleanup to status_reporter
...
Infer build architectures from combinations
Print build command
Fix comments
R=ricow@google.com
Review URL: https://codereview.chromium.org//860723002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43016 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-20 16:49:03 +00:00
014a89563a
Add debug logging for android testing.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//863663002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43005 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-20 11:39:09 +00:00
247ff772d6
Update status files, replace "dartbug.com" with "Issue ".
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//845793004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42900 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-15 10:27:11 +00:00
5bba992965
Enable co19 dart2js browser tests on content shell (drt).
...
Update co19 status files for Firefox update to 35, and other flakes.
TBR=ricow@google.com
Review URL: https://codereview.chromium.org//847393002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42873 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-14 15:56:28 +00:00
9df5e56e9f
tools: fix break in test_progress
...
TBR
Review URL: https://codereview.chromium.org//829803005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42832 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-13 19:46:24 +00:00
3fdea4f366
Outputing comma-separated report with percentages
...
Merged:
http://crrev.com/832583003
http://crrev.com/843553004
R=ricow@google.com
Review URL: https://codereview.chromium.org//847873004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42831 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-13 19:27:47 +00:00
8cd05a8b90
tools: Refactored SummaryReport and move it to its own library
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//832583003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42826 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-13 17:46:52 +00:00
4598291567
Add info about which command line was used to start a browser.
...
This will help us if we see hanging browsers.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//790793009
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42728 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-09 10:46:40 +00:00
b9a61a835a
Allow for reporting with the --list option
...
Also, be better at catagorizing tests and have a category for tests that we don't know.
R=whesse@google.com
Review URL: https://codereview.chromium.org//846433002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42695 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-08 15:23:55 +00:00
261200c587
Build Observatory as part of runtime
...
Relanding https://codereview.chromium.org/810623005/
Review URL: https://codereview.chromium.org//837723004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42645 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-06 21:59:42 +00:00
aa5a986d5d
Revert "Build Observatory with runtime"
...
This reverts commit 76df7b3c1bf83c08d3994d61df4c9c530fadb4e5.
This commit breaks dartium compilation.
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//839543002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42619 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-06 10:07:58 +00:00
9d6ac72b46
1) Remove prebuilt Observatory sources
...
2) Move observatory from runtime/bin/vmservice/observatory to runtime/observatory
3) Add two tools scripts:
- tools/run_pub.py (runs pub before SDK is built)
- tools/obs_tool.py (helper for get, build, and deploy stages)
4) Build Observatory with runtime:
- pub get --offline
- pub build
- deploy
5) Build artifacts are now in standard output directory, for example, out/DebugIA32/observatory.
6) Add a new 'dart_boostrap' host target (no snapshot, no observatory) that can be used as the Dart executable to run pub when building Observatory. This is behind a build.py flag --use-bootstrap-for-observatory because:
- It is only necessary on older Linux distributions that are incompatible with the prebuilt Dart testing executable.
- running pub build with the boostrap Debug build is significantly slower.
7) Detect if the prebuilt executable doesn't work and automatically switch to the 'dart_bootstrap' executable. Also, warn the user and provide a Wiki link with more information.
R=turnidge@google.com
Review URL: https://codereview.chromium.org//810623005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42614 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-05 21:26:52 +00:00
84669b632d
Report the correct number of tests when tests are skipped due to compile time errors.
...
The current setup will count tests that are skipped when runtime is a browser due to compile time errors twice. Example:
tools/test.py -mrelease -rdrt -cdart2js --report language/bad_override
<snip>
Total: 10 tests
* 0 tests will be skipped (0 skipped by design)
* 0 tests are expected to be flaky but not crash
* 5 tests are expected to pass
* 0 tests are expected to fail that we won't fix
* 2 tests are expected to fail that we should fix
* 0 tests are expected to crash that we should fix
* 0 tests are allowed to timeout
* 3 tests are skipped on browsers due to compile-time error
This is a multitest that has 7 tests (including none). 3 of these are giving compile-time errors, 2 of these are failing (as a compile-time error when they should not, but that is not the point), 2 are passing.
This is preparation of a bigger refactoring of the summary reporting, so that I can have sane numbers for validation.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//816703003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42460 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-18 15:15:12 +00:00
4723aee28d
Retry up to 4 times on safari until we have a resolution for issue 21434
...
I worry more that people will actually ignore these then retrying it for now.
R=floitsch@google.com
Review URL: https://codereview.chromium.org//807813004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42424 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-17 09:57:11 +00:00
5f8aa66fde
Rename legacy path library in tools/testing to avoid name collision.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//756423003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42129 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-05 07:21:47 +00:00
47de553025
tools/testing: move code into individual libraries
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//748773004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42108 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-04 15:32:57 +00:00
61b056964a
tools: removed unused members, tiny cleanup
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//770633003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42106 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-04 13:56:14 +00:00
0059ade0dd
Add android device id to test output for failing tests.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//755263002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41960 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-25 16:11:42 +00:00
12845acbf3
Revert "Add android device id to test output in test scripts."
...
This reverts r41933
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//758563004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41934 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-24 17:53:30 +00:00
d91010512a
Add android device id to test output in test scripts.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//752173002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41933 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-24 17:40:13 +00:00
6601198a60
Do not retry intentionally failing tests on browsers.
...
BUG=dartbug.com/21434
R=ricow@google.com
Review URL: https://codereview.chromium.org//726563002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41714 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-13 14:20:50 +00:00
f82e0e339a
Put test shared options before filename in compilation commands.
...
BUG=dartbug.com/21582
R=ricow@google.com
Review URL: https://codereview.chromium.org//718073002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41708 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-13 09:17:00 +00:00
3b4613ca3a
Enable dart2js compilation for new HTML tests.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//700033003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41668 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-11 14:59:14 +00:00
beaa60020c
Refactor test scripts browser multitest loop.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//688323006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41635 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-10 14:25:59 +00:00
ea27275aa6
Refactor browser test enqueuing in test scripts.
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//700753004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41633 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-10 13:37:40 +00:00
55dac6a763
Allow testing script to run without the package directories being present
...
R=sigmund@google.com , whesse@google.com
Review URL: https://codereview.chromium.org//705093002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41570 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 17:14:49 +00:00
562fb318a8
Support dart and js scripts in HTML tests, on dartium.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//705733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41569 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 17:03:24 +00:00
84b0209a77
Add test/xml content type to test server.
...
BUG=dartbug.com/21525
R=ricow@google.com
Review URL: https://codereview.chromium.org//709483002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41566 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 16:37:16 +00:00
1c840e6f01
Re-land r41544 "Update dart binaries used for running tests to version 1.7.2"
...
This also re-lands r41546, and some status file updates.
BUG=dartbug.com/21525 21526 21527
R=ricow@google.com
Review URL: https://codereview.chromium.org//701413002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41562 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 15:28:56 +00:00
802c618118
Move test config files under tools/testing/dart
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//708783002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41561 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 14:21:19 +00:00
d71ecd85d9
Fix hanging test script batch runners.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//707733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41553 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 13:03:00 +00:00
0624b4f7b7
Revert r41544 "Update dart binaries used for running tests to version 1.7.2"
...
Also revert fixes for test scripts for this update, r41546
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//708733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41547 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 11:41:49 +00:00
207f9eacb4
Fix test scripts and xhr test for new default HTTP headers
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//704133003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41546 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 09:59:51 +00:00
151dfd105e
Fix multitest display name bug in test scripts.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//702873002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41520 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-05 13:42:25 +00:00
cecc8d7de5
Fix HTML tests on non-browser runtimes.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//704733004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41519 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-05 13:09:50 +00:00
6ac0684ab8
Working SimpleHTML test front end
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//695893002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41517 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-05 12:54:34 +00:00
49acd886b9
Improve handling of intentionally broken links in test scripts.
...
BUG=
Review URL: https://codereview.chromium.org//702673002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41492 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-04 15:00:00 +00:00
nweiz@google.com