12845acbf3
Revert "Add android device id to test output in test scripts."
...
This reverts r41933
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//758563004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41934 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-24 17:53:30 +00:00
d91010512a
Add android device id to test output in test scripts.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//752173002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41933 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-24 17:40:13 +00:00
6601198a60
Do not retry intentionally failing tests on browsers.
...
BUG=dartbug.com/21434
R=ricow@google.com
Review URL: https://codereview.chromium.org//726563002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41714 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-13 14:20:50 +00:00
f82e0e339a
Put test shared options before filename in compilation commands.
...
BUG=dartbug.com/21582
R=ricow@google.com
Review URL: https://codereview.chromium.org//718073002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41708 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-13 09:17:00 +00:00
3b4613ca3a
Enable dart2js compilation for new HTML tests.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//700033003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41668 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-11 14:59:14 +00:00
beaa60020c
Refactor test scripts browser multitest loop.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//688323006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41635 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-10 14:25:59 +00:00
ea27275aa6
Refactor browser test enqueuing in test scripts.
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//700753004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41633 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-10 13:37:40 +00:00
55dac6a763
Allow testing script to run without the package directories being present
...
R=sigmund@google.com , whesse@google.com
Review URL: https://codereview.chromium.org//705093002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41570 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 17:14:49 +00:00
562fb318a8
Support dart and js scripts in HTML tests, on dartium.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//705733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41569 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 17:03:24 +00:00
84b0209a77
Add test/xml content type to test server.
...
BUG=dartbug.com/21525
R=ricow@google.com
Review URL: https://codereview.chromium.org//709483002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41566 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 16:37:16 +00:00
1c840e6f01
Re-land r41544 "Update dart binaries used for running tests to version 1.7.2"
...
This also re-lands r41546, and some status file updates.
BUG=dartbug.com/21525 21526 21527
R=ricow@google.com
Review URL: https://codereview.chromium.org//701413002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41562 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 15:28:56 +00:00
802c618118
Move test config files under tools/testing/dart
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//708783002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41561 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 14:21:19 +00:00
d71ecd85d9
Fix hanging test script batch runners.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//707733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41553 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 13:03:00 +00:00
0624b4f7b7
Revert r41544 "Update dart binaries used for running tests to version 1.7.2"
...
Also revert fixes for test scripts for this update, r41546
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//708733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41547 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 11:41:49 +00:00
207f9eacb4
Fix test scripts and xhr test for new default HTTP headers
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//704133003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41546 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 09:59:51 +00:00
151dfd105e
Fix multitest display name bug in test scripts.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//702873002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41520 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-05 13:42:25 +00:00
cecc8d7de5
Fix HTML tests on non-browser runtimes.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//704733004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41519 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-05 13:09:50 +00:00
6ac0684ab8
Working SimpleHTML test front end
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//695893002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41517 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-05 12:54:34 +00:00
49acd886b9
Improve handling of intentionally broken links in test scripts.
...
BUG=
Review URL: https://codereview.chromium.org//702673002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41492 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-04 15:00:00 +00:00
0928369fc9
Improve browser testing scripts to better handle tests that reload themselves.
...
BUG=dartbug.com/18558
R=ricow@google.com
Review URL: https://codereview.chromium.org//702543006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41490 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-04 14:46:45 +00:00
c6102a3b5b
Retry failing tests on Safari, because it is flaky.
...
BUG=dartbug.com/21434
Review URL: https://codereview.chromium.org//691583002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41397 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-29 17:53:14 +00:00
67e8b965bb
_Temporarily_ retry failing browser tests on Safari, because versions 6.2 and 7.1 are flaky on dart2js output.
...
Add support for macos 10.9 to buildbot scripts.
BUG=dartbug.com/21434
R=ricow@google.com
Review URL: https://codereview.chromium.org//687213002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41394 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-29 13:07:11 +00:00
aeba67e44e
Add builder tag for Safari 6.2 slave. Update status files for Safari 6.2.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//679153002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41323 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-27 16:09:00 +00:00
f7db779401
Clean up scripts to run Java-based analyzer.
...
sdk/bin/dartanalyzer_developer is renamed sdk/bin/dartanalyzer_java
(replacing the old sdk/bin/dartanalyzer_java, which was unused), and
the test infrastructure is modified to use sdk/bin/dartanalyzer_java
to start the Java-based analyzer.
This frees up sdk/bin/dartanallyzer_developer to be the --host-checked
version of sdk/bin/dartanalyzer (paralleling what we do for
/sdk/bin/dart2js_developer).
R=ricow@google.com
Review URL: https://codereview.chromium.org//668743003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41227 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-21 13:02:37 +00:00
d83ee35044
Terminate browsers in sequence.
...
Also make iframe larger.
R=whesse@google.com
Review URL: https://codereview.chromium.org//660823002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41189 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-20 12:32:50 +00:00
b9116653bd
Modify dartanalyzer scripts to look more like dart2js scripts.
...
The dartanalyzer script (and its Windows companion, dartanalyzer.bat)
now support:
- Executing from snapshot if present, otherwise from source (needed
for buildbot tests).
- Passing in the appropriate package root when executind from source.
- Passing in VM tuning parameters to speed up analysis.
- Passing through extra DART_VM_OPTIONS to the VM.
Also, the old editor/tools/analyzer script has been removed and
the test infrastructure now uses sdk/bin/dartanalyzer, in the
same way that it works for dart2js.
R=ahe@google.com , johnniwinther@google.com , ricow@google.com
Review URL: https://codereview.chromium.org//628363002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41150 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-16 14:21:37 +00:00
6650aeb3d6
Clean up test_runner Command subclass hash/equality.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//645533002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41037 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-10 12:05:52 +00:00
b21c902607
Add support in test scripts backend for simple HTML tests.
...
BUG=dartbug.com/20698
R=ricow@google.com
Review URL: https://codereview.chromium.org//632283002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40956 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-07 15:29:39 +00:00
33e51a5295
Update co19 test suite to r786.
...
R=kustermann@google.com , ricow@google.com
Review URL: https://codereview.chromium.org//621753002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40832 260f80e4-7a28-3924-810f-c04153c831b5
2014-10-01 09:36:32 +00:00
7efd38d195
Start implementing checked mode compile time errors in analyzer.
...
This enables the Java-based command-line analyzer to accept the
"--enable_type_checks" flag so that it can be told whether to report
type checking errors during constant evaluation. Also it fixes the
tests language/compile_time_constant_checked2_test and
language/compile_time_constant_checked3_test in unchecked mode, by
causing CONST_FIELD_INITIALIZER_NOT_ASSIGNABLE to be escalated to an
error only in checked mode.
Note: in order to test this properly, I had to remove a hack from
test_runner.dart which caused it to effectively ignore the "checked
mode compile-time error" test annotation when testing analyzer. With
this hack removed, several new lines needed to be added to the .status
files.
BUG=dartbug.com/16391
R=jwren@google.com , kustermann@google.com
Review URL: https://codereview.chromium.org//610863004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40780 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-29 18:59:14 +00:00
94e1160661
Add PKGTestSuite that will be used for package waterfall testers.
...
This is based on the standard test suite but we specialcase html files.
There is another html file aproach currently being done by whesse@ that we may be able to utilize when it is done instead.
R=sigmund@google.com
Review URL: https://codereview.chromium.org//567803004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40255 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-15 17:16:35 +00:00
4acbe3d75a
Find pub status file in right directory.
...
R=nweiz@google.com
Review URL: https://codereview.chromium.org//561893002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40123 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-10 22:38:24 +00:00
13e1c5d54b
Allow trailing / in directory paths
...
I run into errors as soon as I use tab completion and include a trailing slash
in the suite_dir, this help a bit.
R=ricow@google.com
Review URL: https://codereview.chromium.org//560643002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40093 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-10 15:37:49 +00:00
17c1642748
Store the async-await compiled pub code directly in the repo.
...
R=nweiz@google.com
Review URL: https://codereview.chromium.org//557563002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40041 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-09 16:55:16 +00:00
8bfaae17ea
Add package-root option to the testing scripts
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//552443003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39971 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-08 15:44:45 +00:00
f9b0a27ee9
test.dart: Serve the browser test driver page from the test file HTTP server.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//540933002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39907 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-05 11:01:26 +00:00
46043093af
Move js library back into compiler directory.
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//538513002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39870 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-04 13:49:30 +00:00
94f0a3f3fd
Refactor testing http server in test.dart.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//539493002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39867 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-04 12:58:19 +00:00
2ccac8093b
Add language tests for Issue 18628.
...
As suggested by @karlklose in https://codereview.chromium.org/513563002/
comments.
Improve testing documentation.
- add a README
- add a description by example of selectors to the "./tools/test.py -h"
output
- update/add source comments
I had a hard time figuring out how to add and run the tests, mostly
because I tried to call them "*_test_1.dart" and "*_test_2.dart", but
language test files must have names of the form "*_test.dart". So, I
added a README summarizing and referencing the relevant docs.
R=brianwilkerson@google.com , karlklose@google.com , jwren@google.com
BUG=
Review URL: https://codereview.chromium.org//521773003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39822 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-03 18:51:25 +00:00
3331fd5366
Put selector generation for the suite_dir runs in the same place as the other selector expansion
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//530363003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39796 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-03 08:12:39 +00:00
8327e55137
Support passing in a test suite directory through a flag to the testing scripts
...
This will allow us to setup testing that mirrors what we currently have even with the packages moved to github.
R=whesse@google.com
Review URL: https://codereview.chromium.org//527053002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39735 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-02 05:20:34 +00:00
7060865fa4
Pass --enable-async to the analyzer
...
R=brianwilkerson@google.com
Review URL: https://codereview.chromium.org//517533003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39662 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-28 16:45:02 +00:00
48065a1f91
Update test scripts to run under the Dart 1.6 vm.
...
BUG=
R=sgjesse@google.com
Review URL: https://codereview.chromium.org//483353003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39443 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-21 09:30:10 +00:00
8f54a8b5bd
Update CO19 test suite to r761
...
R=kustermann@google.com
Review URL: https://codereview.chromium.org//487603003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39367 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-19 11:33:27 +00:00
1d73d2c30c
Test scripts: Detect and report error in accessing window.parent in browser_controller.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//472883002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39249 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-14 15:31:33 +00:00
e89bd4ab1d
Try running ie10 in a new window instead of an iframe.
...
We are seeing issues where it seems that we are getting unittest-suite-success messages out of the blue and this may be related to:
https://code.google.com/p/dart/issues/detail?id=17825
This could be the old javascript still running in the iframe posting the event.
R=whesse@google.com
Review URL: https://codereview.chromium.org//477613002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39245 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-14 12:36:54 +00:00
4431b50125
Browser testing: Run android content shell tests on hosts with multiple devices connected.
...
The adb_reverse_forwarder.py script in [dartium]/build/android/ needs the --all-devices option added. We will also try to upstream this flag to chromium.
This change makes the test host reinstall the ContentShell apk on the device each time the device is restarted due to timeout or periodic reset, which takes about 10 seconds, but this is simpler and more like the existing behavior with android chrome.
R=ricow@google.com
Review URL: https://codereview.chromium.org//467643002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39142 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-12 14:40:26 +00:00
cbe97f9ea6
Don't use io prefix in test_suite.dart
...
Review URL: https://codereview.chromium.org//456373002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39072 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-11 11:09:26 +00:00
e675541f42
Use rmdir to delete pkgbuild directories on windows
...
We are seeing issues with this all the time. I validated that this works on my windows box (and our current setup does not)
It sucks that we need to us runInShell, but rmdir is not part of the normal path (i.e., "where rmdir" says it can't find it, but e.g., "where xcopy" works fine)
Review URL: https://chromiumcodereview.appspot.com//462523002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39071 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-11 10:41:25 +00:00
5886a0a997
Add the vmservice testing to the default test selector
...
Review URL: https://codereview.chromium.org//452833002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39023 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-08 08:11:52 +00:00
whesse@google.com