Commit Graph

1689 Commits

Author SHA1 Message Date
kustermann@google.com 006645db9e Capture and report stdout/stderr of the browser while running a test
Currently we have no way of getting stdout/stderr information when using the
browser controller.

This CL will capture stdout/stderr of the browser and tries to align it with the
currently executed test (which might be slightly off due to the fact that
Process.{stderr,stdout} is reported asynchronously).

R=ricow@google.com

Review URL: https://codereview.chromium.org//28533003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28858 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-18 15:28:08 +00:00
kustermann@google.com 24fded56bc test.py: Implement --list option for test.dart
R=ricow@google.com

Review URL: https://codereview.chromium.org//27687002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28845 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-18 08:52:06 +00:00
sigmund@google.com 6c4e38b81e Practically remove boot.js, adds the initialization from the Dart side of
things, and fixes examples to work this way.

R=jmesserly@google.com

Review URL: https://codereview.chromium.org//27518006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28773 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-17 02:43:50 +00:00
kustermann@google.com cf50a507bb Fixed (currently harmless) bug in test_runner and implemented separate dart2js compilation cache
R=ricow@google.com

Review URL: https://codereview.chromium.org//26229005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28634 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-15 11:50:47 +00:00
ricow@google.com a37250df7e Rerun dartium tests until we fixed the flaky crashes in issue 14074
R=kustermann@google.com

Review URL: https://codereview.chromium.org//26986003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28632 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-15 08:36:45 +00:00
kustermann@google.com e6077d093a Remove pixel/layout tests in tests/utils + special casing in the testing scripts for pixel/layout tests
R=ricow@google.com

Review URL: https://codereview.chromium.org//26998002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28502 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-11 10:29:46 +00:00
kustermann@google.com b24a73c137 Remove unittest-based wrapping from our testing scripts
The unittest-based wrapping of tests is completely broken and will be removed
with this CL. ('none-drt' is the last configuration where we currently still do
unittest-based wrapping.)

BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//26162007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28501 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-11 09:01:17 +00:00
ricow@google.com 3a89ab918a Add support for catching rendere crashes in drt
R=kustermann@google.com

Review URL: https://codereview.chromium.org//26793004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28443 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-10 09:30:54 +00:00
kustermann@google.com c9ba1fcbe4 test.py: Propagate the global --dartium option to the browser controller
R=kasperl@google.com

Review URL: https://codereview.chromium.org//25876002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28222 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-03 14:55:09 +00:00
kustermann@google.com b366346004 Disable re-running of ContentShell commands on windows
R=kasperl@google.com

Review URL: https://codereview.chromium.org//25700006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28208 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-03 11:22:23 +00:00
kustermann@google.com 924c46f9ae co19-roll to r607
R=kasperl@google.com

Review URL: https://codereview.chromium.org//25710002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28150 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-02 11:18:31 +00:00
kustermann@google.com 22d20313b4 Implement testing support for "--compiler=none --runtime=dartium"
This is implemented without the broken unittest-based wrapping of tests.

R=kasperl@google.com

Review URL: https://codereview.chromium.org//25514002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28141 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-02 07:37:50 +00:00
kustermann@google.com b470d2572a Report MissingCompileTime errors on the VM, status file updates for the remaining issues
R=ricow@google.com

Review URL: https://codereview.chromium.org//25229002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28043 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-30 08:37:59 +00:00
ajohnsen@google.com 7cfda3591f Let test-runner wait for stdout & stderr when running tests.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//24989004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@28009 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-27 13:19:12 +00:00
kustermann@google.com 55e9dc75b4 test.py: Parse unittest-suite-{wait-for-done,success} messages in output of d8/jsshell/vm
R=ricow@google.com

Review URL: https://codereview.chromium.org//24573003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27953 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-26 14:06:01 +00:00
floitsch@google.com a24014ab08 Automatically append ".js" on spawnUri if we are running in JavaScript.
BUG= http://dartbug.com/9422
R=kasperl@google.com, kustermann@google.com

Review URL: https://codereview.chromium.org//24730002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27941 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-26 11:32:11 +00:00
jwren@google.com 7710f874e8 Add a flag to disable the reporting and generation of hints in the analyzer.
I have a pending cl (24454002) which would break the analyzer bot since hints will be generated on langage and co19 where the output is asserted to be clean.

R=ricow@google.com

Review URL: https://codereview.chromium.org//24449004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27891 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-25 16:37:37 +00:00
kustermann@google.com 766d8c6eea test.py: Use *.precompiled.js in csp mode for customHtml tests as well
R=ahe@google.com

Review URL: https://codereview.chromium.org//24427005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27872 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-25 10:00:40 +00:00
blois@google.com b5bc0e1367 - Fixing analyzer error on legacy custom element polyfill
- Adjsuting IE status (filed bug to investigate)
 - Fixing polymer tests on Dartium

BUG=
R=jmesserly@google.com

Review URL: https://codereview.chromium.org//24168006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27846 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-24 20:11:36 +00:00
blois@google.com 209e413a5c Retry of custom element lifecycle events.
First patch is the original, changes were:
 - Shadow DOM upgrade landed as separate CL
 - CustomElement polyfill wasn't always firing WebComponentsLoaded event (causing timeouts on FF and IE), fixed polyfill.
 - Dartium test exclusions were not working

BUG=
R=jmesserly@google.com

Review URL: https://codereview.chromium.org//23498053

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27841 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-24 19:14:16 +00:00
ahe@google.com 2fa6b681cf Address comments from CL 23721012.
R=kustermann@google.com

Review URL: https://codereview.chromium.org//23726054

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27816 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-24 13:07:02 +00:00
ahe@google.com ab78c663ad Generate out.precompiled.js, not precompiled.js.
BUG=http://dartbug.com/6880
R=kasperl@google.com, kustermann@google.com

Review URL: https://codereview.chromium.org//23721012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27813 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-24 12:04:49 +00:00
kustermann@google.com ed3fe0161c test.py: Support for CompileTimeError,RuntimeError,MissingRuntimeError,MissingCompiletimeError markers in status files
R=ricow@google.com

Review URL: https://codereview.chromium.org//23702055

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27804 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-24 10:21:15 +00:00
ahe@google.com 05a9a7834e Emit CSP code in separate file.
R=kasperl@google.com

Review URL: https://codereview.chromium.org//24267004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27745 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-23 09:06:14 +00:00
blois@google.com 6def065afd Revert "Dart2js support for custom element lifecycle events"
This reverts commit 27729. Shadow DOM polyfill appears to have regressed some tests and some issues are coming up with the browser controller.

BUG=
R=jmesserly@google.com

Review URL: https://codereview.chromium.org//24251016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27730 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-21 00:46:48 +00:00
blois@google.com fb8f32bcc4 Dart2js support for custom element lifecycle events
BUG=
R=jmesserly@google.com

Review URL: https://codereview.chromium.org//24096027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27729 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-20 23:49:12 +00:00
kustermann@google.com be1fc8ad2d co19-roll to r587
R=ricow@google.com

Review URL: https://codereview.chromium.org//23437044

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27657 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-19 11:50:48 +00:00
ricow@google.com 7ff576944f Don't try to get chrome version on windows.
We still make sure that the binary is valid.

Enable the browser controller on windows again

R=kustermann@google.com

Review URL: https://codereview.chromium.org//23815007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27333 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-10 12:29:43 +00:00
kustermann@google.com 1e32f03118 Disable new browser controller on win-chrome
test.dart is not able to determine the version of chrome when running
'chrome.exe --version'. This causes an open browser window to hang and
makes the bot timeout.

TBR=ricow@google.com

Review URL: https://codereview.chromium.org//23561005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27245 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-06 12:22:32 +00:00
kustermann@google.com 58b33d70e9 test.py: Bugfix in browser_controller. Make sure we always complete even in case of errors
TBR=ricow@google.com

Review URL: https://codereview.chromium.org//24033002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27242 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-06 11:32:34 +00:00
ricow@google.com b4b435faab Add support for chrome on windows to the new browser controller
R=kustermann@google.com

Review URL: https://codereview.chromium.org//23625008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27239 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-06 09:45:52 +00:00
ricow@google.com 175c3f58e1 Add support for firefox on windows to the browser controller
R=kustermann@google.com

Review URL: https://codereview.chromium.org//23679006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27235 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-06 08:52:43 +00:00
jmesserly@google.com 337880c0d4 fixed TodoMVC tests to include deploying to JS
R=kustermann@google.com, sigmund@google.com

Review URL: https://codereview.chromium.org//23678009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27222 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-05 23:00:41 +00:00
kustermann@google.com f4691ff4fe Consider tests as flaky if it contains more than one marker (which can occur when running the test)
R=ricow@google.com

Review URL: https://codereview.chromium.org//23441045

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27116 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-04 12:03:10 +00:00
ricow@google.com ec88776e9a Add div displaying the currently executing test.
This can be useful if the window freezes up with a busy loop

R=kustermann@google.com

Review URL: https://codereview.chromium.org//23506023

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27027 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-03 08:04:26 +00:00
kustermann@google.com 71f3a4df75 Shard based on relative originTestPath
R=ricow@google.com

Review URL: https://codereview.chromium.org//23431015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27017 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 17:51:32 +00:00
kustermann@google.com c0ab51e4d6 Seems like cc/ TestCases don't have a TestInformation object attached
R=ricow@google.com

Review URL: https://codereview.chromium.org//23475015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27015 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 14:19:40 +00:00
kustermann@google.com f6ab02857e test.py: Fixed incorrect handling of multitest in status files, status file cleanups.
R=ricow@google.com

Review URL: https://codereview.chromium.org//23721006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27013 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 14:04:59 +00:00
kustermann@google.com b0889233cd test.py: Print the warning about left-over dirs only for directories created using Directory.createTemp()
R=ricow@google.com

Review URL: https://codereview.chromium.org//23714002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27003 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 09:29:12 +00:00
jmesserly@google.com 7a091dcfca Turn on Polymer TodoMVC tests on Dart buildbots
The biggest changes are to the examples, but there's a small tweak to test_suite.dart as well, so it can load the HTML files.

For now, we only test the development loop (content_shell+Dart VM). I'm working on changes to enable us to test the deploy story with dart2js.

R=kustermann@google.com, sigmund@google.com

Review URL: https://codereview.chromium.org//23539003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26943 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 21:09:06 +00:00
kustermann@google.com 59c486d34c Fixed type error in browser_controller: DebugLogger.error() takes a string
TBR=ricow@google.com

Review URL: https://codereview.chromium.org//23618020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26936 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 19:15:03 +00:00
kustermann@google.com 4d7311f14b Remove Timeout entries in status files for ie9/ie10
After reducing the load on our IE builders, we hopefully no longer see these
random timeouts.

R=ahe@google.com

Review URL: https://codereview.chromium.org//23604010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26912 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 13:39:05 +00:00
kustermann@google.com 7ddb5bb8ad test.py: Report info about how long it took until a browser tests started if it times out
R=ahe@google.com

Review URL: https://codereview.chromium.org//23522009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26910 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 12:55:27 +00:00
floitsch@google.com 1887b5ca49 Some more removals of dart:utf.
R=jmesserly@google.com, lrn@google.com, nweiz@google.com

Review URL: https://codereview.chromium.org//22909059

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26712 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-27 13:18:34 +00:00
kustermann@google.com 45c42e08f2 Update checked-in binary to 0.6.21.3_r26639 (M6)
R=ricow@google.com

Review URL: https://codereview.chromium.org//23568002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26704 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-27 11:16:37 +00:00
kustermann@google.com 013ac3b1d1 Reland "Enable running multitests in browsers""
R=ricow@google.com

Review URL: https://codereview.chromium.org//23545003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26695 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-27 09:12:05 +00:00
efortuna@google.com b66711273b Update webdriver setup script for Download name changes.
BUG=
R=sigmund@google.com

Review URL: https://codereview.chromium.org//23334005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26660 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-26 17:23:22 +00:00
kustermann@google.com 807685dcaa Revert "Enable running multitests in browsers"
R=ricow@google.com

Review URL: https://codereview.chromium.org//23201019

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26648 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-26 14:20:57 +00:00
kustermann@google.com 6844e23211 Enable running multitests in browsers
R=ricow@google.com

Review URL: https://codereview.chromium.org//23427002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26641 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-26 12:12:41 +00:00
gram@google.com 5afecf5f67 Changes to how we handle fancy stacks:
- in the base config they are disabled
- in htmnl config they are enabled unless a certain meta tag is present in the
  page.
- in vm config they are enabled unless a --no-fancy-stacks flag is in the
  Options.

The test runner adds a fancy_stacks flag that can be used to control this
behavior, but by default turns off fancy stacks for all tests.

There were a couple of test runner tests that were affected and have kludgy
fixes where I strip out the new argument from Options first.

This has passed a baseline set of tests; I'm still running a more comprehensive
set.

R=kustermann@google.com, nweiz@google.com

Review URL: https://codereview.chromium.org//22859009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26560 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-22 21:47:51 +00:00