Commit Graph

1040 Commits

Author SHA1 Message Date
kustermann@google.com 18a8f25608 Command class hieracy refactoring, environmentOverride extraction
R=ricow@google.com, whesse@google.com

Review URL: https://codereview.chromium.org//118783003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31269 260f80e4-7a28-3924-810f-c04153c831b5
2013-12-19 13:01:46 +00:00
kustermann@google.com 667c9ec4bf Make sure we mark all depending commands (transitively!) UnableToRun if a command fails
R=whesse@google.com

Review URL: https://codereview.chromium.org//107153004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31241 260f80e4-7a28-3924-810f-c04153c831b5
2013-12-18 21:54:45 +00:00
kustermann@google.com ca307461d0 test.py: Removed JUnitTestSuite, since it's no longer used
R=whesse@google.com

Review URL: https://codereview.chromium.org//113713006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31214 260f80e4-7a28-3924-810f-c04153c831b5
2013-12-18 08:48:00 +00:00
whesse@google.com 539d41deb1 Remove unused parameter from test infrastructure: use_unittest_controller.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//104963003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30988 260f80e4-7a28-3924-810f-c04153c831b5
2013-12-09 15:18:11 +00:00
whesse@google.com c8bfa98017 Test infrastructure: add retry to browser controller sending "done" message.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//107513004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30950 260f80e4-7a28-3924-810f-c04153c831b5
2013-12-06 16:38:15 +00:00
kustermann@google.com eb09d1e40b co19-roll to r672
Review URL: https://codereview.chromium.org//100363003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30854 260f80e4-7a28-3924-810f-c04153c831b5
2013-12-04 13:00:12 +00:00
kustermann@google.com 20b8ddbfee Remove the command-specific outcome temporarily when writing out the .test-outcome.log file
TBR=ricow@google.com

Review URL: https://codereview.chromium.org//96603002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30773 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-29 09:28:15 +00:00
ricow@google.com bae4d99ce1 Add debug information to verify that we actually get the onDone event send to the driver page.
I am aware that we should not clutter up the message that we show to developers, but I think it is important to validate that we actually send the onDone message to the driver page.

We should also put in functionality for tracking network errors in the browser_controller generated js (+potentially retrying the send of the message)

R=kustermann@google.com

Review URL: https://codereview.chromium.org//96503002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30771 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-29 08:57:47 +00:00
kustermann@google.com 26f065bdb2 Add .test-outcome.log support to test.dart
R=ricow@google.com

Review URL: https://codereview.chromium.org//95603002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30768 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-29 08:29:20 +00:00
kustermann@google.com fc15ac395d Remove left-over print statement in test_runner.dart
Review URL: https://codereview.chromium.org//95593002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30766 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-28 17:34:01 +00:00
kustermann@google.com 5ed5e5b17a Added debug timer to test.dart
We are seeing a lot of test.dart timeouts on our browser bots. This is an
attempt to get more information on what is going on.

R=ricow@google.com

Review URL: https://codereview.chromium.org//88803002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30765 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-28 16:20:28 +00:00
kustermann@google.com e634fb20a4 Make status updates after 10 seconds + fix handling of status updates
R=ricow@google.com

Review URL: https://codereview.chromium.org//94213002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30748 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-28 08:50:58 +00:00
kustermann@google.com eeee37127b Fix after upgrading to new checked-in binary
R=ricow@google.com

Review URL: https://codereview.chromium.org//91693002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30718 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 14:53:46 +00:00
kustermann@google.com bb54b776ba Checked-in binary update to v1.0.0.3
R=ricow@google.com

Review URL: https://codereview.chromium.org//91473002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30717 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 14:17:44 +00:00
kustermann@google.com e70a3e5a21 Print again how many compilations were skipped
R=ricow@google.com

Review URL: https://codereview.chromium.org//88823003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30699 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 08:27:21 +00:00
kustermann@google.com 8a9d4c085e Whitelist nonzero content_shell exitcode
R=ricow@google.com

Review URL: https://codereview.chromium.org//88443002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30670 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-26 14:48:41 +00:00
kustermann@google.com c23917be9b Print events only to the console and never to the DOM
IE9 does not have a console, so events were printed to the DOM. But since we get
all events anyway when using the browser controller, there is no need to print
it to the DOM.

R=ricow@google.com

Review URL: https://codereview.chromium.org//85853002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30630 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-25 14:35:50 +00:00
ricow@google.com 52a12f1b37 Remove old warning code for wrong usage of warnings in co19
Review URL: https://chromiumcodereview.appspot.com//85303004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30621 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-25 12:54:15 +00:00
kustermann@google.com 6c04b9a0b2 Followup on co19-roll to r667, marked co19/Language/12_Expressions/32_Type_Test_A02_t04 as failing in minified mode
Review URL: https://codereview.chromium.org//79143005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30513 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-21 12:09:52 +00:00
kustermann@google.com 8b103390e2 Make sure variable names used in status files are available in the environment
Previously we didn't validate that a variable name used in a status file
expression was available.

It wasn't surfaced, since lookups in Map objects return null if the key is
missing and calling 'toString()' on 'null' doesn't throw an exception.

BUG=http://dartbug.com/12959
R=ricow@google.com

Review URL: https://codereview.chromium.org//78723002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30502 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-21 09:54:36 +00:00
kustermann@google.com 3d910a2a9a Remove filtering of analyzer warnings/errors by filename
The only files that are now not analyzed are the patch files in
"sdk/lib/_internal/lib" and test files (i.e. files ending with "_test.dart")

R=ricow@google.com

Review URL: https://codereview.chromium.org//78483002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30471 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-20 14:06:34 +00:00
kustermann@google.com 8649be6036 Implement a periodic timer which sends the current state of a browser test back to the browser controller
R=ricow@google.com

Review URL: https://codereview.chromium.org//77763004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30468 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-20 13:32:16 +00:00
kustermann@google.com e3d8608ca2 test.py: Sending JSON between test_controller.js <-> browser_controller
Currently test.py will look for FAIL/PASS messages in the DOM to determine if a
test has failed or not. test_controller.js will add these PASS/FAIL messages to
the DOM (in addition to other messages).

This approach has several issues:
- The test itself could create nodes in the DOM containing FAIL/PASS. This means
  that the outcome of a test cannot be reliably determined.
- The test ifself can remove nodes from the DOM (e.g. setting
  document.body.innerHTML). This could result in a situation where the
  stacktraces/... test_controller.js prints to the DOM are lost.
- It is unclear which parts of the DOM we see in test failure messages
  (reported by test.py) come from the test itself and which parts come from
  test_controller.js.

This CL tries to fix this by recording all events that happend with global
variables in test_controller.js and send back a JSON string with information
about
  - debug messages
  - posted messages
  - print() calls of the test
  - DOM
  - errors (from window.onerror, script.onerror ...)

Furthermore this CL fixes unittest to report
unittest-suite-success/unittest-suite-fail instead of unittest-suite-done (which
is broken).

R=ricow@google.com

Review URL: https://codereview.chromium.org//36913002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30407 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-19 12:54:41 +00:00
ricow@google.com 1fd9f4b774 Print drt exitcode when we pass test but crash before exiting
R=kustermann@google.com

Review URL: https://codereview.chromium.org//60763004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30401 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-19 12:08:54 +00:00
kustermann@google.com af29f7901f Removed assert for nonexistent use_browser_controller option
TBR=ricow@google.com

Review URL: https://codereview.chromium.org//75243002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30344 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-18 12:59:20 +00:00
kustermann@google.com 2adf3ea3c0 Fix SummaryReport after introduction of the RuntimeError,CompileTimeError,... markers
R=ricow@google.com

Review URL: https://codereview.chromium.org//75213002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30342 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-18 12:41:59 +00:00
whesse@google.com 36fe570a31 Remove the --use_browser_controller flag, now that it is always true.
Fix an error in r30269.

BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//68133017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30270 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-14 15:20:31 +00:00
whesse@google.com e545ffef5d Remove uses of Selenium and webdriver from test scripts.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//68213016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30269 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-14 12:30:35 +00:00
whesse@google.com 00f34f7ca4 Use browser_controller instead of selenium in test scripts, by default.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//68113023

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30268 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-14 10:25:19 +00:00
kustermann@google.com 804fd00f9c Fix launch_browser.dart after changes to utils.dart:Location
R=whesse@google.com

Review URL: https://codereview.chromium.org//61793014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30231 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-13 15:50:31 +00:00
whesse@google.com 0f2f482388 Add browser path options to testing scripts.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//60503002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29981 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-06 16:24:33 +00:00
zra@google.com a69e4a5e8d Adds checked mode to Dartium on Android browser test controller.
R=kustermann@google.com

Review URL: https://codereview.chromium.org//52803007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29832 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-04 18:26:41 +00:00
ngeoffray@google.com 76a9b8a358 Pass sharedOptions to the compilation command of a browser test.
R=ricow@google.com

Review URL: https://codereview.chromium.org//55023002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29681 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-31 17:10:18 +00:00
floitsch@google.com 7006de6f23 Remove deprecated parts of dart:async.
Attempt to fix most uses of the deprecated features.

R=floitsch@google.com, nweiz@google.com, rnystrom@google.com

Review URL: https://codereview.chromium.org//48483002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29628 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-31 02:24:29 +00:00
kustermann@google.com 6029bd2f44 co19-roll to r651
TBR=ricow@google.com

Review URL: https://codereview.chromium.org//53453003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29596 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-30 22:16:51 +00:00
ngeoffray@google.com 97489a5dcd Implement SharedOptions in test scripts.
R=kustermann@google.com, ricow@google.com

Review URL: https://codereview.chromium.org//47703006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29568 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-30 17:30:10 +00:00
lrn@google.com 41ff075e31 Remove deprecated dart:utf library.
BUG= http://dartbug.com/12843
R=fschneider@google.com, sgjesse@google.com

Review URL: https://codereview.chromium.org//48133002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29537 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-30 12:25:02 +00:00
kustermann@google.com aac5479809 Only generate multitests if content changed, enables us to dart2js compilations for multitests
BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//52113003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29528 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-30 10:41:17 +00:00
kustermann@google.com 0456d4136b Run the analyzer on dart files under sdk/ -- even in sdk/_internal, if not ending with _test.dart
R=ricow@google.com

Review URL: https://codereview.chromium.org//48763003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29420 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-29 09:02:14 +00:00
kustermann@google.com b5373a419a Run all tests inside an iframe + restrict number of chrome browser processes on mac
R=ricow@google.com

Review URL: https://codereview.chromium.org//49043003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29367 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 16:31:18 +00:00
kustermann@google.com cf822a851a test.py: Run the analyzer on all dart files in the sdk.
BUG=http://dartbug.com/13024
R=ricow@google.com

Review URL: https://codereview.chromium.org//47743005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29362 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 14:45:59 +00:00
kustermann@google.com 94ebff2225 Bugfix in test.dart, adding of specialized test outcomes for analyzer
This CL will:
 - fix a bug in the legacy AnalyzerCommandOutputImpl class (in certain cases
   we did not report that the analyzer was missing a warning).
 - make the outcome of running the analyzer on a test be one of:
   * CompileTimeError
   * MissingCompileTimeError
   * StaticWarning
   * MissingStaticWarning
 - Make status file updates using the new Expectation markers
 - Remove support for '@static-clean':
     Previously running the analyer on a test could either result in
     'Pass' or in 'Fail'. The '@static-clean' annotation has been used
     as a (poor) mechanism to distinguish between errors and warnings.
     Having the 4 markers mentioned above means we can remove '@static-clean'
 - Remove 100 lines of rotted legacy code in our testing scripts.
 - Make a status file entry for every test that has analyzer errors or warnings

R=ricow@google.com

Review URL: https://codereview.chromium.org//46163002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29350 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 10:39:38 +00:00
scheglov@google.com 7ac0b7d0bd Rename analyzer_experimental to analyzer.
R=jmesserly@google.com, pquitslund@google.com, danrubel@google.com
BUG=

Review URL: https://codereview.chromium.org//45573002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29302 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 23:59:38 +00:00
zra@google.com bdc3343090 Adds test target for Dartium on Android.
R=kustermann@google.com

Review URL: https://codereview.chromium.org//43773005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29293 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 21:34:25 +00:00
zra@google.com 5572278a23 Changes to run tests on Dartium content shell on Android.
- In browser_controller.dart, adds a drtOnAndroid Browser.
- Adds flags for starting test servers at fixed ports.
  - This is needed so that android reverse port forwarding
    can be set up in advance.
- Adds setProp to android.dart to be used in lieu of
  environment variables when testing on Android.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//29773006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29259 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 16:39:48 +00:00
kustermann@google.com 746d924e59 co19-roll to r641
R=ricow@google.com

Review URL: https://codereview.chromium.org//44263003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29255 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 15:07:10 +00:00
lrn@google.com 3a01260611 Remove dart:json
BUG= http://dartbug.com/12843
R=floitsch@google.com, fschneider@google.com

Review URL: https://codereview.chromium.org//40323002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29240 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 10:30:34 +00:00
amouravski@google.com ea765638fb Updated webdriver setup script to use new location for downloads.
R=efortuna@google.com

Review URL: https://codereview.chromium.org//33003002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29200 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-24 20:01:48 +00:00
kustermann@google.com b3ba5c5c95 test.py: Support for running tests in checked mode on none-dartium with the browser controller
R=ricow@google.com

Review URL: https://codereview.chromium.org//38753008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29175 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-24 15:37:33 +00:00
jmesserly@google.com ccb7d5304f fix issue 14300 -- polymer tests under CSP
R=ricow@google.com, sigmund@google.com

Review URL: https://codereview.chromium.org//34483003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29020 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-22 18:29:46 +00:00