Commit Graph

569 Commits

Author SHA1 Message Date
blois@google.com 5871625004 Adding the ability for the test server to listen on non-loopback addrs.
BUG=

Review URL: https://codereview.chromium.org//12220068

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18489 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-13 22:27:30 +00:00
efortuna@google.com c6179a50c0 Revert "Change the location of the output directory" plus one other fix.
BUG=

Review URL: https://codereview.chromium.org//12225109

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18295 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-09 02:07:19 +00:00
kustermann@google.com 5e292868f0 Fixed path issue on windows
TBR=ricow

Review URL: https://codereview.chromium.org//12218039

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18187 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-06 21:05:40 +00:00
sigmund@google.com 376c46005e Move test_controller.js inside unitest/lib so it can be used in external tests
too.

Review URL: https://codereview.chromium.org//12217045

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18184 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-06 19:33:55 +00:00
kustermann@google.com 3396dc77a9 Change the location of the output directory of generated tests to be inside build directory, but not relative to the dart root.
This is causing issues on dartium builders where we actually only run because there is a build/Release (and out/Release or xcodebuild/Release for mac/linux) on the bot that has been created inside src/dart.

Also, fix the http server in the testing script to serve files from the output directory - otherwise the tests will not be accessible if an alternative build directory is used.

Review URL: https://codereview.chromium.org//12183022

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18176 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-06 16:38:09 +00:00
kustermann@google.com 0a5a3306f7 Added '--package-root' to http_server.dart.
Review URL: https://codereview.chromium.org//12087130

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17968 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-01 10:22:55 +00:00
kustermann@google.com 7b19966623 If we made progress, add testCases to the front of the queue in test_runner.dart
Review URL: https://codereview.chromium.org//12114027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17913 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-31 14:44:38 +00:00
efortuna@google.com 532b0a7e0e Fix Safari "multitest" failure.
BUG=

Review URL: https://codereview.chromium.org//12089081

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17882 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 23:53:42 +00:00
ricow@google.com 746d3664db Revert revision 17848 - this is breaking dartium testing
Review URL: https://codereview.chromium.org//12087086

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17850 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 15:27:52 +00:00
ricow@google.com 5947bba6cc Change the location of the output directory of generated tests to be inside output directory, but not relative to the dart root.
This is causing issues on dartium builders where we actually only run because there is a build/Release (and out/Release or xcodebuild/Release for mac/linux) on the bot that has been created inside src/dart.

Also, fix the http server in the testing script to serve files from the output directory - otherwise the tests will not be accessible if an alternative build directory is used.
Review URL: https://codereview.chromium.org//11896031

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17848 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 14:38:47 +00:00
kustermann@google.com 7ccd6f2c68 Bugfix in test_runner: in certain cases tests did not get rerun
Review URL: https://codereview.chromium.org//12086048

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17824 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 09:05:02 +00:00
kustermann@google.com a418c4f27f Only print stdout/stderr if we've got an unexpected output
TBR=ricow

Review URL: https://codereview.chromium.org//12092041

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17767 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-29 15:44:27 +00:00
kustermann@google.com 22da1e1fc8 Support for running a limited amount of browser tests in parallel
Patch Set 1:
  Refactored test_runner.dart to execute "Command after Command" instead of
  "TestCase after TestCase". By doing so, we don't couple the execution of
  compilation commands to the execution of the browser (or test) command.

Patch Set 2:
  Introduce a limitation on the number of parallel browser executions. By doing
  so we can run 'NumCores' compilation commands in parallel but only a single
  browser test command at any given time (necessary for IE).
  This way we can significantly reduce the cycle time on IE bots.

Review URL: https://codereview.chromium.org//12035053

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17764 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-29 15:16:44 +00:00
ricow@google.com 03bdded77e Fix selenium to detect and handle browser crashes.
Some context:
On windows, selenium will be hanging a chrome browser
crashes and additional to this we would actually not get information
that the browser crashed, we would get this as a failing test.

This change basically sets up a python timer that will trigger us to
close the browser using browser.service.stop() (I suspect that when
the browser crashes and does not respond in time selenium will call
browser.quit which will be blocking on trying to kill the remote
service).

In addition, this changes the test_runner to handle a crash exitcode
correctly (we will set it to -10 in the bacth runner, I don't know
why, but I dont want to change that in this cl). The current
hasCrashed getter will mask out errors that it does not recognize as
valid windows crashes (of which -10 is not one since it will have a
bunch of set bits in the middle of the bit pattern). I changed this to
explictily recognize the -10 value.
Input on why we have that value is welcome
Review URL: https://codereview.chromium.org//12051037

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17752 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-29 10:20:11 +00:00
kustermann@google.com 740b947e24 Small bugfix in test_suite.dart
Review URL: https://codereview.chromium.org//11929022

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17702 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-28 11:29:41 +00:00
ahe@google.com 2f974584dc Add dart2js option to select library categories.
By default, the compiler will only accept the Client category, meaning that it will be an error to import dart:io.

During testing on d8, the compiler will support all library categories to continue supporting so called "mock compilation".

Review URL: https://codereview.chromium.org//11740025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17637 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-25 12:08:26 +00:00
scheglov@google.com d9605fe9ef Issue 8051. Make extended exit codes optional.
http://code.google.com/p/dart/issues/detail?id=8051

Unfortunately testing framework expects exactly 0 and 1.
So, I've made 0/1/2 exit codes optional.

Phil, FYI

R=devoncarew@google.com,pquitslund@google.com
BUG=

Review URL: https://codereview.chromium.org//12045088

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17629 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-25 04:11:12 +00:00
scheglov@google.com be31b47690 Issue 8051. dart_analyzer return codes on errors
http://code.google.com/p/dart/issues/detail?id=8051

R=devoncarew@google.com,whesse@google.com
BUG=

Review URL: https://codereview.chromium.org//12041051

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17622 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-25 00:47:48 +00:00
kustermann@google.com 6ca4e48671 Added a comment to clarify the interpretation of exit codes on windows
Review URL: https://codereview.chromium.org//12035052

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17455 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-23 13:24:03 +00:00
floitsch@google.com 1febeb689a Move some core classes to collection library.
Review URL: https://codereview.chromium.org//11867024

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17352 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-21 13:34:02 +00:00
regis@google.com 350fa57800 Add mips and simmips build targets.
Review URL: https://codereview.chromium.org//11859034

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17319 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 21:34:53 +00:00
kustermann@google.com d71f8ff86f Added DebugLogger to testing scripts.
Review URL: https://codereview.chromium.org//11962042

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17291 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 16:45:20 +00:00
kustermann@google.com f9a76d5672 Simplify the enqueuing of tests from all test suites
TBR=foo

Review URL: https://codereview.chromium.org//11884054

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17273 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 13:50:24 +00:00
kustermann@google.com 5d083443f8 Don't exit() in test_progress but rather set io.exitCode
Review URL: https://codereview.chromium.org//12026013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17264 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 12:28:08 +00:00
ahe@google.com f42b735a0e Correctly implement co19 test suite.
Review URL: https://codereview.chromium.org//11881053

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17204 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-17 13:40:21 +00:00
kustermann@google.com 9ee5fc4b53 Revert "Removed the 'we don't run multitests on browsers'-hack"
There is an issue with path names on dartium builders.

Review URL: https://codereview.chromium.org//11975039

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17185 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-17 10:20:12 +00:00
kustermann@google.com 442e7fc3b9 Removed the 'we don't run multitests on browsers'-hack
Review URL: https://codereview.chromium.org//11886064

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17183 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-17 08:59:05 +00:00
efortuna@google.com 0345368d65 Unbreak local browser testing.
BUG=

Review URL: https://codereview.chromium.org//11931025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17176 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-17 00:35:23 +00:00
kustermann@google.com 494b8e5d56 Revert "Removed unused StandardTestSuite.cachedTests field"
The variable actually as a side effect, so this was broken.

Review URL: https://codereview.chromium.org//11968016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17147 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-16 17:20:32 +00:00
ahe@google.com 0aa3c7b35f Make test.dart self-contained again.
Review URL: https://codereview.chromium.org//11961017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17139 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-16 15:21:22 +00:00
kustermann@google.com 8e4757a782 Removed unused StandardTestSuite.cachedTests field
Review URL: https://codereview.chromium.org//11962012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17133 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-16 11:35:48 +00:00
ricow@google.com 6f53169ec1 Don't exit test script on an error in the http server.
This often happens if the client closes the connection unexpectedly
Review URL: https://codereview.chromium.org//11971012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17128 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-16 09:57:35 +00:00
kustermann@google.com 09690f9393 Fix in testing scripts, decodeUtf8->encodeUtf8
TBR=ricow

Review URL: https://codereview.chromium.org//11878039

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17058 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-15 11:09:03 +00:00
kustermann@google.com ecf1cdeeb8 Fixed utf8 encoding/decoding issues in the testing scripts
Review URL: https://codereview.chromium.org//11883033

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17057 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-15 10:59:24 +00:00
whesse@google.com 747f79ce1f Upload new Dart binaries and re-enable unit tests for test scripts.
BUG=

Review URL: https://codereview.chromium.org//11884029

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17031 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-14 20:45:42 +00:00
efortuna@google.com 7bc4cb245e Delete debugging change that slipped in.
Review URL: https://codereview.chromium.org//11889002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17008 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-13 01:42:58 +00:00
efortuna@google.com 4622dc3e76 Make browser tests all run from a server instead of the local filesystem.
BUG=

Review URL: https://codereview.chromium.org//11810004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17007 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-13 01:11:07 +00:00
lrn@google.com bfd9b37484 Undo changes to tools-scripts.
TBR=ricow@google.com

Review URL: https://codereview.chromium.org//11856009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16956 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-11 09:56:36 +00:00
lrn@google.com 4868ee2110 Remove Futures class, move methods to Future.
Optimize Future.forEach, Future.delay.

Review URL: https://codereview.chromium.org//11865005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16954 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-11 09:46:45 +00:00
kustermann@google.com 59a12b72c9 Migration of testing scripts in tools/ to libv2
Review URL: https://codereview.chromium.org//11817012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16867 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-09 18:31:28 +00:00
ahe@google.com b4fe3203b1 Add a hashCode to Command so reporting timings is 400 faster.
Review URL: https://codereview.chromium.org//11824028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16859 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-09 15:38:20 +00:00
vsm@google.com 8eacd88652 Create an sdk package to host dart.js
Devon: I think we'd need corresponding editor changes.  The editor could use either pub or just replace the path (as mentioned in the bug).

BUG=6723

Review URL: https://codereview.chromium.org//11774006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16812 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-08 18:35:22 +00:00
ager@google.com db4503ea37 Do not pass VMOptions to dartc
R=kustermann@google.com,sgjesse@google.com
BUG=

Review URL: https://codereview.chromium.org//11784023

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16719 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-07 15:59:21 +00:00
kustermann@google.com ee3e000d63 Revert changes in tools/testing, since we use the checked-in version for the testing scripts
Review URL: https://codereview.chromium.org//11783010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16688 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-07 11:43:36 +00:00
floitsch@google.com 4a7dfd2da3 Big merge from experimental to bleeding edge.
Review URL: https://codereview.chromium.org//11783009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16687 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-07 11:23:16 +00:00
efortuna@google.com 274ac61643 Reverting everything because package root + dartium is causing serious problems.
DART_PACKAGE_ROOT environment variable is set for drt, but not dartium, and is location is problematic with respect to serving the files in the dartium checkout.

Review URL: https://codereview.chromium.org//11800002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16678 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-05 05:20:06 +00:00
efortuna@google.com 06ea3385ff Fix dartc testing.
TBR=sra,

BUG=

Review URL: https://codereview.chromium.org//11784011

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16675 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-05 03:41:15 +00:00
efortuna@google.com 1d3b0c4b3b Add cross-origin test with credentials. I modified the test framework slightly
as well to Enable Cross-origin requests while testing from local files.

BUG=

Review URL: https://codereview.chromium.org//11641005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16671 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-05 02:43:31 +00:00
rnystrom@google.com 95cb97091e Don't run the "pkg" tests on the dart binary in the SDK.
The VM bots are apparently running the pkg tests again, and don't
build the SDK.

Review URL: https://codereview.chromium.org//11778006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16655 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-04 22:48:04 +00:00
rnystrom@google.com c450776e7e Make the "pub" and "pkg" test suites run Dart from the built SDK.
I'm not using a test.dart command-line argument for this because
I want to enforce that they *always* run out of the built SDK
directory. This will be needed in a later patch so that the pub
test code can find the SDK directory easily relative to the
currently running Dart executable.

Review URL: https://codereview.chromium.org//11777003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16652 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-04 22:30:11 +00:00