Commit Graph

42 Commits

Author SHA1 Message Date
efortuna@google.com c6179a50c0 Revert "Change the location of the output directory" plus one other fix.
BUG=

Review URL: https://codereview.chromium.org//12225109

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18295 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-09 02:07:19 +00:00
kustermann@google.com 3396dc77a9 Change the location of the output directory of generated tests to be inside build directory, but not relative to the dart root.
This is causing issues on dartium builders where we actually only run because there is a build/Release (and out/Release or xcodebuild/Release for mac/linux) on the bot that has been created inside src/dart.

Also, fix the http server in the testing script to serve files from the output directory - otherwise the tests will not be accessible if an alternative build directory is used.

Review URL: https://codereview.chromium.org//12183022

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18176 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-06 16:38:09 +00:00
ricow@google.com 746d3664db Revert revision 17848 - this is breaking dartium testing
Review URL: https://codereview.chromium.org//12087086

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17850 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 15:27:52 +00:00
ricow@google.com 5947bba6cc Change the location of the output directory of generated tests to be inside output directory, but not relative to the dart root.
This is causing issues on dartium builders where we actually only run because there is a build/Release (and out/Release or xcodebuild/Release for mac/linux) on the bot that has been created inside src/dart.

Also, fix the http server in the testing script to serve files from the output directory - otherwise the tests will not be accessible if an alternative build directory is used.
Review URL: https://codereview.chromium.org//11896031

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17848 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 14:38:47 +00:00
kustermann@google.com 22da1e1fc8 Support for running a limited amount of browser tests in parallel
Patch Set 1:
  Refactored test_runner.dart to execute "Command after Command" instead of
  "TestCase after TestCase". By doing so, we don't couple the execution of
  compilation commands to the execution of the browser (or test) command.

Patch Set 2:
  Introduce a limitation on the number of parallel browser executions. By doing
  so we can run 'NumCores' compilation commands in parallel but only a single
  browser test command at any given time (necessary for IE).
  This way we can significantly reduce the cycle time on IE bots.

Review URL: https://codereview.chromium.org//12035053

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17764 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-29 15:16:44 +00:00
kustermann@google.com d71f8ff86f Added DebugLogger to testing scripts.
Review URL: https://codereview.chromium.org//11962042

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17291 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 16:45:20 +00:00
kustermann@google.com f9a76d5672 Simplify the enqueuing of tests from all test suites
TBR=foo

Review URL: https://codereview.chromium.org//11884054

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17273 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 13:50:24 +00:00
regis@google.com d8e322afad Fix test harness for running vm tests in runtime directory.
Review URL: https://codereview.chromium.org//11984002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17158 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-16 20:51:35 +00:00
kustermann@google.com 59a12b72c9 Migration of testing scripts in tools/ to libv2
Review URL: https://codereview.chromium.org//11817012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16867 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-09 18:31:28 +00:00
kustermann@google.com e78ad924f6 Added support for logging the output of failed flaky tests.
Failed flaky tests will be logged to 'failed_flaky_tests.log'.
The default behavior is that the old log file gets deleted before
any tests are run. To prevent this, the '--append_flaky_log' option
can be set.

Review URL: https://codereview.chromium.org//11364129

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14735 260f80e4-7a28-3924-810f-c04153c831b5
2012-11-09 12:08:00 +00:00
ager@google.com 0fed52bd2d Only start http server for browser tests.
This reduces the annoyance of the fixed port number used and allows
non-browser test configurations to be run in parallel (or one browser
configuration in parallel with a bunch of non-browser configurations).

R=ahe@google.com,ricow@google.com
BUG=

Review URL: https://codereview.chromium.org//11360028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14403 260f80e4-7a28-3924-810f-c04153c831b5
2012-11-01 12:58:44 +00:00
ager@google.com 7f04c40b2d Land update to tools directory with new binaries.
BUG=

Review URL: https://codereview.chromium.org//11343008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14176 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-29 09:21:14 +00:00
ager@google.com c4c4b7f08c Add in-process http server to the dart test scripts.
Removed support for extra commands. Change pkg/intl test to use
builtin http server.

Fixed regression in test runner so the test script terminates when
passing in an unknown selector.

BUG=

Review URL: https://codereview.chromium.org//11035027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13217 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-04 10:43:48 +00:00
ager@google.com 1159462fc6 Switch from interfaces to abstract classes in dart:io.
Add a bunch of default argument values to the abstract classes
so they are picked up by dartdoc.

R=sgjesse@google.com
BUG=

Review URL: https://codereview.chromium.org//10938010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@12484 260f80e4-7a28-3924-810f-c04153c831b5
2012-09-18 10:54:37 +00:00
dgrove@google.com 518b80f7c6 Continue removal of frog.
Review URL: https://chromiumcodereview.appspot.com//10854232

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@10996 260f80e4-7a28-3924-810f-c04153c831b5
2012-08-20 19:35:58 +00:00
whesse@google.com 5673b2b301 Add Path library and change test scripts, combined change.
Use Path for the filename and TestInformation.filename throughout test scripts.

Change test_suite.dart to use Path class.

Fix bug in join

Address comments.

Address comments

Address comments on Path library.

Add path library to dart:io.

BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10584014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@9203 260f80e4-7a28-3924-810f-c04153c831b5
2012-06-28 15:39:28 +00:00
whesse@google.com a4e88c8b3e Remove string concatenation with + from all Dart files in tools directory.
Fix whitespace errors and rename shadowed variable in ddbg.dart.

BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10387232

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7897 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-23 08:51:38 +00:00
whesse@google.com dbd1d5b33d Remove system-provided temporary directory usage from test scripts.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10398056

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7783 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-21 08:00:47 +00:00
sigmund@google.com 5b8ad6bfab test rename overhaul: step 14 - vm tests
Review URL: https://chromiumcodereview.appspot.com//10271014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7245 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-02 16:46:16 +00:00
sigmund@google.com f8db005eb2 test rename overhaul: step 12 - standalone
Review URL: https://chromiumcodereview.appspot.com//10252020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7165 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-30 17:34:19 +00:00
sigmund@google.com 1dd7f30abc test rename overhaul: step 11 - tests/utils
Review URL: https://chromiumcodereview.appspot.com//10170040

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7117 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-28 00:16:04 +00:00
sigmund@google.com 45efebba9a test rename overhaul: step 10 - crypto tests, and add back other tests commited
recently, but just before the rename overhaul.

Review URL: https://chromiumcodereview.appspot.com//10229002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7115 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-28 00:12:28 +00:00
sigmund@google.com 64d7bc5acf test rename overhaul: step 8 - language tests
Review URL: https://chromiumcodereview.appspot.com//10248007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7101 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-27 18:45:10 +00:00
sigmund@google.com d9eae90196 test rename overhaul: step 7 - corelib tests
Review URL: https://chromiumcodereview.appspot.com//10244009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7096 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-27 18:06:37 +00:00
iposva@google.com d10d1d2cb3 - Add tests/lib to start testing libraries outside of core.
Review URL: https://chromiumcodereview.appspot.com//10197008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6929 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-25 09:13:56 +00:00
asiva@google.com 29334088c1 Fix configuration check so that the test scripts runs the vm unit tests.
Review URL: https://chromiumcodereview.appspot.com//9956005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6045 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-30 16:18:41 +00:00
efortuna@google.com c8e35dbeb1 Rename test.dart component to specify compiler + runtime.
Review URL: https://chromiumcodereview.appspot.com//9838068

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@5893 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-27 18:40:41 +00:00
ager@google.com 659c9a4072 By popular demand, print the configurations being tested by test.dart at startup.
This time don't print anything if the 'silent' progress is requested.

Question to be answered later: Do we actually need the JUnit tests? What do they add?

R=whesse@google.com
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9691045

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@5403 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-13 14:19:29 +00:00
ager@google.com 8a310c9c36 Revert "By popular demand, print the configurations being tested by test.dart at startup."
DartC is parsing all the output without using tokens. I'll have to update
their parser before I can land this.

R=whesse@google.com
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9695039

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@5394 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-13 12:44:12 +00:00
ager@google.com 3c2b1e0a32 By popular demand, print the configurations being tested by test.dart at startup.
R=whesse@google.com
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9689059

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@5393 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-13 12:34:55 +00:00
turnidge@google.com 7647d8ff7f Add the vm internal dart tests into the test suite.
Review URL: https://chromiumcodereview.appspot.com//9414032

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@5113 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-07 19:43:59 +00:00
sigmund@google.com 3606f4c98e vmbot: fix vm bot config
Review URL: https://chromiumcodereview.appspot.com//9414014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4329 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-16 18:27:05 +00:00
ahe@google.com 26d232679d Create a URI class in utils/ (based on client/util/).
Review URL: https://chromiumcodereview.appspot.com//9295043

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3722 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 12:11:10 +00:00
whesse@google.com e543e9901e Synchronize test-runtime.dart and test-compiler.dart with changed test.dart.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9252009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3399 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-18 16:06:44 +00:00
whesse@google.com dfcaf76c50 Make test_wrapper.py and test_compiler.dart that will work for a deps.compiler checkout.
BUG=
TEST=

Review URL: http://codereview.chromium.org//9139017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3236 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-12 14:45:10 +00:00
whesse@google.com f245169804 Add --list option to tools/test.dart.
BUG=
TEST=tools/test.dart --list

Review URL: http://codereview.chromium.org//9053009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2897 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-02 13:20:51 +00:00
ager@google.com fd97081f49 Add --time option to dart test scripts.
This is useful for finding new tests that start taking a long time.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8845001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2183 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-07 16:33:16 +00:00
ager@google.com 5023793165 Correctly handle the --arch argument to dart test scripts.
Support a --verbose/-v flag that prints all commands run.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8835008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2169 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-07 12:48:09 +00:00
ager@google.com 2713ef1ca0 Make tools/test-runtime.dart executable.
R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8803014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2073 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-05 15:00:16 +00:00
ager@google.com e2a6cd4eab Make multi tests work with DartC.
The static type error annotations
are in the multi-tests so that dartc can verify with the
--fatal-type-errors flag that they are correctly caugth.

Enqueue all tests from one configuration before moving on to the next to not start an overwhelming amount of directory listers.

Simplify the setup of dartc batch runners. Simply restart
with the right binary if there is a mismatch. With the new enqueueing switching happens at the right time and we can have as many dartc batch processors as we have cores.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8773036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2018 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 13:46:28 +00:00
ager@google.com 3bf558018e Allow single-dash options to be specified without a space before value.
./tools/test.dart -mdebug,release

Make the patterns given to the test script more restrictive. A pattern
has to specify the test suite as the first component. The rest is used
as a pattern on all tests within that suite:

./tools/test.dart -mrelease leg co19/leg

will run the leg tests and the co19 tests that contains the substring
'leg' somewhere in the full path name of the test.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8772007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2014 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 11:50:05 +00:00
ager@google.com d337ced66c Fork test scripts to support special runtime checkout.
Deal with a couple of other issues in tests scripts also
caused by having to support a separate runtime checkout.
Review URL: http://codereview.chromium.org//8773006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1977 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 13:02:24 +00:00