Commit Graph

206 Commits

Author SHA1 Message Date
sgjesse@google.com 7ff44f77ac Update the test runner to use the new dart:io API
The new binaries are from r19850.

R=whesse@google.com, ager@google.com, ricow@google.com, kustermann@google.com

BUG=

Review URL: https://codereview.chromium.org//12417004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19987 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 07:54:07 +00:00
ricow@google.com ad5da2d318 Add support for the new analyzer to the testing scripts
Review URL: https://codereview.chromium.org//12776004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19885 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-12 18:18:26 +00:00
kustermann@google.com 53497f0c2c Refactoring of ProgressIndicator
Currently ProcessQueue creates and depends on exactly ONE ProgressIndicator.
This is not optimal for the following reasons:

 a) The used ProgressIndicator has several responsibilities (printing timing information,
    setting 'io.exitCode', printing test failures, ...)
    Splitting these responsibilities into different classes makes the code cleaner and more testable.

 b) If we make ProcessQueue depended on an abstract EventListener object (or a list of them) and make
    it send events to those listeners would make it easier to test ProcessQueue itself.

Issue: 8095

Review URL: https://codereview.chromium.org//12302016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19867 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-12 14:09:05 +00:00
ager@google.com ee442f190e Add dart analyzer test suite 'analyze_library' that fails if we
introduce static type warnings in certain dart libraries.

I wanted this for dart:io and might as well add it for the other
libraries that have no warnings when analyzed.

This required a bit of test script reworking. dartc used a leading
hash in a file to determine if it was a test. That is now broken
and has been removed. This also allowed me to override the
readOptionsFromFile method in test suites so that certain analyzer
test suites can require all tests to be static clean.

R=ricow@google.com,kustermann@google.com,sgjesse@google.com,danrubel@google.com
BUG=

Review URL: https://codereview.chromium.org//12475004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19597 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-07 07:25:32 +00:00
amouravski@google.com 3772e3c3fb Add Dartdoc testing to pub bots.
Review URL: https://codereview.chromium.org//12321154

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19417 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-04 19:40:49 +00:00
kasperl@google.com f54583de00 Add --csp flag to test.dart.
When running test with that flag we make sure the HTTP server emits
Content-Security-Policy restriction headers and we pass --disallow-unsafe-eval
to dart2js.

R=ricow@google.com,kustermann@google.com
BUG=

Review URL: https://codereview.chromium.org//12387010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19208 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-28 08:59:33 +00:00
kustermann@google.com 90e2760642 Start two http servers for every configuration
This should fix: http://dartbug.com/8366

Review URL: https://codereview.chromium.org//12340021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18964 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-25 11:54:20 +00:00
kustermann@google.com d2c575c0b0 Create generated tests inside the build directory
Patch Set 1 is a revert of r18295.

Review URL: https://codereview.chromium.org//12223074

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18802 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-21 08:10:37 +00:00
floitsch@google.com ecce8a6293 Remove deprecated Strings class.
Review URL: https://codereview.chromium.org//12295014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18686 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-19 13:57:03 +00:00
efortuna@google.com c6179a50c0 Revert "Change the location of the output directory" plus one other fix.
BUG=

Review URL: https://codereview.chromium.org//12225109

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18295 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-09 02:07:19 +00:00
kustermann@google.com 3396dc77a9 Change the location of the output directory of generated tests to be inside build directory, but not relative to the dart root.
This is causing issues on dartium builders where we actually only run because there is a build/Release (and out/Release or xcodebuild/Release for mac/linux) on the bot that has been created inside src/dart.

Also, fix the http server in the testing script to serve files from the output directory - otherwise the tests will not be accessible if an alternative build directory is used.

Review URL: https://codereview.chromium.org//12183022

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@18176 260f80e4-7a28-3924-810f-c04153c831b5
2013-02-06 16:38:09 +00:00
ricow@google.com 746d3664db Revert revision 17848 - this is breaking dartium testing
Review URL: https://codereview.chromium.org//12087086

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17850 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 15:27:52 +00:00
ricow@google.com 5947bba6cc Change the location of the output directory of generated tests to be inside output directory, but not relative to the dart root.
This is causing issues on dartium builders where we actually only run because there is a build/Release (and out/Release or xcodebuild/Release for mac/linux) on the bot that has been created inside src/dart.

Also, fix the http server in the testing script to serve files from the output directory - otherwise the tests will not be accessible if an alternative build directory is used.
Review URL: https://codereview.chromium.org//11896031

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17848 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-30 14:38:47 +00:00
kustermann@google.com 2e1839e0cf Utilize all cores on IE bots
Review URL: https://codereview.chromium.org//12093044

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17771 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-29 16:20:36 +00:00
kustermann@google.com 22da1e1fc8 Support for running a limited amount of browser tests in parallel
Patch Set 1:
  Refactored test_runner.dart to execute "Command after Command" instead of
  "TestCase after TestCase". By doing so, we don't couple the execution of
  compilation commands to the execution of the browser (or test) command.

Patch Set 2:
  Introduce a limitation on the number of parallel browser executions. By doing
  so we can run 'NumCores' compilation commands in parallel but only a single
  browser test command at any given time (necessary for IE).
  This way we can significantly reduce the cycle time on IE bots.

Review URL: https://codereview.chromium.org//12035053

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17764 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-29 15:16:44 +00:00
blois@google.com e78e8b1cc1 Stubbing out the initial library for Chrome application support.
This adds the core skeleton of Chrome application support with a sample function that allows creating a new window (in dart2js).

BUG=

Review URL: https://codereview.chromium.org//11958026

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17299 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 18:05:19 +00:00
kustermann@google.com d71f8ff86f Added DebugLogger to testing scripts.
Review URL: https://codereview.chromium.org//11962042

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17291 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 16:45:20 +00:00
kustermann@google.com f9a76d5672 Simplify the enqueuing of tests from all test suites
TBR=foo

Review URL: https://codereview.chromium.org//11884054

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17273 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-18 13:50:24 +00:00
efortuna@google.com 4622dc3e76 Make browser tests all run from a server instead of the local filesystem.
BUG=

Review URL: https://codereview.chromium.org//11810004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17007 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-13 01:11:07 +00:00
kustermann@google.com 59a12b72c9 Migration of testing scripts in tools/ to libv2
Review URL: https://codereview.chromium.org//11817012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16867 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-09 18:31:28 +00:00
efortuna@google.com 274ac61643 Reverting everything because package root + dartium is causing serious problems.
DART_PACKAGE_ROOT environment variable is set for drt, but not dartium, and is location is problematic with respect to serving the files in the dartium checkout.

Review URL: https://codereview.chromium.org//11800002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16678 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-05 05:20:06 +00:00
efortuna@google.com 1d3b0c4b3b Add cross-origin test with credentials. I modified the test framework slightly
as well to Enable Cross-origin requests while testing from local files.

BUG=

Review URL: https://codereview.chromium.org//11641005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16671 260f80e4-7a28-3924-810f-c04153c831b5
2013-01-05 02:43:31 +00:00
kustermann@google.com 62c83a4443 Moved the testing scripts to the new import/library/part syntax
Review URL: https://codereview.chromium.org//11575028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16163 260f80e4-7a28-3924-810f-c04153c831b5
2012-12-14 14:19:01 +00:00
kustermann@google.com e78ad924f6 Added support for logging the output of failed flaky tests.
Failed flaky tests will be logged to 'failed_flaky_tests.log'.
The default behavior is that the old log file gets deleted before
any tests are run. To prevent this, the '--append_flaky_log' option
can be set.

Review URL: https://codereview.chromium.org//11364129

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14735 260f80e4-7a28-3924-810f-c04153c831b5
2012-11-09 12:08:00 +00:00
ager@google.com 0fed52bd2d Only start http server for browser tests.
This reduces the annoyance of the fixed port number used and allows
non-browser test configurations to be run in parallel (or one browser
configuration in parallel with a bunch of non-browser configurations).

R=ahe@google.com,ricow@google.com
BUG=

Review URL: https://codereview.chromium.org//11360028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14403 260f80e4-7a28-3924-810f-c04153c831b5
2012-11-01 12:58:44 +00:00
ager@google.com 7f04c40b2d Land update to tools directory with new binaries.
BUG=

Review URL: https://codereview.chromium.org//11343008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14176 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-29 09:21:14 +00:00
scheglov@google.com 4a41088d8d Restore 'samples' in test.dart
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13906 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-22 20:14:17 +00:00
scheglov@google.com 09b22d5b46 Issue 6073. Fixes for 'export'.
http://code.google.com/p/dart/issues/detail?id=6073

R=brianwilkerson@google.com
BUG=

Review URL: https://codereview.chromium.org//11226010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13853 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-20 20:47:58 +00:00
ager@google.com 33b4a0ac44 Fix issues with test.dart that appeared on Mac.
The issue was that we did not properly wait for subprocesses to
die. This was hidden by the fact that we always used exit to exit from
test.dart. I have removed all exit(0) calls from test.dart to keep us
honest. If nothing went wrong test.dart should terminate with exit
code 0 automatically.

R=ricow@google.com,ahe@google.com
BUG=dartbug.com/5644

Review URL: https://codereview.chromium.org//11032047

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13286 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-05 11:41:47 +00:00
ahe@google.com 5b8e8c0459 Revert "Make test.dart executable."
This reverts r13282.

Review URL: https://codereview.chromium.org//11038061

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13284 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-05 11:23:23 +00:00
ahe@google.com 2d77e48462 Make test.dart executable.
Review URL: https://codereview.chromium.org//11065036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13282 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-05 10:59:26 +00:00
ager@google.com f8308cb913 Temporary fix to mac buildbot issue. We need to figure out why
the socket is not immediately available for reuse on the mac.

R=sgjesse@google.com,ahe@google.com
BUG=

Review URL: https://codereview.chromium.org//11040040

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13234 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-04 14:43:47 +00:00
ager@google.com 0346aa70d9 When only listing and not running tests, don't start the http server.
R=sgjesse@google.com
BUG=

Review URL: https://codereview.chromium.org//11029024

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13219 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-04 11:29:05 +00:00
ager@google.com c4c4b7f08c Add in-process http server to the dart test scripts.
Removed support for extra commands. Change pkg/intl test to use
builtin http server.

Fixed regression in test runner so the test script terminates when
passing in an unknown selector.

BUG=

Review URL: https://codereview.chromium.org//11035027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13217 260f80e4-7a28-3924-810f-c04153c831b5
2012-10-04 10:43:48 +00:00
ager@google.com 1159462fc6 Switch from interfaces to abstract classes in dart:io.
Add a bunch of default argument values to the abstract classes
so they are picked up by dartdoc.

R=sgjesse@google.com
BUG=

Review URL: https://codereview.chromium.org//10938010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@12484 260f80e4-7a28-3924-810f-c04153c831b5
2012-09-18 10:54:37 +00:00
ahe@google.com 722e7ce28d Add --step_name option to test.dart.
Review URL: https://chromiumcodereview.appspot.com//10905208

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@12296 260f80e4-7a28-3924-810f-c04153c831b5
2012-09-13 04:19:11 +00:00
ahe@google.com d1af3e7465 Copy all frog/native tests to dart2js_foreign.
Review URL: https://chromiumcodereview.appspot.com//10855248

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@11020 260f80e4-7a28-3924-810f-c04153c831b5
2012-08-21 08:56:36 +00:00
dgrove@google.com 1b580004e1 Remove old frog references from test.dart
Review URL: https://chromiumcodereview.appspot.com//10831329

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@10742 260f80e4-7a28-3924-810f-c04153c831b5
2012-08-15 15:27:44 +00:00
alanknight@google.com ce28be9d2f Move tests for things in /pkg into the right places for packages
Review URL: https://chromiumcodereview.appspot.com//10828310

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@10688 260f80e4-7a28-3924-810f-c04153c831b5
2012-08-14 23:05:20 +00:00
whesse@google.com 5673b2b301 Add Path library and change test scripts, combined change.
Use Path for the filename and TestInformation.filename throughout test scripts.

Change test_suite.dart to use Path class.

Fix bug in join

Address comments.

Address comments

Address comments on Path library.

Add path library to dart:io.

BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10584014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@9203 260f80e4-7a28-3924-810f-c04153c831b5
2012-06-28 15:39:28 +00:00
kasperl@google.com 3eec57a270 Move frog/tests/{leg,leg_only,frog_native} to tests/compiler/.
This may not be the final resting place for these tests, but I want 
to get them out of the frog directory because they really are very
valuable as tests for dart2js.
Review URL: https://chromiumcodereview.appspot.com//10536169

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@8646 260f80e4-7a28-3924-810f-c04153c831b5
2012-06-14 11:28:50 +00:00
whesse@google.com a4e88c8b3e Remove string concatenation with + from all Dart files in tools directory.
Fix whitespace errors and rename shadowed variable in ddbg.dart.

BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10387232

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7897 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-23 08:51:38 +00:00
whesse@google.com dbd1d5b33d Remove system-provided temporary directory usage from test scripts.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10398056

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7783 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-21 08:00:47 +00:00
sigmund@google.com 638238152a lingering step 2 of the test rename overhaul: make await tests also a directory
test rule

Review URL: https://chromiumcodereview.appspot.com//10304018

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7263 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-02 23:21:29 +00:00
sigmund@google.com 8369d0ad46 reenable some dartc tests that have been disabled accidentally. Move
client/dartc/ to samples/dartc/.

Review URL: https://chromiumcodereview.appspot.com//10343008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7262 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-02 22:55:51 +00:00
sigmund@google.com 5b8ad6bfab test rename overhaul: step 14 - vm tests
Review URL: https://chromiumcodereview.appspot.com//10271014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7245 260f80e4-7a28-3924-810f-c04153c831b5
2012-05-02 16:46:16 +00:00
sigmund@google.com f8db005eb2 test rename overhaul: step 12 - standalone
Review URL: https://chromiumcodereview.appspot.com//10252020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7165 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-30 17:34:19 +00:00
sigmund@google.com 13ec089739 test rename overhaul: step 13 - samples
Review URL: https://chromiumcodereview.appspot.com//10253022

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7164 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-30 17:27:08 +00:00
ager@google.com a51e9e3591 Implement HMAC support in lib/crypto.
R=sgjesse@google.com,benl@google.com
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10170027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7145 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-30 09:54:59 +00:00
sigmund@google.com 1dd7f30abc test rename overhaul: step 11 - tests/utils
Review URL: https://chromiumcodereview.appspot.com//10170040

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@7117 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-28 00:16:04 +00:00