Commit Graph

1689 Commits

Author SHA1 Message Date
zundel@google.com c8d34435fd Backout change in test.dart from -batch to --batch.
Review URL: https://chromiumcodereview.appspot.com//9447094

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4594 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-26 14:20:08 +00:00
zundel@google.com 564d6c5cc1 Incremental build is now off by default
Also got rid of some legacy flag settings.

Review URL: https://chromiumcodereview.appspot.com//9447057

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4593 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-26 13:33:02 +00:00
ngeoffray@google.com 06ce0a4528 Use the component information when the test is being scheduled instead of when it's being created.
Review URL: https://chromiumcodereview.appspot.com//9466008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4572 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-24 14:09:21 +00:00
mattsh@google.com 04eeeaaa3f improved comments
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9454015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4543 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-23 17:27:34 +00:00
ngeoffray@google.com 740d3b7419 Sicne dartc has no backend anymore, a runtime error in a multitest does *not* make it a negative test.
Review URL: https://chromiumcodereview.appspot.com//9442015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4531 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-23 13:57:07 +00:00
mattsh@google.com afcf2f7ee7 frogpad now invokes DumpRenderTree
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9454004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4513 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-23 04:14:18 +00:00
mattsh@google.com 37205ec18f remove end script tag from comment
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9416110

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4492 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-22 21:30:39 +00:00
jmesserly@google.com 42972fdec6 This change runs WebDriver tests in batch mode. This means that it keeps N browsers open, where N is the number of jobs in test.dart. It then passes each in-browser test to the next available browser. This is analogous to how DartC tests reuse the java process.
It seems to cut about 30-40% off the run time of tests on Mac+Firefox, with roughly similar gains for other browsers. It also might reduce the browser startup flakiness--although this needs more testing.

I reused almost all of the logic and protocol from DartC's batch runner. Most of the changes are in run_selenium.py, which now implements the batch protocol when started with --batch.

A few changes to BatchProcessRunner:
  1. it can now pass arguments when starting the batch process. We need this to start "python run_selenium.py --batch"
  2. related to #1, it needs to remove the run_selenium argument when running each individual test.
  3. added a graceful shutdown command so run_selenium can shutdown. I would've preferred SIGTERM or SIGINT, but it doesn't look like that's supported in the Process API (sends only SIGKILL).

Changes to run_selenium.py:
  1. Add a batch mode
  2. Factored the common functionality to preserve "single run" mode

Review URL: https://chromiumcodereview.appspot.com//9420037

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4491 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-22 21:27:46 +00:00
sgjesse@google.com 46e44ecba1 Add both sync and async methods for getting streams for a File
The File class used to have two synchronous methods
openInputStream and openOutputStream for getting streams for a
file. These have now been changed to work asynchronously by the
associated callback inputStreamHandler or outputStreamHandler
when the stream is opened and available.

To support the synchronous API two new methods
openInputStreamSync and openOutputStreamSync which returns the
stream directly as before have been added.

The actual implemnetation of the file streams still uses the
synchronous file API internally. However this change
adds "simulated" handling of noPendingWriteHandler and
closeHandler for file output stream.

R=ager@google.com

BUG=dart:1784

TEST=

Review URL: https://chromiumcodereview.appspot.com//9432023

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4452 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-22 14:11:04 +00:00
mattsh@google.com 0210231746 frogpad now uses vm to generate initial js
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9422027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4408 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-21 21:28:01 +00:00
efortuna@google.com 8973618122 Third time's the charm...
TBR=sigmund@google.com
Review URL: https://chromiumcodereview.appspot.com//9422011

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4372 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-17 21:59:09 +00:00
efortuna@google.com 52d9361aab Make "should retry" argument optional -- RunningProcess is used by separate VM
tests.

TBR=sigmund@google.com
Review URL: https://chromiumcodereview.appspot.com//9424008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4371 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-17 21:50:13 +00:00
efortuna@google.com 36b88ced7a Don't retry browser tests if the bot is pretty red. Also, retry properly all
times that DRT crashes.
Review URL: https://chromiumcodereview.appspot.com//9426005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4370 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-17 21:44:34 +00:00
efortuna@google.com ac9b48b436 Retry DRT if we crash with core dump.
Review URL: https://chromiumcodereview.appspot.com//9426001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4362 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-17 18:11:23 +00:00
jmesserly@google.com 3a1a261452 don't retry if the browser is dumprendertree
Review URL: https://chromiumcodereview.appspot.com//9416033

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4340 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-16 21:20:16 +00:00
sigmund@google.com 3606f4c98e vmbot: fix vm bot config
Review URL: https://chromiumcodereview.appspot.com//9414014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4329 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-16 18:27:05 +00:00
mattsh@google.com 9d294a77df initial frogpad
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9392005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4275 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-15 17:46:32 +00:00
efortuna@google.com ad9e253501 Force close of browser Windows when complete.
Review URL: https://chromiumcodereview.appspot.com//9369051

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4241 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-15 00:54:26 +00:00
sigmund@google.com c656cc1b62 test.dart progress bar: a small tweak when --report is not used.
Review URL: https://chromiumcodereview.appspot.com//9378028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4190 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-13 16:25:26 +00:00
jmesserly@google.com c0d3b1f2a0 Add opera as an option to --browser
Review URL: https://chromiumcodereview.appspot.com//9368056

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4114 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-10 04:15:04 +00:00
efortuna@google.com 306f557107 Additional flakiness reducing changes. Also rerun DRT on false positive tests.
Review URL: https://chromiumcodereview.appspot.com//9368008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4104 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-10 00:26:52 +00:00
whesse@google.com cdb6245f3c Remove test_wrapper.py, replace with test.py (which calls test.dart).
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9369026

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4088 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-09 16:14:50 +00:00
whesse@google.com 53f18a1e4f Add dartdoc comments to Dart testing infrastructure.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9347023

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4079 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-09 14:42:05 +00:00
ahe@google.com d556e26aa7 Frog shouldn't read libraries with --leg_only.
Also, simplify leg options.

Also, don't print Frog specific messages when running leg.

Review URL: https://chromiumcodereview.appspot.com//9373019

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4074 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-09 10:38:47 +00:00
efortuna@google.com 34c061e29e Reduce flakiness of browser tests.
Review URL: https://chromiumcodereview.appspot.com//9361040

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4044 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-08 18:08:13 +00:00
zundel@google.com 1172e2bf77 Remove implicit --optimize from testing dartc component in release mode
Review URL: https://chromiumcodereview.appspot.com//9362013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4040 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-08 16:17:05 +00:00
whesse@google.com 9f27aa3a69 Remove unused support files for old version of tools/test.py.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9360017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4033 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-08 14:11:42 +00:00
efortuna@google.com 0fbaf61a8d Add frog build target on Windows and change frogium and webdriver components to use frog instead of frogsh.
Review URL: https://chromiumcodereview.appspot.com//9350022

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4006 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-07 20:48:14 +00:00
whesse@google.com db48b7504d Make test.dart exit with an error message when a selector is repeated.
BUG=dart:1565
TEST=tools/test.dart standalone/File standalone/Directory

Review URL: https://chromiumcodereview.appspot.com//9348015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3992 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-07 12:56:31 +00:00
ahe@google.com 35fcd5e429 Also increase timeout for leg-debug
Review URL: https://chromiumcodereview.appspot.com//9332001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3951 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-06 16:19:41 +00:00
ahe@google.com bb39ff705f Increase timeout limit in frog-debug
Review URL: https://chromiumcodereview.appspot.com//9328043

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3950 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-06 16:12:55 +00:00
ahe@google.com 533aebd06d @dynamic-type-error are no longer negative tests
BUG=http://code.google.com/p/dart/issues/detail?id=1550

Review URL: https://chromiumcodereview.appspot.com//9310118

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3932 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-06 11:26:15 +00:00
ahe@google.com 2c9093125d Run co19 language tests on leg.
Review URL: https://chromiumcodereview.appspot.com//9325033

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3928 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-05 13:35:04 +00:00
ahe@google.com da2bec0dfc Remove "complex matching" from co19.
Review URL: https://chromiumcodereview.appspot.com//9325024

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3896 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-03 13:27:21 +00:00
whesse@google.com 79b646bb2a In test.dart, don't check that the shell or compiler executable exists if we are just listing tests.
BUG=
TEST=tools/test.dart --list

Review URL: https://chromiumcodereview.appspot.com//9317077

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3894 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-03 13:12:29 +00:00
whesse@google.com e7860a4f33 Change output of test.dart --list option, so it can be parsed automatically.
The framework that lets shared tests be run in Eclipse uses the output of this command, and this framework is tested when running test.dart --component=dartc dartc/junit_tests.

BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9315036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3891 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-03 12:19:20 +00:00
whesse@google.com 8cf7a30c9e Move test.dart's check for missing test directories from co19 to general framework.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9320038

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3886 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-03 09:47:00 +00:00
efortuna@google.com acb397ad92 Fixing Windows buildbot exception.
Review URL: https://chromiumcodereview.appspot.com//9317060

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3872 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-02 20:52:32 +00:00
efortuna@google.com 7f85b28ff6 Fix windows performance tests.
Review URL: https://chromiumcodereview.appspot.com//9325002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3865 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-02 19:15:31 +00:00
antonm@google.com d65a7bd3eb Support passing DartVM flags via DART_FLAGS.
Review URL: https://chromiumcodereview.appspot.com//9320037

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3847 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-02 15:04:27 +00:00
efortuna@google.com 1e734076dc Get Firefox on Windows running.
Review URL: https://chromiumcodereview.appspot.com//9314047

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3811 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-01 21:24:52 +00:00
ager@google.com 9a6f6b8210 Fix VM test suite after path changes.
R=whesse@google.com
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9314032

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3787 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-01 13:18:08 +00:00
whesse@google.com 2f3266f20a Fix test.dart on dartc client compilation tests.
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9317030

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3784 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-01 12:37:32 +00:00
whesse@google.com 03700e60e5 Make test.dart use the path of the running script to find the Dart checkout.
This could be tools/test.dart, tools/test-runtime.dart, or tools/test-compiler.dart.

BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//9302034

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3782 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-01 12:10:24 +00:00
dgrove@google.com f45724122a Fix a few remaining issues from moving swarm.
Review URL: http://codereview.chromium.org//9310010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3759 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 22:56:47 +00:00
whesse@google.com 0fc415a002 Add flag to tools/test.dart. Add utils test suite to list of default suites.
Optional --drt= flag specifies non-standard location of DumpRenderTree for browser tests.

BUG=
TEST=tools/test.dart -cdartium --drt=client/tests/drt/DumpRenderTree

Review URL: https://chromiumcodereview.appspot.com//9159064

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3728 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 14:10:53 +00:00
ahe@google.com 26d232679d Create a URI class in utils/ (based on client/util/).
Review URL: https://chromiumcodereview.appspot.com//9295043

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3722 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 12:11:10 +00:00
efortuna@google.com 95498e8e50 Prevent browser windows from staying open.
Review URL: https://chromiumcodereview.appspot.com//9303019

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3705 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 01:47:41 +00:00
efortuna@google.com 5a44035961 Changing to recommended way to fix console.log in IE by Kasper.
Plus some updates to the test.stats files for IE results.
Review URL: https://chromiumcodereview.appspot.com//9302012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3704 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 00:51:43 +00:00
vsm@google.com 9f963fb24e Refactoring to migrate layout tests over.
I'll rename layout tests to end in Test.dart as I migrate them over.

Review URL: https://chromiumcodereview.appspot.com//9297032

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3674 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-27 23:30:08 +00:00