d986fd676b
Get Dromaeo tests running on Windows.
...
Review URL: https://chromiumcodereview.appspot.com//10115011
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6666 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-17 23:23:37 +00:00
2f2b098362
Add runtime=dartium webdriver support to test.dart
...
Review URL: https://chromiumcodereview.appspot.com//9960050
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6381 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-10 20:53:00 +00:00
e17d681cc1
Preliminary selenium support for Dartium
...
Note, nothing is hooked up to get_drt.py --dartium yet. Future CLs
will download it on demand in:
- run_perf_tests.py
- test.dart for webdriver tests
Review URL: https://chromiumcodereview.appspot.com//10014004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6343 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-09 22:07:13 +00:00
90fefc69d6
Various perf/selenium script cleanup suggested in earlier CLs
...
Review URL: https://chromiumcodereview.appspot.com//9960018
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6219 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-05 14:38:17 +00:00
1bb202400f
Add support for Dromaeo tests in perf scripts.
...
Review URL: https://chromiumcodereview.appspot.com//9958051
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6115 260f80e4-7a28-3924-810f-c04153c831b5
2012-04-02 22:13:58 +00:00
24340ce51b
Clean up temporary directories in buildbot script.
...
Review URL: https://chromiumcodereview.appspot.com//9600033
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4985 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-05 22:15:31 +00:00
6cd0ec3577
Add token to stderr as well as stdout for batch processing.
...
This makes it easy to tell when a test is completed and we have all
the output. stderr and stdout are independent file descriptors so
this is the only reliable way to know that you have flushed both.
Review URL: https://chromiumcodereview.appspot.com//9569003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4782 260f80e4-7a28-3924-810f-c04153c831b5
2012-03-01 09:13:47 +00:00
42972fdec6
This change runs WebDriver tests in batch mode. This means that it keeps N browsers open, where N is the number of jobs in test.dart. It then passes each in-browser test to the next available browser. This is analogous to how DartC tests reuse the java process.
...
It seems to cut about 30-40% off the run time of tests on Mac+Firefox, with roughly similar gains for other browsers. It also might reduce the browser startup flakiness--although this needs more testing.
I reused almost all of the logic and protocol from DartC's batch runner. Most of the changes are in run_selenium.py, which now implements the batch protocol when started with --batch.
A few changes to BatchProcessRunner:
1. it can now pass arguments when starting the batch process. We need this to start "python run_selenium.py --batch"
2. related to #1 , it needs to remove the run_selenium argument when running each individual test.
3. added a graceful shutdown command so run_selenium can shutdown. I would've preferred SIGTERM or SIGINT, but it doesn't look like that's supported in the Process API (sends only SIGKILL).
Changes to run_selenium.py:
1. Add a batch mode
2. Factored the common functionality to preserve "single run" mode
Review URL: https://chromiumcodereview.appspot.com//9420037
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4491 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-22 21:27:46 +00:00
306f557107
Additional flakiness reducing changes. Also rerun DRT on false positive tests.
...
Review URL: https://chromiumcodereview.appspot.com//9368008
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4104 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-10 00:26:52 +00:00
34c061e29e
Reduce flakiness of browser tests.
...
Review URL: https://chromiumcodereview.appspot.com//9361040
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4044 260f80e4-7a28-3924-810f-c04153c831b5
2012-02-08 18:08:13 +00:00
95498e8e50
Prevent browser windows from staying open.
...
Review URL: https://chromiumcodereview.appspot.com//9303019
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3705 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 01:47:41 +00:00
5a44035961
Changing to recommended way to fix console.log in IE by Kasper.
...
Plus some updates to the test.stats files for IE results.
Review URL: https://chromiumcodereview.appspot.com//9302012
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3704 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-31 00:51:43 +00:00
c8e620d663
Fix frogsh + Windows + test.dart take 2
...
Review URL: https://chromiumcodereview.appspot.com//9117010
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3522 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-23 23:34:13 +00:00
036f2cdbd3
Revert "Make changes to test.dart and frogsh for Windows."
...
Review URL: https://chromiumcodereview.appspot.com//9193021
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3510 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-23 19:59:06 +00:00
9bd7f7722f
Make changes to test.dart and frogsh for Windows.
...
This should enable frogsh to build correctly and function properly on Windows.
test.dart is waiting on a fix in the VM before it will be fully ready.
Review URL: https://chromiumcodereview.appspot.com//9233015
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3506 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-23 19:09:32 +00:00
4ecc520173
Make changes for Safari to run with webdriver on the bots.
...
Review URL: https://chromiumcodereview.appspot.com//9252002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3382 260f80e4-7a28-3924-810f-c04153c831b5
2012-01-18 02:22:10 +00:00
9a525e35c6
Final touches for running smoketests. On buildbot, run
...
python create_graph.py -v -b -l
Review URL: http://codereview.chromium.org//8890091
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2491 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-15 23:24:46 +00:00
011093a066
Add Safari to the list of browsers we test on a regular basis.
...
Review URL: http://codereview.chromium.org//8920009
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2393 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-13 18:56:41 +00:00
4abe74e1e4
Adding the performance and browser benchmarking script.
...
Review URL: http://codereview.chromium.org//8670013
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1914 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-30 02:57:08 +00:00
bb83c227fe
Made changes to the test architecture so that we can run frameworks other than
...
just Firefox from WebDriver.
Review URL: http://codereview.chromium.org//8566021
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1555 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-16 00:42:18 +00:00
87b9e83041
Adding in-browser correctness testing via selenium.
...
Do not, I repeat, DO NOT enable these to run by default on the buildbot yet
(Currently they do not run by default). I am checking this in in its raw state
so that my fellow frog developers can start making fixes to frog for running in
other browsers. You can run these test by running:
Install WebDriver stuff by following these instructions:
http://code.google.com/p/selenium/wiki/PythonBindings
Then start the server:
java -jar selenium-server-standalone-2.11.0.jar -browserSessionReuse
../tools/test.py --component=webdriver --report --timeout=10 --progress=color
--mode=release language
Frog generates code that fails in Firefox, but passes in Chrome (for example). We
need to fix this eventually, but it shouldn't cause our entire tree to turn red.
Note also that to run selenium, you will need to install the selenium python
library, and ChromeDriver.
Review URL: http://codereview.chromium.org//8469016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1436 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 01:24:50 +00:00
efortuna@google.com