dart-lang/sdk
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
63,821 Commits 2 Branches 0 Tags
b316210d94dece7d34cbe69f8f9e2d81de026330
Commit Graph

51 Commits

Author SHA1 Message Date
Natalie Weizenbaum b33dcfdaad Remove the Dromaeo and TodoMVC samples. 
No one was maintaining or using these, and they were stale to the point
that they were breaking pkgbuild tests because their dependencies
weren't compatible with the latest SDK.

This also removes tools/testing/perf_testing, which only tested these
two samples.

R=kevmoo@google.com

Review URL: https://codereview.chromium.org/1576153002 .
 2016-01-11 13:09:26 -08:00
ricow@google.com f4bc3b8d09 Speculative fix for flakines on browser bots 
Review URL: https://codereview.chromium.org//12090067

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17827 260f80e4-7a28-3924-810f-c04153c831b5
 2013-01-30 10:00:38 +00:00
ricow@google.com 03bdded77e Fix selenium to detect and handle browser crashes. 
Some context:
On windows, selenium will be hanging a chrome browser
crashes and additional to this we would actually not get information
that the browser crashed, we would get this as a failing test.

This change basically sets up a python timer that will trigger us to
close the browser using browser.service.stop() (I suspect that when
the browser crashes and does not respond in time selenium will call
browser.quit which will be blocking on trying to kill the remote
service).

In addition, this changes the test_runner to handle a crash exitcode
correctly (we will set it to -10 in the bacth runner, I don't know
why, but I dont want to change that in this cl). The current
hasCrashed getter will mask out errors that it does not recognize as
valid windows crashes (of which -10 is not one since it will have a
bunch of set bits in the middle of the bit pattern). I changed this to
explictily recognize the -10 value.
Input on why we have that value is welcome
Review URL: https://codereview.chromium.org//12051037

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17752 260f80e4-7a28-3924-810f-c04153c831b5
 2013-01-29 10:20:11 +00:00
efortuna@google.com 4622dc3e76 Make browser tests all run from a server instead of the local filesystem. 
BUG=

Review URL: https://codereview.chromium.org//11810004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@17007 260f80e4-7a28-3924-810f-c04153c831b5
 2013-01-13 01:11:07 +00:00
kustermann@google.com 02d33cbafe Print exception information in run_selenium.py. 
Review URL: https://codereview.chromium.org//11826023

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16845 260f80e4-7a28-3924-810f-c04153c831b5
 2013-01-09 10:55:35 +00:00
efortuna@google.com 274ac61643 Reverting everything because package root + dartium is causing serious problems. 
DART_PACKAGE_ROOT environment variable is set for drt, but not dartium, and is location is problematic with respect to serving the files in the dartium checkout.

Review URL: https://codereview.chromium.org//11800002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16678 260f80e4-7a28-3924-810f-c04153c831b5
 2013-01-05 05:20:06 +00:00
efortuna@google.com 1d3b0c4b3b Add cross-origin test with credentials. I modified the test framework slightly 
as well to Enable Cross-origin requests while testing from local files.

BUG=

Review URL: https://codereview.chromium.org//11641005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@16671 260f80e4-7a28-3924-810f-c04153c831b5
 2013-01-05 02:43:31 +00:00
efortuna@google.com 4a23980c8a Take 2 of splitting html tests into subtests. Had to make two changes to drt to 
fully work.
Review URL: https://codereview.chromium.org//11368128

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14703 260f80e4-7a28-3924-810f-c04153c831b5
 2012-11-08 18:54:14 +00:00
efortuna@google.com 868b439bc4 Revert run large html tests individually. 
Review URL: https://codereview.chromium.org//11406002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14667 260f80e4-7a28-3924-810f-c04153c831b5
 2012-11-08 00:11:09 +00:00
efortuna@google.com 3476d1c528 Run large html tests individually. 
Review URL: https://codereview.chromium.org//11293019

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14663 260f80e4-7a28-3924-810f-c04153c831b5
 2012-11-07 23:42:50 +00:00
ahe@google.com 9b49d61cfb Fix syntax errors. 
Review URL: https://codereview.chromium.org//11362079

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14512 260f80e4-7a28-3924-810f-c04153c831b5
 2012-11-05 06:22:15 +00:00
ahe@google.com a57b4fbf71 Prevent hanging if selenium cannot close browser. 
Review URL: https://codereview.chromium.org//11275125

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14511 260f80e4-7a28-3924-810f-c04153c831b5
 2012-11-05 06:17:33 +00:00
ahe@google.com fbe2e51663 Disable Firefox console logging as it appears to hang the browser. 
See this selenium bug: http://code.google.com/p/selenium/issues/detail?id=4375

Review URL: https://codereview.chromium.org//11362036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@14419 260f80e4-7a28-3924-810f-c04153c831b5
 2012-11-01 17:46:30 +00:00
efortuna@google.com 48a9e653c8 Mark ie10 + Windows as an acceptable browser + OS combo. 
Review URL: https://codereview.chromium.org//11175043

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13979 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-23 17:24:24 +00:00
efortuna@google.com 89d7cdaae5 One more ie -> ie9 rename. 
Review URL: https://codereview.chromium.org//11191031

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13750 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-17 18:06:15 +00:00
gram@google.com 306a9255d2 Revert r13442. The extension fails to install under Windows, and the sentinel 
message approach does not work on Mac; Mac seems to need the old timeout approach.
So only Linux works at this point.
Review URL: https://codereview.chromium.org//11098028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13450 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-09 22:48:13 +00:00
efortuna@google.com 47d4ff93d3 Fix IEDriver error on closing. 
Review URL: https://codereview.chromium.org//11088038

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13444 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-09 21:48:02 +00:00
gram@google.com ee34ca9e60 Chrome extension to get console messages upon test failures. Unlike the 
prior one which used chrome.experimental.console APIs, which aren't accessible
to non-devtool extensions, this one uses remote debugging APIs, which are.
Review URL: https://codereview.chromium.org//11092015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13442 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-09 21:09:22 +00:00
ahe@google.com 664bd6427c Revert "Experiment: revert parts of r13318." 
This reverts r13403.

Review URL: https://codereview.chromium.org//11093019

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13407 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-09 11:48:34 +00:00
ahe@google.com c593b45989 Experiment: revert parts of r13318. 
Review URL: https://codereview.chromium.org//11086021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13403 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-09 09:47:56 +00:00
ricow@google.com db7f80469b Give more debug info from selenium driver. 
Review URL: https://codereview.chromium.org//11098013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13394 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-09 06:22:09 +00:00
gram@google.com 5187e54f41 Fixed the issue with the ConsoleCollector extension causing FF to hang if run from WebDriver. 
Review URL: https://codereview.chromium.org//11028067

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13318 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-05 20:47:52 +00:00
ricow@google.com 96814a521e Revert r13264, it is making the firefox bot very slow, with hundreds of tests timing out. 
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13272 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-05 05:43:42 +00:00
gram@google.com e2709f12e6 Add the ability to get the Javascript console errors in Firefox in the test output when tests fail. 
Review URL: https://codereview.chromium.org//11043007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@13264 260f80e4-7a28-3924-810f-c04153c831b5
 2012-10-04 21:51:06 +00:00
gram@google.com eb2a0fc533 Eliminate some of the flakiness in testing: 
- errors in test_controller.js get posted to the Dart configs
- Dart configs will receive these and set uncaughtError
- Selenium driver will output the full HTML body, not just up to the first script tag (else the errors above could be lost).
Review URL: https://codereview.chromium.org//10968040

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@12735 260f80e4-7a28-3924-810f-c04153c831b5
 2012-09-21 20:21:32 +00:00
efortuna@google.com 5778a6896f Improve selenium RC failure message. 
Review URL: https://codereview.chromium.org//10907222

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@12357 260f80e4-7a28-3924-810f-c04153c831b5
 2012-09-13 22:10:42 +00:00
efortuna@google.com 31cf5d5c24 Always turn on auto-updating on firefox for browser tests. 
Review URL: https://chromiumcodereview.appspot.com//10909131

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@12081 260f80e4-7a28-3924-810f-c04153c831b5
 2012-09-07 23:49:32 +00:00
efortuna@google.com 5072b18d98 Enable Opera testing (!!!). 
Review URL: https://chromiumcodereview.appspot.com//10832239

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@10513 260f80e4-7a28-3924-810f-c04153c831b5
 2012-08-10 16:50:34 +00:00
vsm@google.com 7a5a9ecc63 More robust exit test for Dromaeo 
This should fix the immediate close in Safari.

Review URL: https://chromiumcodereview.appspot.com//10827232

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@10423 260f80e4-7a28-3924-810f-c04153c831b5
 2012-08-08 22:02:31 +00:00
samhop@google.com 9d08d66b7d added preliminary ShadowDOM tests 
BUG=
TEST=

Review URL: https://chromiumcodereview.appspot.com//10661039

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@9141 260f80e4-7a28-3924-810f-c04153c831b5
 2012-06-26 23:16:07 +00:00
efortuna@google.com d986fd676b Get Dromaeo tests running on Windows. 
Review URL: https://chromiumcodereview.appspot.com//10115011

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6666 260f80e4-7a28-3924-810f-c04153c831b5
 2012-04-17 23:23:37 +00:00
vsm@google.com 2f2b098362 Add runtime=dartium webdriver support to test.dart 
Review URL: https://chromiumcodereview.appspot.com//9960050

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6381 260f80e4-7a28-3924-810f-c04153c831b5
 2012-04-10 20:53:00 +00:00
vsm@google.com e17d681cc1 Preliminary selenium support for Dartium 
Note, nothing is hooked up to get_drt.py --dartium yet.  Future CLs
will download it on demand in:
- run_perf_tests.py
- test.dart for webdriver tests

Review URL: https://chromiumcodereview.appspot.com//10014004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6343 260f80e4-7a28-3924-810f-c04153c831b5
 2012-04-09 22:07:13 +00:00
vsm@google.com 90fefc69d6 Various perf/selenium script cleanup suggested in earlier CLs 
Review URL: https://chromiumcodereview.appspot.com//9960018

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6219 260f80e4-7a28-3924-810f-c04153c831b5
 2012-04-05 14:38:17 +00:00
vsm@google.com 1bb202400f Add support for Dromaeo tests in perf scripts. 
Review URL: https://chromiumcodereview.appspot.com//9958051

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@6115 260f80e4-7a28-3924-810f-c04153c831b5
 2012-04-02 22:13:58 +00:00
efortuna@google.com 24340ce51b Clean up temporary directories in buildbot script. 
Review URL: https://chromiumcodereview.appspot.com//9600033

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4985 260f80e4-7a28-3924-810f-c04153c831b5
 2012-03-05 22:15:31 +00:00
ager@google.com 6cd0ec3577 Add token to stderr as well as stdout for batch processing. 
This makes it easy to tell when a test is completed and we have all
the output. stderr and stdout are independent file descriptors so
this is the only reliable way to know that you have flushed both.

Review URL: https://chromiumcodereview.appspot.com//9569003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4782 260f80e4-7a28-3924-810f-c04153c831b5
 2012-03-01 09:13:47 +00:00
jmesserly@google.com 42972fdec6 This change runs WebDriver tests in batch mode. This means that it keeps N browsers open, where N is the number of jobs in test.dart. It then passes each in-browser test to the next available browser. This is analogous to how DartC tests reuse the java process. 
It seems to cut about 30-40% off the run time of tests on Mac+Firefox, with roughly similar gains for other browsers. It also might reduce the browser startup flakiness--although this needs more testing.

I reused almost all of the logic and protocol from DartC's batch runner. Most of the changes are in run_selenium.py, which now implements the batch protocol when started with --batch.

A few changes to BatchProcessRunner:
  1. it can now pass arguments when starting the batch process. We need this to start "python run_selenium.py --batch"
  2. related to #1, it needs to remove the run_selenium argument when running each individual test.
  3. added a graceful shutdown command so run_selenium can shutdown. I would've preferred SIGTERM or SIGINT, but it doesn't look like that's supported in the Process API (sends only SIGKILL).

Changes to run_selenium.py:
  1. Add a batch mode
  2. Factored the common functionality to preserve "single run" mode

Review URL: https://chromiumcodereview.appspot.com//9420037

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4491 260f80e4-7a28-3924-810f-c04153c831b5
 2012-02-22 21:27:46 +00:00
efortuna@google.com 306f557107 Additional flakiness reducing changes. Also rerun DRT on false positive tests. 
Review URL: https://chromiumcodereview.appspot.com//9368008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4104 260f80e4-7a28-3924-810f-c04153c831b5
 2012-02-10 00:26:52 +00:00
efortuna@google.com 34c061e29e Reduce flakiness of browser tests. 
Review URL: https://chromiumcodereview.appspot.com//9361040

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@4044 260f80e4-7a28-3924-810f-c04153c831b5
 2012-02-08 18:08:13 +00:00
efortuna@google.com 95498e8e50 Prevent browser windows from staying open. 
Review URL: https://chromiumcodereview.appspot.com//9303019

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3705 260f80e4-7a28-3924-810f-c04153c831b5
 2012-01-31 01:47:41 +00:00
efortuna@google.com 5a44035961 Changing to recommended way to fix console.log in IE by Kasper. 
Plus some updates to the test.stats files for IE results.
Review URL: https://chromiumcodereview.appspot.com//9302012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3704 260f80e4-7a28-3924-810f-c04153c831b5
 2012-01-31 00:51:43 +00:00
efortuna@google.com c8e620d663 Fix frogsh + Windows + test.dart take 2 
Review URL: https://chromiumcodereview.appspot.com//9117010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3522 260f80e4-7a28-3924-810f-c04153c831b5
 2012-01-23 23:34:13 +00:00
sigmund@google.com 036f2cdbd3 Revert "Make changes to test.dart and frogsh for Windows." 
Review URL: https://chromiumcodereview.appspot.com//9193021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3510 260f80e4-7a28-3924-810f-c04153c831b5
 2012-01-23 19:59:06 +00:00
efortuna@google.com 9bd7f7722f Make changes to test.dart and frogsh for Windows. 
This should enable frogsh to build correctly and function properly on Windows. 
test.dart is waiting on a fix in the VM before it will be fully ready.
Review URL: https://chromiumcodereview.appspot.com//9233015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3506 260f80e4-7a28-3924-810f-c04153c831b5
 2012-01-23 19:09:32 +00:00
efortuna@google.com 4ecc520173 Make changes for Safari to run with webdriver on the bots. 
Review URL: https://chromiumcodereview.appspot.com//9252002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@3382 260f80e4-7a28-3924-810f-c04153c831b5
 2012-01-18 02:22:10 +00:00
efortuna@google.com 9a525e35c6 Final touches for running smoketests. On buildbot, run 
python create_graph.py -v -b -l
Review URL: http://codereview.chromium.org//8890091

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2491 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-15 23:24:46 +00:00
efortuna@google.com 011093a066 Add Safari to the list of browsers we test on a regular basis. 
Review URL: http://codereview.chromium.org//8920009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2393 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-13 18:56:41 +00:00
efortuna@google.com 4abe74e1e4 Adding the performance and browser benchmarking script. 
Review URL: http://codereview.chromium.org//8670013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1914 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-30 02:57:08 +00:00
efortuna@google.com bb83c227fe Made changes to the test architecture so that we can run frameworks other than 
just Firefox from WebDriver.
Review URL: http://codereview.chromium.org//8566021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1555 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-16 00:42:18 +00:00