Commit Graph

1689 Commits

Author SHA1 Message Date
efortuna@google.com 87b9e83041 Adding in-browser correctness testing via selenium.
Do not, I repeat, DO NOT enable these to run by default on the buildbot yet
(Currently they do not run by default). I am checking this in in its raw state
so that my fellow frog developers can start making fixes to frog for running in
other browsers. You can run these test by running: 

Install WebDriver stuff by following these instructions:
http://code.google.com/p/selenium/wiki/PythonBindings

Then start the server:
java -jar selenium-server-standalone-2.11.0.jar -browserSessionReuse

../tools/test.py --component=webdriver --report --timeout=10 --progress=color
--mode=release language

Frog generates code that fails in Firefox, but passes in Chrome (for example). We
need to fix this eventually, but it shouldn't cause our entire tree to turn red.
Note also that to run selenium, you will need to install the selenium python
library, and ChromeDriver.
Review URL: http://codereview.chromium.org//8469016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1436 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 01:24:50 +00:00
whesse@google.com 02b001fbaf tools/test.dart: Read test expectations from the status file, and pass them to the test runner.
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8514003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1407 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 17:13:45 +00:00
ager@google.com a427f80ccc Getting started on options parsing.
Support the most common options. So far only the --tasks/-j option
is actually used.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8508054

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1405 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 16:14:06 +00:00
ahe@google.com 40608f24e7 Create class AST nodes.
Review URL: http://codereview.chromium.org//8508016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1399 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 14:43:28 +00:00
floitsch@google.com d0dedfdffc Throw and a small fix to If.
If fix is slightly hacky, but should go away with our refactoring.
BUG=
TEST=

Review URL: http://codereview.chromium.org//8513004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1398 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 14:07:06 +00:00
whesse@google.com 55ad9b0e7b Make tools/test.dart read standalone.status status file when running tests.
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8507010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1358 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-09 15:50:39 +00:00
ager@google.com f789c40d85 Correct the sign of exit codes for the process library.
BUG=
TEST=

Review URL: http://codereview.chromium.org//8506013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1356 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-09 15:37:40 +00:00
whesse@google.com 70da4ae316 Add asynchronous test suite runner to Dart rewrite of test scripts.
BUG=
TEST=

Review URL: http://codereview.chromium.org//8492013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1316 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-08 15:21:47 +00:00
ngeoffray@google.com d92b93178d Fix unbound variable error in python code. This fixes the browser tests breakage.
Review URL: http://codereview.chromium.org//8502015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1304 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-08 12:39:54 +00:00
ngeoffray@google.com 8c9a64166f Add a leg_only test suite, and make sure to run it in our presubmit script.
Review URL: http://codereview.chromium.org//8496009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1303 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-08 12:34:10 +00:00
whesse@google.com a417e377dc Add test_runner.dart to Dart version of test scripts. Include TestRunnerTest unit test.
BUG=
TEST=standalone/TestRunnerTest

Review URL: http://codereview.chromium.org//8440066

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1245 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-07 12:11:07 +00:00
ngeoffray@google.com c93b5a40ea Integrate leg as a component in test.py. Also update presubmit script to run tests with leg.
Review URL: http://codereview.chromium.org//8462004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1187 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-04 10:29:48 +00:00
ngeoffray@google.com 3dedc560f5 - Update tests to make sure they recerefence invalid code.
- Improve multi test case configuration by adding a 'continued' tag.
Review URL: http://codereview.chromium.org//8437091

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1153 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-03 16:58:54 +00:00
ngeoffray@google.com 5d6af6602a Bleeding edge change to get frog integrated into the testing infrastructure.
Review URL: http://codereview.chromium.org//8372095

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1140 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-03 12:15:55 +00:00
whesse@google.com ddf5026893 Dart rewrite of test scripts: do not fail test on missing status file.
BUG=
TEST=standalone/StatusFileParserTest

Review URL: http://codereview.chromium.org//8437048

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1077 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-02 10:35:02 +00:00
whesse@google.com f9a5add2da Add status_file_parser.dart library, and tests for it, to the Dart rewrite of the test suite runner.
BUG=
TEST=standalone/StatusFileParserTest

Review URL: http://codereview.chromium.org//8335008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1076 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-02 10:17:35 +00:00
ahe@google.com 8846883321 Update to co19 revision 15.
Review URL: http://codereview.chromium.org//8430028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1004 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-01 13:29:33 +00:00
ngeoffray@google.com 33ec29bf11 Add a new variable environment for testing, to replace the misusage of 'arch'.
Review URL: http://codereview.chromium.org//8408002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@993 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-01 09:12:55 +00:00
floitsch@google.com 92e7c3981f Increase timeout. Hopefully this reduces the flakiness on the build-server.
Start timeout only when document is loaded.

Review URL: http://codereview.chromium.org//8427012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@964 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-31 18:50:08 +00:00
floitsch@google.com 61b7e92560 Tell the testing-framework that we started the tests.
Review URL: http://codereview.chromium.org//8430005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@956 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-31 17:00:10 +00:00
whesse@google.com 41b8b4a875 Fix type error in tools/testing/dart/status_expression.dart.
BUG=
TEST=standalone/StatusExpressionTest

Review URL: http://codereview.chromium.org//8400058

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@887 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-28 11:47:36 +00:00
whesse@google.com 205ddb3ad1 Start adding files for Dart version of test script test.py.
BUG=
TEST=

Review URL: http://codereview.chromium.org//8394043

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@885 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-28 11:09:48 +00:00
zundel@google.com dc5bf070e1 Fixes problem with running test.py --arch dartc --mode release,debug
The --optimize flag was set for all tests at the top level if
release mode was specified.  I pushed this logic down into the
be a part of generating run command for each individual test case.

BUG=5408215

Review URL: http://codereview.chromium.org//8341066

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@768 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-26 18:12:08 +00:00
ahe@google.com 80e2bb4bd2 Filter-out dart:... sources
Review URL: http://codereview.chromium.org//8329026

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@548 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-19 10:05:03 +00:00
nweiz@google.com 9e293343cc Another fix to the web-test pattern.
Review URL: http://codereview.chromium.org//8297007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@501 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-17 23:59:01 +00:00
rnystrom@google.com c28999e0fa Fix pattern used to tell which tests are web tests.
Review URL: http://codereview.chromium.org//8295012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@453 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-14 21:09:06 +00:00
ngeoffray@google.com fee0ef8fb5 Make sure we cleanup what was generated by the architecture.
Review URL: http://codereview.chromium.org//8283033

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@440 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-14 14:25:18 +00:00
sgjesse@google.com 78f8e7bd91 Only use one process when running tests on Windows
Running more than one process on Windows fails at the moment, and one always need to pass -j1.

R=ngeoffray@google.com, ager@google.com

BUG=
TEST=

Review URL: http://codereview.chromium.org//8272001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@397 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 14:06:41 +00:00
sgjesse@google.com 8e1fe6626d Fix running of tests on Chromium and Dartium
The change in r388 removed the VM options from Chromium and Dartium test runs.

R=ngeoffray@google.com

BUG=
TEST=

Review URL: http://codereview.chromium.org//8258016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@391 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 11:54:36 +00:00
zundel@google.com 3745d707cb Addresses Python style issues in test_configuration.py and test_case.py
Review URL: http://codereview.chromium.org//8260004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@390 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 11:07:18 +00:00
sgjesse@google.com 1cd5459f7b Add the ability to run tests with several sets of VM flags
The test-option VMOptions that can be placed in .dart test files can now be specified several times like this:

// VMOptions=
// VMOptions=--short_socket_read
// VMOptions=--short_socket_write
// VMOptions=--short_socket_read --short_socket_write

For each time VMOptions is specified a seperate test will be bun with the specified flags.

Used this to run the tests that uses sockets with short read and writes. Fixed a number of bugs in both stream implementation and in tests revealed by this.

R=iposva@google.com, ngeoffray@google.com

Review URL: http://codereview.chromium.org//8226016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@388 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 10:14:31 +00:00
zundel@google.com 6bef774e19 Cleans up style problems in architecture.py and test_runner.py
Cleaning these up so I can merge in changes related to
including chromium tests into the mainline test.py.

Review URL: http://codereview.chromium.org//8234029

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@365 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-12 14:12:10 +00:00
zundel@google.com 98c678891c Style cleanups for test.py
This reformats test.py to have consistent Python style.

Review URL: http://codereview.chromium.org//8223016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@353 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-11 22:44:53 +00:00
zundel@google.com 0322aafe87 Migrating guts of run.py to testing/architecture.py
simply moves the bulk for run.py into testing/architecure.py
and updates references.

Review URL: https://chromereviews.googleplex.com/3549014

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@298 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-10 13:52:47 +00:00
karlklose@google.com d95c89a2f4 Allow #import and #source in multi tests.
Review URL: https://chromereviews.googleplex.com/3511021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@119 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-06 14:13:03 +00:00
ngeoffray@google.com 84c81a082d Conditionnaly cleanup after running a command.
Review URL: https://chromereviews.googleplex.com/3546016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@111 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-06 11:04:54 +00:00
ngeoffray@google.com 61486c2267 Small clenaup in the python scripts to make sure all tests get their Cleanup method called.
Review URL: https://chromereviews.googleplex.com/3534013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@108 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-06 10:47:32 +00:00
zundel@google.com 705be03363 Move BatchTester into a separate file.
BUG=
TEST=

Review URL: https://chromereviews.googleplex.com/3521020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@52 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-05 16:50:50 +00:00
zundel@google.com 78d16cca6c Create a directory for python package, move 'testing' in there
Review URL: https://chromereviews.googleplex.com/3514028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-05 14:01:12 +00:00