efortuna@google.com
87b9e83041
Adding in-browser correctness testing via selenium.
...
Do not, I repeat, DO NOT enable these to run by default on the buildbot yet
(Currently they do not run by default). I am checking this in in its raw state
so that my fellow frog developers can start making fixes to frog for running in
other browsers. You can run these test by running:
Install WebDriver stuff by following these instructions:
http://code.google.com/p/selenium/wiki/PythonBindings
Then start the server:
java -jar selenium-server-standalone-2.11.0.jar -browserSessionReuse
../tools/test.py --component=webdriver --report --timeout=10 --progress=color
--mode=release language
Frog generates code that fails in Firefox, but passes in Chrome (for example). We
need to fix this eventually, but it shouldn't cause our entire tree to turn red.
Note also that to run selenium, you will need to install the selenium python
library, and ChromeDriver.
Review URL: http://codereview.chromium.org//8469016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1436 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 01:24:50 +00:00
whesse@google.com
02b001fbaf
tools/test.dart: Read test expectations from the status file, and pass them to the test runner.
...
BUG=
TEST=tools/test.dart
Review URL: http://codereview.chromium.org//8514003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1407 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 17:13:45 +00:00
ager@google.com
a427f80ccc
Getting started on options parsing.
...
Support the most common options. So far only the --tasks/-j option
is actually used.
R=whesse@google.com
BUG=
TEST=
Review URL: http://codereview.chromium.org//8508054
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1405 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 16:14:06 +00:00
ahe@google.com
40608f24e7
Create class AST nodes.
...
Review URL: http://codereview.chromium.org//8508016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1399 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 14:43:28 +00:00
floitsch@google.com
d0dedfdffc
Throw and a small fix to If.
...
If fix is slightly hacky, but should go away with our refactoring.
BUG=
TEST=
Review URL: http://codereview.chromium.org//8513004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1398 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-10 14:07:06 +00:00
whesse@google.com
55ad9b0e7b
Make tools/test.dart read standalone.status status file when running tests.
...
BUG=
TEST=tools/test.dart
Review URL: http://codereview.chromium.org//8507010
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1358 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-09 15:50:39 +00:00
ager@google.com
f789c40d85
Correct the sign of exit codes for the process library.
...
BUG=
TEST=
Review URL: http://codereview.chromium.org//8506013
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1356 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-09 15:37:40 +00:00
whesse@google.com
70da4ae316
Add asynchronous test suite runner to Dart rewrite of test scripts.
...
BUG=
TEST=
Review URL: http://codereview.chromium.org//8492013
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1316 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-08 15:21:47 +00:00
ngeoffray@google.com
d92b93178d
Fix unbound variable error in python code. This fixes the browser tests breakage.
...
Review URL: http://codereview.chromium.org//8502015
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1304 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-08 12:39:54 +00:00
ngeoffray@google.com
8c9a64166f
Add a leg_only test suite, and make sure to run it in our presubmit script.
...
Review URL: http://codereview.chromium.org//8496009
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1303 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-08 12:34:10 +00:00
whesse@google.com
a417e377dc
Add test_runner.dart to Dart version of test scripts. Include TestRunnerTest unit test.
...
BUG=
TEST=standalone/TestRunnerTest
Review URL: http://codereview.chromium.org//8440066
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1245 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-07 12:11:07 +00:00
ngeoffray@google.com
c93b5a40ea
Integrate leg as a component in test.py. Also update presubmit script to run tests with leg.
...
Review URL: http://codereview.chromium.org//8462004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1187 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-04 10:29:48 +00:00
ngeoffray@google.com
3dedc560f5
- Update tests to make sure they recerefence invalid code.
...
- Improve multi test case configuration by adding a 'continued' tag.
Review URL: http://codereview.chromium.org//8437091
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1153 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-03 16:58:54 +00:00
ngeoffray@google.com
5d6af6602a
Bleeding edge change to get frog integrated into the testing infrastructure.
...
Review URL: http://codereview.chromium.org//8372095
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1140 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-03 12:15:55 +00:00
whesse@google.com
ddf5026893
Dart rewrite of test scripts: do not fail test on missing status file.
...
BUG=
TEST=standalone/StatusFileParserTest
Review URL: http://codereview.chromium.org//8437048
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1077 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-02 10:35:02 +00:00
whesse@google.com
f9a5add2da
Add status_file_parser.dart library, and tests for it, to the Dart rewrite of the test suite runner.
...
BUG=
TEST=standalone/StatusFileParserTest
Review URL: http://codereview.chromium.org//8335008
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1076 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-02 10:17:35 +00:00
ahe@google.com
8846883321
Update to co19 revision 15.
...
Review URL: http://codereview.chromium.org//8430028
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1004 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-01 13:29:33 +00:00
ngeoffray@google.com
33ec29bf11
Add a new variable environment for testing, to replace the misusage of 'arch'.
...
Review URL: http://codereview.chromium.org//8408002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@993 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-01 09:12:55 +00:00
floitsch@google.com
92e7c3981f
Increase timeout. Hopefully this reduces the flakiness on the build-server.
...
Start timeout only when document is loaded.
Review URL: http://codereview.chromium.org//8427012
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@964 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-31 18:50:08 +00:00
floitsch@google.com
61b7e92560
Tell the testing-framework that we started the tests.
...
Review URL: http://codereview.chromium.org//8430005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@956 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-31 17:00:10 +00:00
whesse@google.com
41b8b4a875
Fix type error in tools/testing/dart/status_expression.dart.
...
BUG=
TEST=standalone/StatusExpressionTest
Review URL: http://codereview.chromium.org//8400058
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@887 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-28 11:47:36 +00:00
whesse@google.com
205ddb3ad1
Start adding files for Dart version of test script test.py.
...
BUG=
TEST=
Review URL: http://codereview.chromium.org//8394043
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@885 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-28 11:09:48 +00:00
zundel@google.com
dc5bf070e1
Fixes problem with running test.py --arch dartc --mode release,debug
...
The --optimize flag was set for all tests at the top level if
release mode was specified. I pushed this logic down into the
be a part of generating run command for each individual test case.
BUG=5408215
Review URL: http://codereview.chromium.org//8341066
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@768 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-26 18:12:08 +00:00
ahe@google.com
80e2bb4bd2
Filter-out dart:... sources
...
Review URL: http://codereview.chromium.org//8329026
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@548 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-19 10:05:03 +00:00
nweiz@google.com
9e293343cc
Another fix to the web-test pattern.
...
Review URL: http://codereview.chromium.org//8297007
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@501 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-17 23:59:01 +00:00
rnystrom@google.com
c28999e0fa
Fix pattern used to tell which tests are web tests.
...
Review URL: http://codereview.chromium.org//8295012
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@453 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-14 21:09:06 +00:00
ngeoffray@google.com
fee0ef8fb5
Make sure we cleanup what was generated by the architecture.
...
Review URL: http://codereview.chromium.org//8283033
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@440 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-14 14:25:18 +00:00
sgjesse@google.com
78f8e7bd91
Only use one process when running tests on Windows
...
Running more than one process on Windows fails at the moment, and one always need to pass -j1.
R=ngeoffray@google.com , ager@google.com
BUG=
TEST=
Review URL: http://codereview.chromium.org//8272001
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@397 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 14:06:41 +00:00
sgjesse@google.com
8e1fe6626d
Fix running of tests on Chromium and Dartium
...
The change in r388 removed the VM options from Chromium and Dartium test runs.
R=ngeoffray@google.com
BUG=
TEST=
Review URL: http://codereview.chromium.org//8258016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@391 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 11:54:36 +00:00
zundel@google.com
3745d707cb
Addresses Python style issues in test_configuration.py and test_case.py
...
Review URL: http://codereview.chromium.org//8260004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@390 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 11:07:18 +00:00
sgjesse@google.com
1cd5459f7b
Add the ability to run tests with several sets of VM flags
...
The test-option VMOptions that can be placed in .dart test files can now be specified several times like this:
// VMOptions=
// VMOptions=--short_socket_read
// VMOptions=--short_socket_write
// VMOptions=--short_socket_read --short_socket_write
For each time VMOptions is specified a seperate test will be bun with the specified flags.
Used this to run the tests that uses sockets with short read and writes. Fixed a number of bugs in both stream implementation and in tests revealed by this.
R=iposva@google.com , ngeoffray@google.com
Review URL: http://codereview.chromium.org//8226016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@388 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-13 10:14:31 +00:00
zundel@google.com
6bef774e19
Cleans up style problems in architecture.py and test_runner.py
...
Cleaning these up so I can merge in changes related to
including chromium tests into the mainline test.py.
Review URL: http://codereview.chromium.org//8234029
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@365 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-12 14:12:10 +00:00
zundel@google.com
98c678891c
Style cleanups for test.py
...
This reformats test.py to have consistent Python style.
Review URL: http://codereview.chromium.org//8223016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@353 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-11 22:44:53 +00:00
zundel@google.com
0322aafe87
Migrating guts of run.py to testing/architecture.py
...
simply moves the bulk for run.py into testing/architecure.py
and updates references.
Review URL: https://chromereviews.googleplex.com/3549014
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@298 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-10 13:52:47 +00:00
karlklose@google.com
d95c89a2f4
Allow #import and #source in multi tests.
...
Review URL: https://chromereviews.googleplex.com/3511021
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@119 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-06 14:13:03 +00:00
ngeoffray@google.com
84c81a082d
Conditionnaly cleanup after running a command.
...
Review URL: https://chromereviews.googleplex.com/3546016
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@111 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-06 11:04:54 +00:00
ngeoffray@google.com
61486c2267
Small clenaup in the python scripts to make sure all tests get their Cleanup method called.
...
Review URL: https://chromereviews.googleplex.com/3534013
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@108 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-06 10:47:32 +00:00
zundel@google.com
705be03363
Move BatchTester into a separate file.
...
BUG=
TEST=
Review URL: https://chromereviews.googleplex.com/3521020
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@52 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-05 16:50:50 +00:00
zundel@google.com
78d16cca6c
Create a directory for python package, move 'testing' in there
...
Review URL: https://chromereviews.googleplex.com/3514028
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40 260f80e4-7a28-3924-810f-c04153c831b5
2011-10-05 14:01:12 +00:00