dart-lang/sdk
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
56,224 Commits 2 Branches 0 Tags
8bfbce33f13da170362434c6332f7d6487d92e55
Commit Graph

1689 Commits

Author SHA1 Message Date
ager@google.com 9c4bb86594 Support actual stub generation in the dart test scripts. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8817017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2120 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-06 13:39:43 +00:00
efortuna@google.com d9e4e72576 Small adjustment to run smoketests on buildbots. 
Review URL: http://codereview.chromium.org//8805015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2096 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-05 22:09:50 +00:00
ager@google.com 456d63c6ab Add support for client/dartc compilation only tests. 
These tests do not fit in that nicely. They have an interesting
way of finding out what are test cases. They use the .dart
suffix in the status file.

Implement directory createTempSync.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8799009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2067 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-05 13:34:12 +00:00
ager@google.com 17d97944a1 Do not show percentages when we don't know what they are in test progress indication. 
Print the --report output as soon as we can.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8776049

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2064 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-05 08:04:57 +00:00
efortuna@google.com a3ac094f6e Tweaking perf testing script and adding smoketests to run on buildbot. 
Review URL: http://codereview.chromium.org//8775058

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2046 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-03 01:34:13 +00:00
ager@google.com 9c8fa42417 Add color indication to progress. 
R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8772044

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2025 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-02 15:22:48 +00:00
ager@google.com e90eb35c57 Fix multitest failure/pass marking. 
Only dynamic type error tests should be marked as negative in
checked mode.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8771036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2022 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-02 14:33:19 +00:00
ager@google.com e2a6cd4eab Make multi tests work with DartC. 
The static type error annotations
are in the multi-tests so that dartc can verify with the
--fatal-type-errors flag that they are correctly caugth.

Enqueue all tests from one configuration before moving on to the next to not start an overwhelming amount of directory listers.

Simplify the setup of dartc batch runners. Simply restart
with the right binary if there is a mismatch. With the new enqueueing switching happens at the right time and we can have as many dartc batch processors as we have cores.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8773036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2018 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-02 13:46:28 +00:00
whesse@google.com 71e98e9d4a tools/test.dart: Add summary report of the number of tests with each expectation. 
BUG=
TEST=tools/test.dart --report

Review URL: http://codereview.chromium.org//8771007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2017 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-02 13:29:26 +00:00
sgjesse@google.com 775438288d Add line handler to string stream 
This adds the line handler to the string stream to provide callbacks
when a line is known to be available.

This change also refactors parts of the string stream to avoid
converting decoded char codes to a string before checking for line
break sequences. With this change the string decoder tracks all line
breaks.

There is still room for improvement as e.g. the coping of the list of
char codes when reading lines can be avoided by using anoher offset.

R=ager@google.com

BUG=
TEST=

Review URL: http://codereview.chromium.org//8772008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2016 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-02 11:59:02 +00:00
ager@google.com 3bf558018e Allow single-dash options to be specified without a space before value. 
./tools/test.dart -mdebug,release

Make the patterns given to the test script more restrictive. A pattern
has to specify the test suite as the first component. The rest is used
as a pattern on all tests within that suite:

./tools/test.dart -mrelease leg co19/leg

will run the leg tests and the co19 tests that contains the substring
'leg' somewhere in the full path name of the test.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8772007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2014 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-02 11:50:05 +00:00
ager@google.com 2995930544 Allow varying case in the expected outcome (Pass, PASS). 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8775007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1981 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-01 13:18:30 +00:00
ager@google.com d337ced66c Fork test scripts to support special runtime checkout. 
Deal with a couple of other issues in tests scripts also
caused by having to support a separate runtime checkout.
Review URL: http://codereview.chromium.org//8773006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1977 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-01 13:02:24 +00:00
whesse@google.com 0fd45f103e tools/test.dart: Add synchronization, so the process queue knows when all multitests are done. 
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8773004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1974 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-01 12:11:40 +00:00
whesse@google.com 90237ddd0b Dart tests: Create generated tests in build directory in test.dart. 
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8754001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1973 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-01 12:01:44 +00:00
ager@google.com 06a0bba5a6 Add the frog test suites to the dart test scripts. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8747018

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1969 260f80e4-7a28-3924-810f-c04153c831b5
 2011-12-01 10:45:28 +00:00
whesse@google.com 2529c010d0 tools/test.dart: Add multitest support to Dart implementation of test runner. 
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8715006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1919 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-30 10:18:09 +00:00
efortuna@google.com 4abe74e1e4 Adding the performance and browser benchmarking script. 
Review URL: http://codereview.chromium.org//8670013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1914 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-30 02:57:08 +00:00
whesse@google.com 9d834082ce Test script tools/test.dart: fix type error in test_suite.dart. 
BUG=
TEST=dart --enable-type-checks tools/test.dart

Review URL: http://codereview.chromium.org//8664029

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1894 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-29 15:12:59 +00:00
ager@google.com 38c6bf8659 Support batch running of dartc tests. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8729030

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1890 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-29 12:38:14 +00:00
sgjesse@google.com da1ecfb1ab Fix handling of VMOptions= in multi tests 
R=kasperl@google.com

BUG=dart:483

TEST=

Review URL: http://codereview.chromium.org//8679025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1837 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-24 11:37:05 +00:00
hausner@google.com 45fff0023d Undo some of the initializing formal change 1755 
I didn't undo those initializing formas that are initializing a private field.
Review URL: http://codereview.chromium.org//8677027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1824 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-23 23:44:14 +00:00
ager@google.com e0651019fc Perform better activity tracking in test scripts. 
Let the process queue be the controller that has full information about pending activities.

R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8682005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1783 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-23 10:40:04 +00:00
ager@google.com 5d7ee32c6e Update test scripts to deal with current VM behavior on optional constructor arguments. 
Find binaries in tests based on the platform we are running on.

R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8662004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1779 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-23 10:22:48 +00:00
hausner@google.com b9cf297c15 Initializing formals can't be optional parameters 
Add new error message to VM compiler.
Remove all optional initializing formals from library
and tests.
Review URL: http://codereview.chromium.org//8619008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1755 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-22 19:09:54 +00:00
ager@google.com d77030bb36 Make Dart test scripts work for the VM on Windows. 
Minor changes:
- Set system to win32 for test expectation files.
- Add the .exe executable postfix to binaries.
- Do the magic to figure out if a test crashed.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8636012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1748 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-22 15:29:27 +00:00
iposva@google.com ea500c9260 - Remove uses of the dart_bin binary. 
Review URL: http://codereview.chromium.org//8597016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1725 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-21 23:50:35 +00:00
ager@google.com 9ef42b14d9 Various test script changes: 
- Supply options to cctests and filter based on name.
- Add samples test suite.
- Minor cleanup in the scripts.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8547012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1703 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-21 15:12:01 +00:00
ager@google.com 40e896bf17 Fix timing of both dart and python test scripts. 
The scripts (in particular the python one) were not counting all
of the setup code that is run before tests are started. The time
reported by the progress indicator now matches the time reported
by 'time test_script'.

R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8609012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1697 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-21 10:36:34 +00:00
ager@google.com 1a09eb8f6a Implement cc test suite and use it to run the VM tests. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8558018

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1696 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-21 10:06:53 +00:00
iposva@google.com 372d425658 - Move generated_tests into the build output directory. 
Review URL: http://codereview.chromium.org//8608004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1693 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-21 07:25:29 +00:00
ager@google.com 7808645ea4 Support stub-generator tests on the VM (which does not actually generate the stubs). 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8590025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1618 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-17 14:27:28 +00:00
ager@google.com 0bbe9566c6 Enable language and isolate tests using the dart test runner. 
Refactor the test_config.dart files. Have a standard implementation
of a test suite that can be easily customized to cover all the
current suites.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8589020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1611 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-17 12:25:01 +00:00
ager@google.com fb9d29c514 Use the right command for dartc. 
Tests running correctly now. The python script does some sort
of batch processing to speed up the test runs. None of that is
in the dart scripts yet.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8588028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1610 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-17 11:20:57 +00:00
ager@google.com 0b8097c578 Start extracting common test_config.dart functionality into a utility library. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8574052

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1607 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-17 09:39:13 +00:00
ager@google.com 9acb066008 Dart test scripts: fix progress time indication. 
Also, fix recursive configuration expansion (--mode=debug,release)
and allow test selection patterns in arbitrary position on the
command line and not just at the end (./tools/test.dart co19 -m release).

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8589017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1606 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-17 09:27:07 +00:00
ager@google.com 2b62a139f2 Enable co19 test suite on dart test scripts. 
Updated the TestExpectations class to be able to deal with the
odd matching rules that are used for co19.

Currently we are using a lot of memory when running all of these
tests. I have optimized the test expectation part quite a bit.
The thing that seems bad now if the processing of all the lines
of every simple test to find DartOptions. We need to work on that.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8539044

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1563 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-16 12:27:06 +00:00
efortuna@google.com bb83c227fe Made changes to the test architecture so that we can run frameworks other than 
just Firefox from WebDriver.
Review URL: http://codereview.chromium.org//8566021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1555 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-16 00:42:18 +00:00
ager@google.com bd670664bb Implement more progress modes. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8528025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1509 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-14 15:52:36 +00:00
ager@google.com 211968eb7a Implement test selection. 
Make it very simple and flexible. I don't think we need to make
it more restrictive than this.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8566001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1502 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-14 11:28:54 +00:00
sigmund@google.com e2b35683cc Minor code clean-ups addressing Nicolas suggestions 
Review URL: http://codereview.chromium.org//8491052

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1478 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 22:20:27 +00:00
ager@google.com 1191c37e56 Enable frog testing components. 
Respect timeout command-line option.

Use option names with underscores understood by all components.

Improve compact progress report using stdout access.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8537010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1460 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 14:08:07 +00:00
whesse@google.com 636a5d6df7 tools/test.dart: Implement --checked option. 
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8537009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1455 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 11:44:06 +00:00
ager@google.com dde03ed8ad Fix build: use strings for booleans in status expression evaluation. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8511057

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1454 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 10:57:39 +00:00
ager@google.com 10092daafd Parse command-line options into a list of test configurations. 
This allows to run multiple variants at once:

./tools/test.dart --mode=debug,release --component=most

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8511056

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1453 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 10:53:18 +00:00
ager@google.com 6b73da258c Implement 'compact' progress indicator. 
At this point it is not that compact because print always prints
a newline and therefore we cannot reuse the same line in the output.
I will update that when we have access to stdout stream.

Removed asserts that fail when test script is run from runtime
directory.

Removed debugging output from status file parsing.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8523009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1452 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 10:24:02 +00:00
ager@google.com 5d40fb2a9f Fix type mismatch errors. Environments do not only contain strings. 
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8539009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1451 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 09:37:08 +00:00
ager@google.com 187e1cd2ab Use the configuration for determining the binary to use for testing. 
So far supporting components vm and dartc.

Also, use the actual configuration for status file parsing.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8540002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1450 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 09:27:51 +00:00
antonm@google.com f8eb259b8d Defer further starting timeout watch dog. 
Recent changed made DOMContentLoaded event to fire before than
Dart application is ready to run.  Therefore the safest bet
timeout watchdog is to wait until the document is fully loaded.

This reverts commit 162f93c5b4def3f2cac2aa1b00fa1d510d1e9940.

Review URL: http://codereview.chromium.org//8525005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1447 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 08:23:05 +00:00
sigmund@google.com e024570e01 Adding frogium: a frog-chromium architecture that runs tests in chromium that 
were compiled with frog.

Review URL: http://codereview.chromium.org//8523024

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1440 260f80e4-7a28-3924-810f-c04153c831b5
 2011-11-11 02:07:02 +00:00