Commit Graph

6631 Commits

Author SHA1 Message Date
efortuna@google.com a3ac094f6e Tweaking perf testing script and adding smoketests to run on buildbot.
Review URL: http://codereview.chromium.org//8775058

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2046 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-03 01:34:13 +00:00
dgrove@google.com 332f6c640b Skip building SDK in Debug mode.
Review URL: http://codereview.chromium.org//8784007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2045 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-03 01:07:49 +00:00
dgrove@google.com 88e6204578 Move JSON to its own lib directory in sdk.
Review URL: http://codereview.chromium.org//8786009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2044 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-03 00:29:18 +00:00
dgrove@google.com 35ed89198b Build the sdk in PRODUCT_DIR.
Review URL: http://codereview.chromium.org//8784005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2042 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 23:56:16 +00:00
dgrove@google.com d83560fb0d Initial CL to create SDK directory (this will be done via the usual gyp and tools/build.py process).
Proposed top-level structure:
..sdk/
....bin/
......dart or dart.exe (executable)
......frogc.dart
......frogsh (coming later)
....lib/
......core/
........core_{compiler, frog, runtime}.dart
........{compiler, frog, runtime}/ 
......coreimpl/
........coreimpl_{compiler, frog, runtime}.dart
........{compiler, frog, runtime}/ 
......dom/
........dom.dart
......frog/
......html/ 
........html.dart
......htmlimpl/ 
........htmlimpl.dart
......(more will come here - io, etc)
....tools/
......dartdoc/
......(more will come here)
Review URL: http://codereview.chromium.org//8619005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2040 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 23:20:35 +00:00
ager@google.com 9c8fa42417 Add color indication to progress.
R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8772044

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2025 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 15:22:48 +00:00
ager@google.com e90eb35c57 Fix multitest failure/pass marking.
Only dynamic type error tests should be marked as negative in
checked mode.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8771036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2022 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 14:33:19 +00:00
ager@google.com e2a6cd4eab Make multi tests work with DartC.
The static type error annotations
are in the multi-tests so that dartc can verify with the
--fatal-type-errors flag that they are correctly caugth.

Enqueue all tests from one configuration before moving on to the next to not start an overwhelming amount of directory listers.

Simplify the setup of dartc batch runners. Simply restart
with the right binary if there is a mismatch. With the new enqueueing switching happens at the right time and we can have as many dartc batch processors as we have cores.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8773036

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2018 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 13:46:28 +00:00
whesse@google.com 71e98e9d4a tools/test.dart: Add summary report of the number of tests with each expectation.
BUG=
TEST=tools/test.dart --report

Review URL: http://codereview.chromium.org//8771007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2017 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 13:29:26 +00:00
sgjesse@google.com 775438288d Add line handler to string stream
This adds the line handler to the string stream to provide callbacks
when a line is known to be available.

This change also refactors parts of the string stream to avoid
converting decoded char codes to a string before checking for line
break sequences. With this change the string decoder tracks all line
breaks.

There is still room for improvement as e.g. the coping of the list of
char codes when reading lines can be avoided by using anoher offset.

R=ager@google.com

BUG=
TEST=

Review URL: http://codereview.chromium.org//8772008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2016 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 11:59:02 +00:00
ager@google.com 3bf558018e Allow single-dash options to be specified without a space before value.
./tools/test.dart -mdebug,release

Make the patterns given to the test script more restrictive. A pattern
has to specify the test suite as the first component. The rest is used
as a pattern on all tests within that suite:

./tools/test.dart -mrelease leg co19/leg

will run the leg tests and the co19 tests that contains the substring
'leg' somewhere in the full path name of the test.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8772007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@2014 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-02 11:50:05 +00:00
ager@google.com 2995930544 Allow varying case in the expected outcome (Pass, PASS).
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8775007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1981 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 13:18:30 +00:00
ager@google.com d337ced66c Fork test scripts to support special runtime checkout.
Deal with a couple of other issues in tests scripts also
caused by having to support a separate runtime checkout.
Review URL: http://codereview.chromium.org//8773006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1977 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 13:02:24 +00:00
ngeoffray@google.com a90e28e7a1 Get rid of guessing the VM location in frog.py.
Review URL: http://codereview.chromium.org//8773005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1976 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 12:58:53 +00:00
whesse@google.com 0fd45f103e tools/test.dart: Add synchronization, so the process queue knows when all multitests are done.
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8773004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1974 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 12:11:40 +00:00
whesse@google.com 90237ddd0b Dart tests: Create generated tests in build directory in test.dart.
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8754001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1973 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 12:01:44 +00:00
ager@google.com 06a0bba5a6 Add the frog test suites to the dart test scripts.
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8747018

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1969 260f80e4-7a28-3924-810f-c04153c831b5
2011-12-01 10:45:28 +00:00
whesse@google.com 2529c010d0 tools/test.dart: Add multitest support to Dart implementation of test runner.
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8715006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1919 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-30 10:18:09 +00:00
efortuna@google.com 4abe74e1e4 Adding the performance and browser benchmarking script.
Review URL: http://codereview.chromium.org//8670013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1914 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-30 02:57:08 +00:00
whesse@google.com 9d834082ce Test script tools/test.dart: fix type error in test_suite.dart.
BUG=
TEST=dart --enable-type-checks tools/test.dart

Review URL: http://codereview.chromium.org//8664029

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1894 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-29 15:12:59 +00:00
ager@google.com 38c6bf8659 Support batch running of dartc tests.
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8729030

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1890 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-29 12:38:14 +00:00
sgjesse@google.com da1ecfb1ab Fix handling of VMOptions= in multi tests
R=kasperl@google.com

BUG=dart:483

TEST=

Review URL: http://codereview.chromium.org//8679025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1837 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-24 11:37:05 +00:00
hausner@google.com 45fff0023d Undo some of the initializing formal change 1755
I didn't undo those initializing formas that are initializing a private field.
Review URL: http://codereview.chromium.org//8677027

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1824 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-23 23:44:14 +00:00
ager@google.com e0651019fc Perform better activity tracking in test scripts.
Let the process queue be the controller that has full information about pending activities.

R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8682005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1783 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-23 10:40:04 +00:00
ager@google.com 5d7ee32c6e Update test scripts to deal with current VM behavior on optional constructor arguments.
Find binaries in tests based on the platform we are running on.

R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8662004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1779 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-23 10:22:48 +00:00
hausner@google.com b9cf297c15 Initializing formals can't be optional parameters
Add new error message to VM compiler.
Remove all optional initializing formals from library
and tests.
Review URL: http://codereview.chromium.org//8619008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1755 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-22 19:09:54 +00:00
ager@google.com d77030bb36 Make Dart test scripts work for the VM on Windows.
Minor changes:
- Set system to win32 for test expectation files.
- Add the .exe executable postfix to binaries.
- Do the magic to figure out if a test crashed.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8636012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1748 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-22 15:29:27 +00:00
iposva@google.com ea500c9260 - Remove uses of the dart_bin binary.
Review URL: http://codereview.chromium.org//8597016

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1725 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-21 23:50:35 +00:00
ager@google.com 8b047a6544 Fix gclient runhooks on Windows for a full checkout.
The problem was incorrect setting of and use of the DEPTH gyp
variable.

R=whesse@google.com
BUG=496
TEST=

Review URL: http://codereview.chromium.org//8472007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1706 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-21 15:47:21 +00:00
ager@google.com 9ef42b14d9 Various test script changes:
- Supply options to cctests and filter based on name.
- Add samples test suite.
- Minor cleanup in the scripts.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8547012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1703 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-21 15:12:01 +00:00
ager@google.com 40e896bf17 Fix timing of both dart and python test scripts.
The scripts (in particular the python one) were not counting all
of the setup code that is run before tests are started. The time
reported by the progress indicator now matches the time reported
by 'time test_script'.

R=sgjesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8609012

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1697 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-21 10:36:34 +00:00
ager@google.com 1a09eb8f6a Implement cc test suite and use it to run the VM tests.
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8558018

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1696 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-21 10:06:53 +00:00
iposva@google.com 372d425658 - Move generated_tests into the build output directory.
Review URL: http://codereview.chromium.org//8608004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1693 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-21 07:25:29 +00:00
ager@google.com 7808645ea4 Support stub-generator tests on the VM (which does not actually generate the stubs).
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8590025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1618 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-17 14:27:28 +00:00
ager@google.com 0bbe9566c6 Enable language and isolate tests using the dart test runner.
Refactor the test_config.dart files. Have a standard implementation
of a test suite that can be easily customized to cover all the
current suites.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8589020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1611 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-17 12:25:01 +00:00
ager@google.com fb9d29c514 Use the right command for dartc.
Tests running correctly now. The python script does some sort
of batch processing to speed up the test runs. None of that is
in the dart scripts yet.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8588028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1610 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-17 11:20:57 +00:00
ager@google.com 0b8097c578 Start extracting common test_config.dart functionality into a utility library.
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8574052

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1607 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-17 09:39:13 +00:00
ager@google.com 9acb066008 Dart test scripts: fix progress time indication.
Also, fix recursive configuration expansion (--mode=debug,release)
and allow test selection patterns in arbitrary position on the
command line and not just at the end (./tools/test.dart co19 -m release).

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8589017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1606 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-17 09:27:07 +00:00
ager@google.com 2b62a139f2 Enable co19 test suite on dart test scripts.
Updated the TestExpectations class to be able to deal with the
odd matching rules that are used for co19.

Currently we are using a lot of memory when running all of these
tests. I have optimized the test expectation part quite a bit.
The thing that seems bad now if the processing of all the lines
of every simple test to find DartOptions. We need to work on that.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8539044

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1563 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-16 12:27:06 +00:00
efortuna@google.com bb83c227fe Made changes to the test architecture so that we can run frameworks other than
just Firefox from WebDriver.
Review URL: http://codereview.chromium.org//8566021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1555 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-16 00:42:18 +00:00
iposva@google.com 4d3a4d6568 - Warn about variable length arrays.
Review URL: http://codereview.chromium.org//8564035

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1543 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-15 19:09:19 +00:00
ager@google.com bd670664bb Implement more progress modes.
R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8528025

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1509 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-14 15:52:36 +00:00
ager@google.com 211968eb7a Implement test selection.
Make it very simple and flexible. I don't think we need to make
it more restrictive than this.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8566001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1502 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-14 11:28:54 +00:00
ager@google.com 1c96143867 Fix activity tracking in test scripts.
Only shutdown when all test listers are done and the process queue
is empty. Before there was a posibility that the script would shut
down when the queue got empty before all the listers were done.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8565001

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1500 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-14 09:21:28 +00:00
sigmund@google.com 67a5aded5a Don't increase default timeouts in frogium tests
Review URL: http://codereview.chromium.org//8536046

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1498 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-12 02:28:54 +00:00
sigmund@google.com e2b35683cc Minor code clean-ups addressing Nicolas suggestions
Review URL: http://codereview.chromium.org//8491052

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1478 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 22:20:27 +00:00
vsm@google.com ef590ec928 Fix typo
TBR=sigmund

Review URL: http://codereview.chromium.org//8491047

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1467 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 17:54:22 +00:00
vsm@google.com 22f003b5b1 Fix formatting on error string
Review URL: http://codereview.chromium.org//8463021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1466 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 17:52:16 +00:00
ager@google.com 1191c37e56 Enable frog testing components.
Respect timeout command-line option.

Use option names with underscores understood by all components.

Improve compact progress report using stdout access.

R=whesse@google.com
BUG=
TEST=

Review URL: http://codereview.chromium.org//8537010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1460 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 14:08:07 +00:00
whesse@google.com 636a5d6df7 tools/test.dart: Implement --checked option.
BUG=
TEST=tools/test.dart

Review URL: http://codereview.chromium.org//8537009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@1455 260f80e4-7a28-3924-810f-c04153c831b5
2011-11-11 11:44:06 +00:00