Commit Graph

206 Commits

Author SHA1 Message Date
kustermann@google.com 54b71bdbe2 Reaply "Use a real package-root for all of our samples (and tests inside a package) instead of buildDir/packages/"
R=whesse@google.com

Review URL: https://codereview.chromium.org//133653004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31694 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-10 15:15:37 +00:00
kustermann@google.com dc24212755 Added PkgBuildTestSuite (aka 'pkgbuild')
This CL adds
 - support for fetching dependencies via 'pub get' of samples/packages
 - support for building applications/samples via 'pub build' (or a custom
   build.dart file)
 - pkg/pkgbuild.status: Status files for all package checkouts/builds
 - the '--use-public-packages' option to test.dart
 - the CleanDirectoryCopyCommand, PubCommand, ModifyPubspecYamlCommand commands

The test suite can be executed with:
 $ ./tools/test.py -mrelease --use-sdk pkgbuild
 $ ./tools/test.py -mrelease --use-sdk --use-public-packages pkgbuild

R=ricow@google.com

Review URL: https://codereview.chromium.org//122443003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31535 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-07 09:36:27 +00:00
kustermann@google.com 26f065bdb2 Add .test-outcome.log support to test.dart
R=ricow@google.com

Review URL: https://codereview.chromium.org//95603002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30768 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-29 08:29:20 +00:00
kustermann@google.com 1d98fa26bb Only enqueue VmTestSuite on compiler=none,runtime=vm
Review URL: https://codereview.chromium.org//91633003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30720 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 15:17:44 +00:00
kustermann@google.com bb54b776ba Checked-in binary update to v1.0.0.3
R=ricow@google.com

Review URL: https://codereview.chromium.org//91473002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30717 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 14:17:44 +00:00
whesse@google.com 36fe570a31 Remove the --use_browser_controller flag, now that it is always true.
Fix an error in r30269.

BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//68133017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30270 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-14 15:20:31 +00:00
kustermann@google.com b5373a419a Run all tests inside an iframe + restrict number of chrome browser processes on mac
R=ricow@google.com

Review URL: https://codereview.chromium.org//49043003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29367 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 16:31:18 +00:00
kustermann@google.com cf822a851a test.py: Run the analyzer on all dart files in the sdk.
BUG=http://dartbug.com/13024
R=ricow@google.com

Review URL: https://codereview.chromium.org//47743005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29362 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 14:45:59 +00:00
kustermann@google.com 94ebff2225 Bugfix in test.dart, adding of specialized test outcomes for analyzer
This CL will:
 - fix a bug in the legacy AnalyzerCommandOutputImpl class (in certain cases
   we did not report that the analyzer was missing a warning).
 - make the outcome of running the analyzer on a test be one of:
   * CompileTimeError
   * MissingCompileTimeError
   * StaticWarning
   * MissingStaticWarning
 - Make status file updates using the new Expectation markers
 - Remove support for '@static-clean':
     Previously running the analyer on a test could either result in
     'Pass' or in 'Fail'. The '@static-clean' annotation has been used
     as a (poor) mechanism to distinguish between errors and warnings.
     Having the 4 markers mentioned above means we can remove '@static-clean'
 - Remove 100 lines of rotted legacy code in our testing scripts.
 - Make a status file entry for every test that has analyzer errors or warnings

R=ricow@google.com

Review URL: https://codereview.chromium.org//46163002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29350 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 10:39:38 +00:00
zra@google.com 5572278a23 Changes to run tests on Dartium content shell on Android.
- In browser_controller.dart, adds a drtOnAndroid Browser.
- Adds flags for starting test servers at fixed ports.
  - This is needed so that android reverse port forwarding
    can be set up in advance.
- Adds setProp to android.dart to be used in lieu of
  environment variables when testing on Android.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//29773006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29259 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 16:39:48 +00:00
ricow@google.com ba16679d74 Revert revision 27014 "Remove restriction on the number of IE processes running simultainiously"
I updated the comment to better reflect what our current status is.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//23556008

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27041 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-03 11:16:23 +00:00
ahe@google.com eb5906ef01 Remove dart2js_foreign.
R=kustermann@google.com

Review URL: https://codereview.chromium.org//23477028

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27032 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-03 08:41:32 +00:00
ricow@google.com bfa2c1d9dd Remove restriction on the number of IE processes running simultainiously
R=kustermann@google.com

Review URL: https://codereview.chromium.org//23437021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27014 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 14:16:13 +00:00
kustermann@google.com b0889233cd test.py: Print the warning about left-over dirs only for directories created using Directory.createTemp()
R=ricow@google.com

Review URL: https://codereview.chromium.org//23714002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27003 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 09:29:12 +00:00
kustermann@google.com 7c2d27bb13 Add again the *necessary* timeout markers for tests running on ie9/ie10
R=ahe@google.com

Review URL: https://codereview.chromium.org//23830002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26930 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 17:32:42 +00:00
kustermann@google.com bdb11d93c0 Reduce the number of processes/tests run in parallel by test.dart
R=ahe@google.com

Review URL: https://codereview.chromium.org//23436004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26907 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 09:34:49 +00:00
jmesserly@google.com b5e9c9546c Reorganize tests for samples so the test is discoverable from the sample
This change gets rid of the legacy "samples/test/samples/samples.status" folder structure. Instead it moves to "samples/samples.status", and each sample's test moves into its "test" folder.

The benefit is less "..", easier to find the test for the sample, matching the structure of "pkg" and reducing levels of nesting. My other motivation is to help fix https://code.google.com/p/dart/issues/detail?id=12865, and generally make it easier to write tests for the web samples.

R=devoncarew@google.com, sigmund@google.com

Review URL: https://codereview.chromium.org//23717003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26831 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-29 00:25:39 +00:00
kustermann@google.com 45c42e08f2 Update checked-in binary to 0.6.21.3_r26639 (M6)
R=ricow@google.com

Review URL: https://codereview.chromium.org//23568002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26704 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-27 11:16:37 +00:00
sgjesse@google.com 6b514b1a0c Remove all remaining references to dartc
R=ricow@google.com
BUG=

Review URL: https://codereview.chromium.org//23301004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26338 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-20 06:17:03 +00:00
ricow@google.com 73826dc6bf Add support for ie in the browser controller
Also, add no caching headers (since IE will cache the task that it gets)

R=kustermann@google.com

Review URL: https://codereview.chromium.org//22420002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26112 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-14 11:30:48 +00:00
kustermann@google.com 84d4f0bebe test.py: Print command line when starting http servers in case of '--verbose'
R=ricow@google.com

Review URL: https://codereview.chromium.org//22532003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@25862 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-07 08:52:26 +00:00
kustermann@google.com 92303dffda test.py: First step towards support of caching dart2js compilations across runtimes
This CL changes the way we run tests completely: When enqueueing TestCases we
build up a dependency graph of Commands. This has the advantage that if more
TestCases share common commands, we only execute it once.

R=ricow@google.com

Review URL: https://codereview.chromium.org//21001003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@25760 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-05 07:54:17 +00:00
kustermann@google.com cb18d8ba87 Removed compiler/ directory from repository
R=ricow@google.com

Review URL: https://codereview.chromium.org//20722006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@25728 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-02 08:31:15 +00:00
ricow@google.com af21d74d2d Fix safari browser to use Future.value
Also correct type errors found by the analyzer.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//18089005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24532 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-27 17:07:17 +00:00
ricow@google.com ecb4dea649 Add safari cache clearing browser functionality to the safari browser.
Also, add flag to test.dart to enable this feature.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//17489002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24215 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-20 10:30:04 +00:00
ricow@google.com 756c5de9aa Remove special casing of number of dart compilation processes on mac.
I want to know if this actually has an effect or not.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//17377005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24136 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-18 11:51:37 +00:00
ricow@google.com b814373e75 Change number of started browser processes to the max number of browser processes.
R=kustermann@google.com

Review URL: https://codereview.chromium.org//17037003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24094 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-17 12:45:12 +00:00
ricow@google.com 8ebb5cd61a Limit number of safari process to 1 (or num processes -3)
R=kustermann@google.com

Review URL: https://codereview.chromium.org//17076007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24092 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-17 12:21:55 +00:00
kustermann@google.com 7ac44d347f Reduce the number of browser processes on safari
This is a temporary measure until we figure out what's wrong with the new
browser_controller.

R=ricow@google.com

Review URL: https://codereview.chromium.org//17235003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24082 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-17 09:40:24 +00:00
kustermann@google.com 29d11f90ad Use run_vm_tests.host to list VM tests if possible
R=ricow@google.com

Review URL: https://codereview.chromium.org//15963011

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@23348 260f80e4-7a28-3924-810f-c04153c831b5
2013-05-29 12:36:34 +00:00
kustermann@google.com c2304eff9c Disable VM unittests in test.py for arm/mips for the moment
R=ricow@google.com

Review URL: https://codereview.chromium.org//15956006

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@23247 260f80e4-7a28-3924-810f-c04153c831b5
2013-05-28 10:33:46 +00:00
kustermann@google.com 4353bead01 Record/replay support to test.py
R=ricow@google.com

Review URL: https://codereview.chromium.org//15944005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@23216 260f80e4-7a28-3924-810f-c04153c831b5
2013-05-27 12:23:39 +00:00
kustermann@google.com 2a49e58294 Added support for running dart2js tests on android devices
R=ricow@google.com

Review URL: https://codereview.chromium.org//15567002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@23022 260f80e4-7a28-3924-810f-c04153c831b5
2013-05-22 15:34:32 +00:00
ricow@google.com e7f790dba5 Fix csp flags send to browsers.
We can't send the webkit flag to chrome, it will throw an error.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//14645003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@22178 260f80e4-7a28-3924-810f-c04153c831b5
2013-04-30 12:02:49 +00:00
sgjesse@google.com 921653a087 Add a new test suite 'analyze_tests'
The new test suite 'analyze_tests' will run the analyzer on the
selected tests, and fail if there are static type errors. Currently
only the tests in tests/standalone are included, but that can easily
be expanded.

The reason for starting this was that for M4 we where missing two
'part' files in io.dart (for the HttpBody utility class). This caused
the use of HttpBody in the editor to be complicated. With static type
checking on the tests which tested HttpBody this mistake would have
been caught.

R=ager@google.com, ricow@google.com, kustermann@google.com, ajohnsen@google.com
BUG=

Review URL: https://codereview.chromium.org//14436004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@21944 260f80e4-7a28-3924-810f-c04153c831b5
2013-04-24 12:47:13 +00:00
nweiz@google.com 24213beff5 Move pub into sdk/lib/_internal.
This also converts pub to a more package-like layout, which will help in the
eventual exposing of pub internals as a library. Since pub's sources are now in
lib/src, this also makes them importable from the tests and entrypoint using
"package:" imports.

BUG=6619

Review URL: https://codereview.chromium.org//14297021

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@21907 260f80e4-7a28-3924-810f-c04153c831b5
2013-04-23 21:44:26 +00:00
kustermann@google.com d077ef8ee9 Support for removing left over temporary directories from dart processes
VM developers have asked for a way to make test.py automatically
delete left-over temporary directories at the start.

This CL will enable them to do so, but they need to opt-in for it, by setting
the environment variable DART_TESTING_DELETE_TEMPORARY_DIRECTORIES to 1.

Review URL: https://codereview.chromium.org//14244009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@21669 260f80e4-7a28-3924-810f-c04153c831b5
2013-04-18 09:18:29 +00:00
kustermann@google.com 04f9ab4f6d Print the failure summary by default
It was requested that we should print the failure summary by default (again).
This will print all failures twice.

Review URL: https://codereview.chromium.org//14139011

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@21361 260f80e4-7a28-3924-810f-c04153c831b5
2013-04-12 15:08:33 +00:00
ahe@google.com 7fb4ed976a Don't extract per-config options from firstConf.
Review URL: https://codereview.chromium.org//14173004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@21282 260f80e4-7a28-3924-810f-c04153c831b5
2013-04-11 14:59:20 +00:00
amouravski@google.com 4f78a435db Added tests for docs.dart
Review URL: https://codereview.chromium.org//13000005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20630 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-28 18:25:23 +00:00
kevmoo@j832.com 3b6582d24e fix to test.dart
Review URL: https://codereview.chromium.org//12578017

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20385 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-22 16:31:33 +00:00
kustermann@google.com 4c45723e98 Added --failure-summary option to test.dart
Review URL: https://codereview.chromium.org//12902035

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20379 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-22 13:31:06 +00:00
kustermann@google.com c39e900179 Update of co19_test.dart to reflect new API
Review URL: https://codereview.chromium.org//12517015

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20149 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-18 10:26:22 +00:00
sgjesse@google.com d6955d176c Reapply "Update the test runner to use the new dart:io API"
This reverts r20031.

R=ager@google.com

BUG=

Review URL: https://codereview.chromium.org//12751005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20070 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-15 11:13:39 +00:00
devoncarew@google.com 0cc0f798ce Tweaks to the new_analyzer test suite to not run the dartc unit tests.
Review URL: https://codereview.chromium.org//12833007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20044 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 19:53:49 +00:00
sgjesse@google.com f5270bf202 Revert "Update the test runner to use the new dart:io API" again
This reverts r20027 and r20029

TBR=ager@google.com

BUG=

Review URL: https://codereview.chromium.org//12475010

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20031 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 15:38:18 +00:00
sgjesse@google.com fdaca2fe83 Revert "Update the test runner to use the new dart:io API" again
This reapplies r20004 and r20008 and fixes a HTTP server issue.

TBR=ager@google.com

BUG=

Review URL: https://codereview.chromium.org//12431020

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20027 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 15:24:36 +00:00
sgjesse@google.com 3e2ffb4394 Revert "Update the test runner to use the new dart:io API" again
This reverts r20004 and r20008.

TBR=ager@google.com

BUG=

Review URL: https://codereview.chromium.org//12559013

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20009 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 12:13:37 +00:00
sgjesse@google.com db7821cdf3 Reapply "Update the test runner to use the new dart:io API"
The Linux binary will work on the bots. Fixed a number of issues.

The new binaries are from r19850.

R=ager@google.com

BUG=

Review URL: https://codereview.chromium.org//12608007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@20004 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 11:39:20 +00:00
sgjesse@google.com 78403ce605 Revert "Update the test runner to use the new dart:io API"
This reverts commit r19987.

The included binaries did not work on the bots due to a glibc version issue.

TBR=ager@google.com

BUG=

Review URL: https://codereview.chromium.org//12864003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@19988 260f80e4-7a28-3924-810f-c04153c831b5
2013-03-14 08:08:56 +00:00