92cd3e10f5
Fix test.py and tests to use an explicit --packages flag.
...
BUG=https://github.com/dart-lang/sdk/issues/27412
R=johnmccutchan@google.com
Review URL: https://codereview.chromium.org/2361813003 .
2016-09-22 17:51:09 +02:00
523ceac525
Fix type error in test.dart script.
...
BUG=
R=eernst@google.com
Review URL: https://codereview.chromium.org/2264003002 .
2016-08-22 11:50:05 +02:00
620b896e2f
Initial support to test.dart for running precompiler tests on android devices
...
Steps to make this work:
a) Make sure you have an android sdk checkout:
=> See https://github.com/dart-lang/sdk/wiki/Building-Dart-SDK-for-Android
b) Building using android-toolchain crosscompiler:
$ ./tools/build.py -mrelease -aarm --os=android dart_precompiled_runtime
=> Notice --os=android
c) Testing using attached android phones:
$ export PATH=$PATH:$PWD/third_party/android_tools/sdk/platform-tools
$ ./tools/test.py -mrelease -aarm --system=android -cprecompiler -rdart_precompiled --use-blobs
=> Notice --system=android
Failing tests on android can be marked in status files via:
[ $compiler == precompiler && $runtime == dart_precompiled && $system == android ]
R=whesse@google.com
Review URL: https://codereview.chromium.org/1922163002 .
2016-05-02 12:41:22 +02:00
47de553025
tools/testing: move code into individual libraries
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//748773004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42108 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-04 15:32:57 +00:00
61b056964a
tools: removed unused members, tiny cleanup
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//770633003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42106 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-04 13:56:14 +00:00
802c618118
Move test config files under tools/testing/dart
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//708783002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41561 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-06 14:21:19 +00:00
94e1160661
Add PKGTestSuite that will be used for package waterfall testers.
...
This is based on the standard test suite but we specialcase html files.
There is another html file aproach currently being done by whesse@ that we may be able to utilize when it is done instead.
R=sigmund@google.com
Review URL: https://codereview.chromium.org//567803004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40255 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-15 17:16:35 +00:00
4acbe3d75a
Find pub status file in right directory.
...
R=nweiz@google.com
Review URL: https://codereview.chromium.org//561893002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40123 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-10 22:38:24 +00:00
17c1642748
Store the async-await compiled pub code directly in the repo.
...
R=nweiz@google.com
Review URL: https://codereview.chromium.org//557563002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@40041 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-09 16:55:16 +00:00
8bfaae17ea
Add package-root option to the testing scripts
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//552443003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39971 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-08 15:44:45 +00:00
94f0a3f3fd
Refactor testing http server in test.dart.
...
BUG=
R=ricow@google.com
Review URL: https://codereview.chromium.org//539493002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39867 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-04 12:58:19 +00:00
2ccac8093b
Add language tests for Issue 18628.
...
As suggested by @karlklose in https://codereview.chromium.org/513563002/
comments.
Improve testing documentation.
- add a README
- add a description by example of selectors to the "./tools/test.py -h"
output
- update/add source comments
I had a hard time figuring out how to add and run the tests, mostly
because I tried to call them "*_test_1.dart" and "*_test_2.dart", but
language test files must have names of the form "*_test.dart". So, I
added a README summarizing and referencing the relevant docs.
R=brianwilkerson@google.com , karlklose@google.com , jwren@google.com
BUG=
Review URL: https://codereview.chromium.org//521773003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39822 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-03 18:51:25 +00:00
3331fd5366
Put selector generation for the suite_dir runs in the same place as the other selector expansion
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//530363003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39796 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-03 08:12:39 +00:00
8327e55137
Support passing in a test suite directory through a flag to the testing scripts
...
This will allow us to setup testing that mirrors what we currently have even with the packages moved to github.
R=whesse@google.com
Review URL: https://codereview.chromium.org//527053002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39735 260f80e4-7a28-3924-810f-c04153c831b5
2014-09-02 05:20:34 +00:00
418a550d1c
Add package links for the observatory and enable testing
...
This will make them run on the vm bots, not the pkg bots (I can move them if need be by changing the exclude filter, but I assume you want full vm coverage for this? )
Review URL: https://codereview.chromium.org//455693002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@39021 260f80e4-7a28-3924-810f-c04153c831b5
2014-08-08 07:47:44 +00:00
dae3c92848
test.dart: Handle checkout paths containing spaces.
...
Change TestUtils to correctly convert from a URI to a file path, and
simplify the setting of the path to the Dart checkout.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//282173004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@36299 260f80e4-7a28-3924-810f-c04153c831b5
2014-05-19 14:30:26 +00:00
6be37386e0
Add mobile safari simulator support in the testing scripts
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//262763005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35626 260f80e4-7a28-3924-810f-c04153c831b5
2014-05-01 11:32:08 +00:00
9a9ca47034
Add clear_browser_cache flag to test.dart
...
This can be used by any browser implementation to flush browser specific caches if set
clear_safari_cache is left in as a synonym for now, I will remove if after I update the bots
Review URL: https://chromiumcodereview.appspot.com//252653007
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35477 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-28 09:38:31 +00:00
441bd85c9f
Fix JSON tests, re-enable in all cases - 2nd try
...
R=lrn@google.com
Review URL: https://codereview.chromium.org//212813006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34457 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-26 23:11:40 +00:00
19a5147493
Add a test suite for Try Dart!
...
R=kasperl@google.com , lukechurch@google.com
Review URL: https://codereview.chromium.org//210873002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34360 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-25 14:08:36 +00:00
9c5986c69e
Add back swarm to our tests by adding a samples-dev status file and enabling the path in the test driver
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//146093004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32551 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-11 11:31:44 +00:00
ed59ab7a67
Remove more tests which depend on dartdoc, which has been deleted.
...
Review URL: https://codereview.chromium.org//156903004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32393 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-06 23:41:13 +00:00
c2f12c4da6
Add support for copying coredumps to /tmp
...
This will be used on the bots to be able to archive dumps from unexpectec crashes.
The tools/archive_crash.py tool will be used to actually archive the dumps to gcs and delete the local copies. The reason for the split is to enable developers to actually utilize this locally as well (run tools/test.py in a loop but don't archive the expected crashes). Additionally, this puts the bot specific code in the small python script.
R=whesse@google.com
Review URL: https://codereview.chromium.org//145273024
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32111 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-29 09:41:47 +00:00
54b71bdbe2
Reaply "Use a real package-root for all of our samples (and tests inside a package) instead of buildDir/packages/"
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//133653004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31694 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-10 15:15:37 +00:00
dc24212755
Added PkgBuildTestSuite (aka 'pkgbuild')
...
This CL adds
- support for fetching dependencies via 'pub get' of samples/packages
- support for building applications/samples via 'pub build' (or a custom
build.dart file)
- pkg/pkgbuild.status: Status files for all package checkouts/builds
- the '--use-public-packages' option to test.dart
- the CleanDirectoryCopyCommand, PubCommand, ModifyPubspecYamlCommand commands
The test suite can be executed with:
$ ./tools/test.py -mrelease --use-sdk pkgbuild
$ ./tools/test.py -mrelease --use-sdk --use-public-packages pkgbuild
R=ricow@google.com
Review URL: https://codereview.chromium.org//122443003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@31535 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-07 09:36:27 +00:00
26f065bdb2
Add .test-outcome.log support to test.dart
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//95603002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30768 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-29 08:29:20 +00:00
1d98fa26bb
Only enqueue VmTestSuite on compiler=none,runtime=vm
...
Review URL: https://codereview.chromium.org//91633003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30720 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 15:17:44 +00:00
bb54b776ba
Checked-in binary update to v1.0.0.3
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//91473002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30717 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-27 14:17:44 +00:00
36fe570a31
Remove the --use_browser_controller flag, now that it is always true.
...
Fix an error in r30269.
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//68133017
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@30270 260f80e4-7a28-3924-810f-c04153c831b5
2013-11-14 15:20:31 +00:00
b5373a419a
Run all tests inside an iframe + restrict number of chrome browser processes on mac
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//49043003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29367 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 16:31:18 +00:00
cf822a851a
test.py: Run the analyzer on all dart files in the sdk.
...
BUG=http://dartbug.com/13024
R=ricow@google.com
Review URL: https://codereview.chromium.org//47743005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29362 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 14:45:59 +00:00
94ebff2225
Bugfix in test.dart, adding of specialized test outcomes for analyzer
...
This CL will:
- fix a bug in the legacy AnalyzerCommandOutputImpl class (in certain cases
we did not report that the analyzer was missing a warning).
- make the outcome of running the analyzer on a test be one of:
* CompileTimeError
* MissingCompileTimeError
* StaticWarning
* MissingStaticWarning
- Make status file updates using the new Expectation markers
- Remove support for '@static-clean':
Previously running the analyer on a test could either result in
'Pass' or in 'Fail'. The '@static-clean' annotation has been used
as a (poor) mechanism to distinguish between errors and warnings.
Having the 4 markers mentioned above means we can remove '@static-clean'
- Remove 100 lines of rotted legacy code in our testing scripts.
- Make a status file entry for every test that has analyzer errors or warnings
R=ricow@google.com
Review URL: https://codereview.chromium.org//46163002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29350 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-28 10:39:38 +00:00
5572278a23
Changes to run tests on Dartium content shell on Android.
...
- In browser_controller.dart, adds a drtOnAndroid Browser.
- Adds flags for starting test servers at fixed ports.
- This is needed so that android reverse port forwarding
can be set up in advance.
- Adds setProp to android.dart to be used in lieu of
environment variables when testing on Android.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//29773006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@29259 260f80e4-7a28-3924-810f-c04153c831b5
2013-10-25 16:39:48 +00:00
ba16679d74
Revert revision 27014 "Remove restriction on the number of IE processes running simultainiously"
...
I updated the comment to better reflect what our current status is.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//23556008
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27041 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-03 11:16:23 +00:00
eb5906ef01
Remove dart2js_foreign.
...
R=kustermann@google.com
Review URL: https://codereview.chromium.org//23477028
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27032 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-03 08:41:32 +00:00
bfa2c1d9dd
Remove restriction on the number of IE processes running simultainiously
...
R=kustermann@google.com
Review URL: https://codereview.chromium.org//23437021
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27014 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 14:16:13 +00:00
b0889233cd
test.py: Print the warning about left-over dirs only for directories created using Directory.createTemp()
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//23714002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@27003 260f80e4-7a28-3924-810f-c04153c831b5
2013-09-02 09:29:12 +00:00
7c2d27bb13
Add again the *necessary* timeout markers for tests running on ie9/ie10
...
R=ahe@google.com
Review URL: https://codereview.chromium.org//23830002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26930 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 17:32:42 +00:00
bdb11d93c0
Reduce the number of processes/tests run in parallel by test.dart
...
R=ahe@google.com
Review URL: https://codereview.chromium.org//23436004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26907 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-30 09:34:49 +00:00
b5e9c9546c
Reorganize tests for samples so the test is discoverable from the sample
...
This change gets rid of the legacy "samples/test/samples/samples.status" folder structure. Instead it moves to "samples/samples.status", and each sample's test moves into its "test" folder.
The benefit is less "..", easier to find the test for the sample, matching the structure of "pkg" and reducing levels of nesting. My other motivation is to help fix https://code.google.com/p/dart/issues/detail?id=12865 , and generally make it easier to write tests for the web samples.
R=devoncarew@google.com , sigmund@google.com
Review URL: https://codereview.chromium.org//23717003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26831 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-29 00:25:39 +00:00
45c42e08f2
Update checked-in binary to 0.6.21.3_r26639 (M6)
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//23568002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26704 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-27 11:16:37 +00:00
6b514b1a0c
Remove all remaining references to dartc
...
R=ricow@google.com
BUG=
Review URL: https://codereview.chromium.org//23301004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26338 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-20 06:17:03 +00:00
73826dc6bf
Add support for ie in the browser controller
...
Also, add no caching headers (since IE will cache the task that it gets)
R=kustermann@google.com
Review URL: https://codereview.chromium.org//22420002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@26112 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-14 11:30:48 +00:00
84d4f0bebe
test.py: Print command line when starting http servers in case of '--verbose'
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//22532003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@25862 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-07 08:52:26 +00:00
92303dffda
test.py: First step towards support of caching dart2js compilations across runtimes
...
This CL changes the way we run tests completely: When enqueueing TestCases we
build up a dependency graph of Commands. This has the advantage that if more
TestCases share common commands, we only execute it once.
R=ricow@google.com
Review URL: https://codereview.chromium.org//21001003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@25760 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-05 07:54:17 +00:00
cb18d8ba87
Removed compiler/ directory from repository
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//20722006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@25728 260f80e4-7a28-3924-810f-c04153c831b5
2013-08-02 08:31:15 +00:00
af21d74d2d
Fix safari browser to use Future.value
...
Also correct type errors found by the analyzer.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//18089005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24532 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-27 17:07:17 +00:00
ecb4dea649
Add safari cache clearing browser functionality to the safari browser.
...
Also, add flag to test.dart to enable this feature.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//17489002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24215 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-20 10:30:04 +00:00
756c5de9aa
Remove special casing of number of dart compilation processes on mac.
...
I want to know if this actually has an effect or not.
R=kustermann@google.com
Review URL: https://codereview.chromium.org//17377005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24136 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-18 11:51:37 +00:00
b814373e75
Change number of started browser processes to the max number of browser processes.
...
R=kustermann@google.com
Review URL: https://codereview.chromium.org//17037003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@24094 260f80e4-7a28-3924-810f-c04153c831b5
2013-06-17 12:45:12 +00:00
William Hesse