9a9ca47034
Add clear_browser_cache flag to test.dart
...
This can be used by any browser implementation to flush browser specific caches if set
clear_safari_cache is left in as a synonym for now, I will remove if after I update the bots
Review URL: https://chromiumcodereview.appspot.com//252653007
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35477 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-28 09:38:31 +00:00
6886c3f350
Add default selector exclution flag to test.dart
...
This can be used like this:
tools/test.py -mrelease --exclude-suite=co19,pkg
to run the default selector tests but not run pkg and co19 tests.
Why am I doing this:
We want to keep broad testing on developer machines, but want to allow testing resources to have a better and more logic distribution on the bots, e.g., not run pkg tests on the vm bots.
R=whesse@google.com
Review URL: https://codereview.chromium.org//256703003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35424 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-25 14:42:33 +00:00
9bb09add29
Reduce memory usage of test.dart: canonicalize Set<Expectation>
...
BUG=dartbug.com/18084
R=kustermann@google.com
Review URL: https://codereview.chromium.org//258523006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35375 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-24 15:42:17 +00:00
afbf758380
Reduce test.dart memory usage
...
BUG=dartbug.com/18084
R=ricow@google.com
Review URL: https://codereview.chromium.org//247223009
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35365 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-24 11:09:49 +00:00
bede5d4373
Reduce test.dart memory usage.
...
BUG=dartbug.com/18084
R=ricow@google.com
Review URL: https://codereview.chromium.org//234673003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35313 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-23 15:07:47 +00:00
4faa800a5c
Remove obsolete "interop.js" from browser test scripts.
...
BUG=dartbug.com/17661
R=ricow@google.com
Review URL: https://codereview.chromium.org//246443005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35248 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-22 08:00:10 +00:00
d8a23ea25a
"Reverting 35157"
...
BUG=
R=blois@google.com
Review URL: https://codereview.chromium.org//243253002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35211 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-21 17:51:42 +00:00
b5ffc1968e
Fix Browser Controller to not reuse iFrames, which can sometimes cause bad state to be left between tests.
...
BUG=
R=jmesserly@google.com
Review URL: https://codereview.chromium.org//241783003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35157 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-17 22:56:05 +00:00
b2a55b4309
Avoid exceptions when analyzing truncated test output.
...
r34867 introduced a mechanism to truncate excessively long test
output. Since the truncation may happen in the middle of a line, we
need to be tolerant of mal-formed lines when analyzing the test
output.
R=kustermann@google.com , whesse@google.com
Review URL: https://codereview.chromium.org//236313005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35063 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-15 15:49:36 +00:00
48b4b4550f
Reduce test.dart memory usage.
...
BUG=18084
R=kustermann@google.com
Review URL: https://codereview.chromium.org//239003002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@35058 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-15 12:50:46 +00:00
052d61b1da
Truncate excessively long output from tests in test.dart.
...
BUG=dartbug.com/18084
R=kustermann@google.com
Review URL: https://codereview.chromium.org//227113010
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34867 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-09 10:38:28 +00:00
5c363f6831
Include PUB_CACHE when invoking build.dart too.
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//229183002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34843 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-08 21:09:37 +00:00
55546df84a
Update co19 test suite to r706
...
R=kustermann@google.com
Review URL: https://codereview.chromium.org//225403020
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34826 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-08 14:48:59 +00:00
9139d46d39
test.dart: Enable shortening of shorter generated test paths on Windows.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//226543004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34780 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-07 15:28:47 +00:00
25c05ba8ea
test.dart: Shorten long paths for generated test files on Windows.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//225863004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34778 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-07 14:47:30 +00:00
8fb7ab6c74
test.dart: Add timeout for browsers that are started but do not fetch tests.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//218683009
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34701 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-03 12:35:22 +00:00
d3305f559c
Don't send csp flag to polymer build step
...
Filed issue 18011 to track removing unneccesary stuff from polymer pkg
R=johnniwinther@google.com
Review URL: https://codereview.chromium.org//223403004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34686 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-03 08:54:55 +00:00
2fe51715e5
Begins work on ARM64, first assembler test.
...
Most new code is in constants_arm64.h and
{assembler,disassembler,simulator}_arm64.{h,cc}
The rest of the CL just #def's out tests, modifies status files,
and adds UNIMPLEMENTED functions, etc.
R=regis@google.com
Review URL: https://codereview.chromium.org//221133002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34654 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-02 17:39:32 +00:00
e14b9b8c57
Prevent test.dart warning "TestCase would be finished twice"
...
BUG=
R=ricow@google.com , whesse@google.com
Review URL: https://codereview.chromium.org//220243011
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34638 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-02 08:04:31 +00:00
cf376bee12
Deprecate automatic generation of precompiled.js.
...
RELNOTES=Deprecate automatic generation of precompiled.js from dart2js.
R=floitsch@google.com , ricow@google.com
Review URL: https://codereview.chromium.org//219053003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34637 260f80e4-7a28-3924-810f-c04153c831b5
2014-04-02 05:59:48 +00:00
8cb301d6c1
Added TodoMVC startup benchmarks.
...
R=jmesserly@google.com
Review URL: https://codereview.chromium.org//204733004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34561 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-31 17:09:00 +00:00
56eccbca88
test_options tweak post json fix
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//213203007
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34560 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-31 16:14:20 +00:00
d5780f88b9
Rollback 215463002.
...
R=brianwilkerson@google.com , ricow@google.com
BUG=
Review URL: https://codereview.chromium.org//215683002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34491 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-27 23:57:32 +00:00
5a9afd5f64
Move Dart-based analyzer script to packages.
...
Rico, can you please change the performance tool to use this pkg/analyzer/bin/analyzer script?
R=brianwilkerson@google.com , ricow@google.com
BUG=
Review URL: https://codereview.chromium.org//215463002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34483 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-27 21:38:35 +00:00
5578cc0ce0
Revert co19 roll (revert r34468)
...
Some path names of generated files for new co19 tests are longer than the Windows pathname limit of 254 characters.
R=ricow@google.com
Review URL: https://codereview.chromium.org//213473009
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34471 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-27 13:25:35 +00:00
412fb33dac
Update co19 test suite to r706
...
BUG=dartbug.com/17758
R=kustermann@google.com
Review URL: https://codereview.chromium.org//211383002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34468 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-27 12:14:00 +00:00
1692a15f4e
Add 'static type error' tags to multitests.
...
BUG=http://dartbug.com/16411
R=ricow@google.com
Review URL: https://codereview.chromium.org//150223002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34412 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-26 09:03:47 +00:00
425792636f
Fix a null error on empty suites.
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//211103005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34365 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-25 15:02:43 +00:00
618140cd95
Get the correct version of ie from the reg database
...
version is 9.0.FOO.BAR on ie9
9.10.XFOO.XBAR on ie10
9.11.ZFOO.ZBAR on ie11
svcVersion is a more sane number, i.e., on ie10 it is 10.0.9200.16843 (atm) and on ie11 it is 11.0.9600.16521 (atm)
R=whesse@google.com
Review URL: https://codereview.chromium.org//210783004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34355 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-25 12:47:59 +00:00
ccdfcc90aa
Add a generic ie marker that we can use in the status files
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//210893002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34354 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-25 12:47:51 +00:00
ffb5397a8b
Add default location for ie11
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//208653011
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34350 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-25 09:14:32 +00:00
6e6bc22e12
Add support for ie11 in our testing scripts
...
We explicitly need this since we need to be able to distinguesh between the
different versions in the status files. We could generalize this by having browser groups for everything but the actual status file parsing.
Review URL: https://codereview.chromium.org//206623010
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@34349 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-25 08:51:53 +00:00
4a396e2e7b
Fix type error in test.dart.
...
BUG=
R=kustermann@google.com
Review URL: https://codereview.chromium.org//197963004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33688 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-14 10:00:51 +00:00
7205c233b0
Package-ify Dromaeo and browser controller functionality
...
R=vsm@google.com
Review URL: https://codereview.chromium.org//199003005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33670 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-13 22:43:53 +00:00
74f7b29b55
Enable cross compiled outputs in the testing scripts
...
R=whesse@google.com
Review URL: https://codereview.chromium.org//196213005
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33650 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-13 12:04:50 +00:00
5c16460e3d
Reapply "Dart2js testing: Add prefix files when running dart2js output on d8 or jsshell.""
...
This reapplies r33369. A git dependency was missing, meaning the sdk was not rebuilt, even though we add two .js files to it.
BUG=
R=ahe@google.com
Review URL: https://codereview.chromium.org//183743032
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33378 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-06 15:08:43 +00:00
72b0b89102
Allow empty messages coming from the iframe to the driving page
...
R=ricow@google.com
Review URL: https://codereview.chromium.org//188543003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33377 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-06 14:29:55 +00:00
ff10fe3cdb
Revert "Dart2js testing: Add prefix files when running dart2js output on d8 or jsshell."
...
This reverts r33369. A relative path is failing.
BUG=
R=ahe@google.com
Review URL: https://codereview.chromium.org//176883023
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33372 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-06 13:32:05 +00:00
8cc9739e4c
Dart2js testing: Add prefix files when running dart2js output on d8 or jsshell.
...
BUG=
R=ahe@google.com , kustermann@google.com
Review URL: https://codereview.chromium.org//187843002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33369 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-06 12:38:15 +00:00
7e29f42833
Change tests to use test.py's test_controller.js, cleanup in browser_controller
...
This change makes all remaining tests use test.py's test_controller.js:
We have our own way of testing using test.py and that might change any time.
It's therefore not wise to rely on functionality in the unittest framework. If
we kept test_controller.js in the unittest package, we'd need to make a breaking
change whenever we change the behavior of test_controller.js. So this file was
forked into tools/testing/dart/test_controller.js.
After this, all our tests will use tools/testing/dart/test_controller.js. It is
therefore no longer necessary for the browser_controller to support the old
mechanism of posting back results. By removing this legacy code, we can ensure,
that the driving page of browser_controller will only react on valid messages
which were ment for it.
Context:
Some tests (e.g. dromaeo) might use postMessage internally, maybe even for
testing that postMessage is working. But the driving window should only react
on valid messages ment for it, ignoring any other messages.
R=blois@google.com , efortuna@google.com , ricow@google.com , whesse@google.com
Review URL: https://codereview.chromium.org//177333004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33365 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-06 10:37:53 +00:00
ea45e766df
Make _TestOptionSpecification take a named argument.
...
I want to refactor test_options.dart so that variable expansions, such as, "all" -> "debug,release" are generalized. So I want to add another named argument to _TestOptionSpecification in the next CL.
R=whesse@google.com
Review URL: https://codereview.chromium.org//185463004
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33207 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-03 11:46:27 +00:00
14230c1c33
Refactor compiler and runtime configurations (command line tools command building).
...
R=kustermann@google.com
Review URL: https://codereview.chromium.org//179173003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33197 260f80e4-7a28-3924-810f-c04153c831b5
2014-03-03 07:05:20 +00:00
9d53b1d682
Replace run_selenium.py with Dart script that uses the browser controller for performance tests.
...
BUG=
R=kustermann@google.com , ricow@google.com , vsm@google.com
Review URL: https://codereview.chromium.org//178223008
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@33171 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-28 21:06:28 +00:00
61a5ff28fe
Fixes for the test framework multitests.
...
Allow imports with a metadata annotation.
Allow test keys to be alphanumeric instead of just two digits.
R=floitsch@google.com , whesse@google.com
Committed: https://code.google.com/p/dart/source/detail?r=32892
Was reverted in Issue 175113002, commit r32894.
Review URL: https://codereview.chromium.org//164333013
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32956 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-24 10:13:42 +00:00
8e65452aa9
Revert "Fixes for the test framework multitests."
...
This reverts commit r32892.
Review URL: https://codereview.chromium.org//175113002
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32894 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-21 12:54:11 +00:00
48b2d4f50b
Fixes for the test framework multitests.
...
Allow imports with a metadata annotation.
Allow test keys to be alphanumeric instead of just two digits.
R=whesse@google.com
Review URL: https://codereview.chromium.org//164333013
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32892 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-21 12:41:49 +00:00
19e74c6272
Added tools/status_clean.dart script
...
This script supports two commands:
deflake:
This command will go through all status file entries and check if the actual
testoutcomes we've observed on our buildbots match the status file entries.
If we have tests marked as flaky which are in fact not flaky, it will write
a *.status.deflaked file which contains the fixes to the status file.
fix:
This command will go through all status files and ensures that all the
status file lines correspond to existing tests.
If we have lines that refer to non-existent tests, it will write a
*.status.fixed file which contains the fixes to the status file.
R=whesse@google.com
Review URL: https://codereview.chromium.org//143453012
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32694 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-14 12:21:37 +00:00
0b1fee8131
Let deferred load work from worker isolates.
...
If we try to load a deferred library from a worker-isolate we cannot
inject a script tag because we do not have access to the dom. Instead we
make an XMLHttpRequest object and load the code with that.
I tried to take some care of error handling introducing a new exception.
R=floitsch@google.com
Review URL: https://codereview.chromium.org//163733003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32693 260f80e4-7a28-3924-810f-c04153c831b5
2014-02-14 12:12:58 +00:00
fdc6d43083
Improve how we handle packages/ HTML imports. This improves resolution of URLs containing
...
"package/" under the web/ directory. Resolution under 'lib' is the same, but it and gives better suggestions if the path looks wrong. This summarizes what changed:
- source file: lib/b.html
import to "packages/c/d.html" was error, now is error + suggestion
import to "../packages/c/d.html" was error, now is error + suggestion
import to "../../packages/c/d.html" was resolved, now is resolved too
- source file: lib/a/b.html
import to "packages/c/d.html" was error, now is error + suggestion
import to "../packages/c/d.html" was error, now is error + suggestion
import to "../../packages/c/d.html" was error, now is error + suggestion
import to "../../../packages/c/d.html" was resolved, now is resolved too
- source file: web/b.html
import to "packages/c/d.html" was and continues to be resolved
import to "../packages/c/d.html" was error, now is resolved
- source file: web/a/b.html
import to "packages/c/d.html" was error, now is resolved
import to "../packages/c/d.html" was and continues to be resolved
import to "../../packages/c/d.html" was and continues to be resolved
Note: polymer-build and development mode are slightly different: polymer-build
detects and issues an error for bad paths inside lib/. These are not detected by
our package-resolution in loader.dart, but as long as users are not creating
symlinks by hand, Dartium should detect if the paths are wrong.
When we switch to start using pub-serve by default, we should be able to go back
to the web-ui style of using "package:" urls directly in HTML.
R=jmesserly@google.com , kustermann@google.com
Review URL: https://codereview.chromium.org//148913003
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32170 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-30 20:51:28 +00:00
0306e06b5f
Allow copy_coredumps flag on all platforms.
...
This will have not effect on winodws/mac yet, since the core file will not be there.
Don't try to archive on non linux platforms
I will apply this flag on all vm bots - setting this up on system basis is harder, and this is a no-op on mac/windows
R=ajohnsen@google.com
Review URL: https://codereview.chromium.org//148283006
git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@32117 260f80e4-7a28-3924-810f-c04153c831b5
2014-01-29 11:45:36 +00:00
ricow@google.com