Commit Graph

1689 Commits

Author SHA1 Message Date
zra@google.com 86bfd7cb30 Adds a simarmv5te build and test target.
Also:
- Removes command line flags to choose simulated arm version.
  I think we should use build targets instead, like in this change,
  to make building and testing more obvious.
- Skips pkg tests on all simulators.

R=regis@google.com, ricow@google.com

Review URL: https://codereview.chromium.org//1077823002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@45181 260f80e4-7a28-3924-810f-c04153c831b5
2015-04-15 20:44:43 +00:00
ricow@google.com 8f302fbf34 Add a --cps-ir flag to the testing script to allow us to run with the new cps based backend in dart2js
R=whesse@google.com, karlklose@google.com
BUG=

Review URL: https://codereview.chromium.org//1085803002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@45136 260f80e4-7a28-3924-810f-c04153c831b5
2015-04-14 12:33:46 +00:00
johnmccutchan@google.com 647c355f8c Relocate service library tests and hookup a working status file
BUG=

Review URL: https://codereview.chromium.org//1071363002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@45043 260f80e4-7a28-3924-810f-c04153c831b5
2015-04-09 22:57:59 +00:00
johnmccutchan@google.com cef8aa3a34 Enable observatory tests by default
BUG=
R=turnidge@google.com

Review URL: https://codereview.chromium.org//1075013002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@45039 260f80e4-7a28-3924-810f-c04153c831b5
2015-04-09 21:43:28 +00:00
zra@google.com f6028da01d Fixes bug in typed data read/write for floats and doubles.
When reading from a byte array as floats or doubles, perform the
endianness correction before converting to a float or double
rather than the other way around. This is to avoid floating
point canonicalization changing the bytes before we put them
in the right order.

Unrelatedly, this change also adds armv5te as an architecture
needing extra time for tests to correct an oversight in my
last CL.

R=iposva@google.com

Review URL: https://codereview.chromium.org//1059493002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44871 260f80e4-7a28-3924-810f-c04153c831b5
2015-04-02 20:22:39 +00:00
zra@google.com 34044a4ca8 Adds armv5 build and test target.
R=regis@google.com

Review URL: https://codereview.chromium.org//1043263002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44828 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-31 23:11:33 +00:00
turnidge@google.com 57bf6c53a1 Turn off observatory tests.
BUG=

Review URL: https://codereview.chromium.org//1042523003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44753 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-27 18:41:30 +00:00
turnidge@google.com caea4d0ce2 Turn on observatory tests
BUG=

Review URL: https://codereview.chromium.org//1036383002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44747 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-27 17:38:59 +00:00
turnidge@google.com b577beaafc Turn off observatory tests
BUG=
R=johnmccutchan@google.com

Review URL: https://codereview.chromium.org//1038913005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44716 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-26 18:16:04 +00:00
turnidge@google.com 4ac382e0d4 Make sure Observatory tests run for each commit. Fix broken tests.
BUG=
R=johnmccutchan@google.com

Review URL: https://codereview.chromium.org//1031393003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44714 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-26 17:35:48 +00:00
rmacnak@google.com fbc6b005a4 Support percent encoded data URIs in the standalone embedder.
BUG=
R=iposva@google.com

Review URL: https://codereview.chromium.org//1028453002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44609 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-20 20:11:53 +00:00
lrn@google.com 2b908ad153 Change Multitest files to preserve line numbers.
Instead of omitting multi-test parts that is not part of the current file,
an empty line is inserted instead.

Also move the "generated file, don't edit" warning line to the end of the file.

R=whesse@google.com

Review URL: https://codereview.chromium.org//1026693002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44604 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-20 13:34:43 +00:00
floitsch@google.com fea7ca3d16 dart2js: fix csp mode when minifying.
R=ricow@google.com

Review URL: https://codereview.chromium.org//1000043003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44453 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-13 10:01:58 +00:00
ricow@google.com 5172de7370 Change testing script notification line kustermann->whesse
BUG=
R=whesse@google.com

Review URL: https://codereview.chromium.org//991223002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44366 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-10 12:04:51 +00:00
whesse@google.com 5ef44eeb0a Fix new HTML test type when using dart2dart compiler.
BUG=http://dartbug.com/16603
R=ricow@google.com

Review URL: https://codereview.chromium.org//977383002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44281 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-06 09:44:19 +00:00
kevmoo@google.com 3f2addecd7 fix status_reporter
R=ricow@google.com

Review URL: https://codereview.chromium.org//974973002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44186 260f80e4-7a28-3924-810f-c04153c831b5
2015-03-03 18:08:26 +00:00
kevmoo@google.com 6041043793 Add a --simple flag to status_reporter to allow a fast build covering important configurations
R=ricow@google.com

Review URL: https://codereview.chromium.org//948113003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44087 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-27 12:08:40 +00:00
ricow@google.com f39e0b392a Move dart_style to third_party/pkg_tested
Start testing packages in third_party/pkg_tested

R=rnystrom@google.com

Review URL: https://codereview.chromium.org//955413004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44064 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-26 18:12:48 +00:00
ricow@google.com d6e6b50a64 Allow uri in deepJsonCompare
R=sgjesse@google.com, whesse@google.com
BUG=

Review URL: https://codereview.chromium.org//957253002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@44043 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-26 09:29:30 +00:00
nweiz@google.com c8de060c54 Revert "Revert "Use native async/await support in pub.""
The VM now fully supports all the weird async stuff pub is doing, and all the
tests pass with native async/await!

Previous CLs were r43484 and r43483.

R=rnystrom@google.com

Review URL: https://codereview.chromium.org//937243002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43897 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-19 22:28:54 +00:00
koda@google.com 952a4124fe Include environment overrides when building repro command.
This is important since flags to the Dart VM are passed through an environment variable.

R=whesse@google.com

Review URL: https://codereview.chromium.org//909603003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43765 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-13 15:41:05 +00:00
ricow@google.com 0c21c996db Add SkipSlow marker
This is to be used temporarily until we can start running slow tests on seperate bots.

R=whesse@google.com, kevmoo@google.com
BUG=22402

Review URL: https://codereview.chromium.org//924793002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43751 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-13 10:02:30 +00:00
ricow@google.com 37f9165c0b Revert "Remove test retrying for Safari, in test scripts."
TBR=whesse@google.com
BUG=

Review URL: https://codereview.chromium.org//902083004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43542 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-06 06:44:08 +00:00
ricow@google.com 10595e509d Make standalone tests not dependent on current working directory.
This also simplifies DartOptions - could we simply remove it, the only usage is the arguments test which could simply call the vm on another file, and validate the output?

R=iposva@google.com, sgjesse@google.com
BUG=

Review URL: https://codereview.chromium.org//899243002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43511 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-05 16:29:39 +00:00
iposva@google.com c859d25679 - Return exit code 253 in case of API errors during loading. This
will trigger for example when loading outdated snapshots.

R=ricow@google.com

Review URL: https://codereview.chromium.org//899523005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43505 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-05 14:30:24 +00:00
whesse@google.com 1c8158500c Remove test retrying for Safari, in test scripts.
BUG=dartbug.com/21434
R=ricow@google.com

Review URL: https://codereview.chromium.org//884073003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43503 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-05 13:05:47 +00:00
nweiz@google.com bbe0d9325c Revert "Use native async/await support in pub."
This caused SDK compilation issues that may have obscured pub test failures as
well.

R=rnystrom@google.com

Review URL: https://codereview.chromium.org//887223007

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43484 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-04 21:15:44 +00:00
nweiz@google.com 1835c63d0a Use native async/await support in pub.
R=rnystrom@google.com

Review URL: https://codereview.chromium.org//896623005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43483 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-04 20:45:49 +00:00
whesse@google.com e39f5e5ab0 Cache a computed directory in test_suite.dart.
BUG=dartbug.com/22221
R=ricow@google.com

Review URL: https://codereview.chromium.org//877403003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43402 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-03 15:29:24 +00:00
whesse@google.com 3103024ab2 Fix bad code in test_suite.dart
BUG=dartbug.com/22221
R=ricow@google.com

Review URL: https://codereview.chromium.org//900443004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43390 260f80e4-7a28-3924-810f-c04153c831b5
2015-02-03 12:04:47 +00:00
whesse@google.com 8257b1874e Restart ie11 browser while running tests. Update status files.
BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//888013002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43329 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-30 10:33:07 +00:00
whesse@google.com 5406811398 Restart IE 10 browser as we do with Android browsers on buildbot, to improve stability
BUG=22203

Review URL: https://codereview.chromium.org//867083003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43294 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-29 16:24:00 +00:00
kevmoo@google.com 24cac2a7f6 cleanup to status_reporter
Infer build architectures from combinations
Print build command
Fix comments

R=ricow@google.com

Review URL: https://codereview.chromium.org//860723002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43016 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-20 16:49:03 +00:00
whesse@google.com 014a89563a Add debug logging for android testing.
BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//863663002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@43005 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-20 11:39:09 +00:00
whesse@google.com 247ff772d6 Update status files, replace "dartbug.com" with "Issue ".
BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//845793004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42900 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-15 10:27:11 +00:00
whesse@google.com 5bba992965 Enable co19 dart2js browser tests on content shell (drt).
Update co19 status files for Firefox update to 35, and other flakes.

TBR=ricow@google.com

Review URL: https://codereview.chromium.org//847393002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42873 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-14 15:56:28 +00:00
kevmoo@google.com 9df5e56e9f tools: fix break in test_progress
TBR

Review URL: https://codereview.chromium.org//829803005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42832 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-13 19:46:24 +00:00
kevmoo@google.com 3fdea4f366 Outputing comma-separated report with percentages
Merged:

http://crrev.com/832583003
http://crrev.com/843553004

R=ricow@google.com

Review URL: https://codereview.chromium.org//847873004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42831 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-13 19:27:47 +00:00
kevmoo@google.com 8cd05a8b90 tools: Refactored SummaryReport and move it to its own library
R=ricow@google.com

Review URL: https://codereview.chromium.org//832583003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42826 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-13 17:46:52 +00:00
ricow@google.com 4598291567 Add info about which command line was used to start a browser.
This will help us if we see hanging browsers.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//790793009

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42728 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-09 10:46:40 +00:00
ricow@google.com b9a61a835a Allow for reporting with the --list option
Also, be better at catagorizing tests and have a category for tests that we don't know.

R=whesse@google.com

Review URL: https://codereview.chromium.org//846433002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42695 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-08 15:23:55 +00:00
johnmccutchan@google.com 261200c587 Build Observatory as part of runtime
Relanding https://codereview.chromium.org/810623005/

Review URL: https://codereview.chromium.org//837723004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42645 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-06 21:59:42 +00:00
whesse@google.com aa5a986d5d Revert "Build Observatory with runtime"
This reverts commit 76df7b3c1bf83c08d3994d61df4c9c530fadb4e5.
This commit breaks dartium compilation.

BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//839543002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42619 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-06 10:07:58 +00:00
johnmccutchan@google.com 9d6ac72b46 1) Remove prebuilt Observatory sources
2) Move observatory from runtime/bin/vmservice/observatory to runtime/observatory

3) Add two tools scripts:
- tools/run_pub.py (runs pub before SDK is built)
- tools/obs_tool.py (helper for get, build, and deploy stages)

4) Build Observatory with runtime:
- pub get --offline
- pub build
- deploy

5) Build artifacts are now in standard output directory, for example, out/DebugIA32/observatory.

6) Add a new 'dart_boostrap' host target (no snapshot, no observatory) that can be used as the Dart executable to run pub when building Observatory. This is behind a build.py flag --use-bootstrap-for-observatory because:

- It is only necessary on older Linux distributions that are incompatible with the prebuilt Dart testing executable.
- running pub build with the boostrap Debug build is significantly slower.

7) Detect if the prebuilt executable doesn't work and automatically switch to the 'dart_bootstrap' executable. Also, warn the user and provide a Wiki link with more information.

R=turnidge@google.com

Review URL: https://codereview.chromium.org//810623005

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42614 260f80e4-7a28-3924-810f-c04153c831b5
2015-01-05 21:26:52 +00:00
ricow@google.com 84669b632d Report the correct number of tests when tests are skipped due to compile time errors.
The current setup will count tests that are skipped when runtime is a browser due to compile time errors twice. Example:
tools/test.py -mrelease -rdrt -cdart2js --report language/bad_override
<snip>
Total: 10 tests
 * 0 tests will be skipped (0 skipped by design)
 * 0 tests are expected to be flaky but not crash
 * 5 tests are expected to pass
 * 0 tests are expected to fail that we won't fix
 * 2 tests are expected to fail that we should fix
 * 0 tests are expected to crash that we should fix
 * 0 tests are allowed to timeout
 * 3 tests are skipped on browsers due to compile-time error

This is a multitest that has 7 tests (including none). 3 of these are giving compile-time errors, 2 of these are failing (as a compile-time error when they should not, but that is not the point), 2 are passing.

This is preparation of a bigger refactoring of the summary reporting, so that I can have sane numbers for validation.

R=kustermann@google.com

Review URL: https://codereview.chromium.org//816703003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42460 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-18 15:15:12 +00:00
ricow@google.com 4723aee28d Retry up to 4 times on safari until we have a resolution for issue 21434
I worry more that people will actually ignore these then retrying it for now.

R=floitsch@google.com

Review URL: https://codereview.chromium.org//807813004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42424 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-17 09:57:11 +00:00
whesse@google.com 5f8aa66fde Rename legacy path library in tools/testing to avoid name collision.
BUG=
R=ricow@google.com

Review URL: https://codereview.chromium.org//756423003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42129 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-05 07:21:47 +00:00
kevmoo@google.com 47de553025 tools/testing: move code into individual libraries
R=ricow@google.com

Review URL: https://codereview.chromium.org//748773004

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42108 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-04 15:32:57 +00:00
kevmoo@google.com 61b056964a tools: removed unused members, tiny cleanup
R=ricow@google.com

Review URL: https://codereview.chromium.org//770633003

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@42106 260f80e4-7a28-3924-810f-c04153c831b5
2014-12-04 13:56:14 +00:00
whesse@google.com 0059ade0dd Add android device id to test output for failing tests.
BUG=
R=kustermann@google.com

Review URL: https://codereview.chromium.org//755263002

git-svn-id: https://dart.googlecode.com/svn/branches/bleeding_edge/dart@41960 260f80e4-7a28-3924-810f-c04153c831b5
2014-11-25 16:11:42 +00:00