- Move expression evaluation to ddc in preparation for google3 - Added server to ddc to handle update and compileExpression requests - Added tests - Added 'experimental-output-compiled-kernel' option to ddc to generate full kernel files only for compiled libraries, and store with '.full.dill' extension - Added AssetFileSystem to communicate to the asset server in the debugger - Made expression_compiler_worker work with full kernel files, so removed invalidation of current file to improve performance - Made expression_compiler_worker reuse already loaded imports to avoid reading them from source in the incremental compiler - Updated tests to work with DDC (for simulating webdev) - Disabled tests that work with bazel kernel worker for now as it does not generate full dill files yet - Addressed code review comments from the prototype version: https://dart-review.googlesource.com/c/sdk/+/157005 Details: Currently, in flutter tools, expression evaluation is supported via expression compilation, which is done by the incremental compiler in the frontend server. The same incremental compiler is used for initial application compilation, incremental code compilation for hot reload, and any number of expression compilation requests. In google3, the apps are typically too large to be compiled as a whole in memory by the frontend server. Build in google3 is currently done by blaze, as a distributed build using a task dependency graph. Build tasks output kernel outline files as an interface between components produced by individual tasks. We are proposing an implementation of the expression compilation in google3 that is taking advantage of full kernel files produced by the build (supporting build changes to follow). This change introduces a small server based on dev_compiler, which can handle following requests: - update: load full kernel for given modules (done on app start) - compileExpression: compile expression in a given library and module (done when paused on a breakpoint) Expression compilation uses previously loaded kernel files for the application component and its dependencies to compile an expression. Change-Id: Icf73868069faf3a2eb6d43ba78e459f8457e9e35 Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/160944 Reviewed-by: Nicholas Shahan <nshahan@google.com> Reviewed-by: Gary Roumanis <grouma@google.com> Reviewed-by: Jens Johansen <jensj@google.com> Reviewed-by: Jake Macdonald <jakemac@google.com> Commit-Queue: Anna Gringauze <annagrin@google.com>
The Dart Dev Compiler (DDC) is a fast, modular compiler that generates modern JavaScript (EcmaScript 6). Its primary use today is to support fast, iterative development of Dart web applications for Chrome and other modern browsers.
Soundness and Restrictions
DDC is built upon Dart's sound type system. It only compiles programs that statically type check (i.e., no strong mode errors). It leverages static type checking to generate simpler, readable, and more idiomatic code with fewer runtime checks. In general, DDC is able to provide stronger type guarantees - i.e., soundness - than traditional Dart checked mode with significantly fewer runtime checks.
With strong mode, DDC is stricter than traditional Dart production mode or checked mode. Running existing Dart code on DDC will generally require fixing both static and runtime type errors.
For example, although the following snippet will run in production or checked mode, it will fail to compile with DDC:
var list = ["hello", "world"]; // Inferred as List<String> in strong mode
List<int> list2 = list; // Static type error: incompatible types
On the other hand, the following snippet - which tries to mask the type error via casts - will compile with DDC, but fail with a runtime type error.
var list = ["hello", "world"];
List<Object> list2 = list; // Generics are covariant. No runtime check required.
List<int> list3 = list2; // Implicit runtime downcast triggers error.
Modularity
DDC provides fast, incremental compilation based on standard JavaScript modules. Unlike Dart2JS, DDC does not require an entire Dart application. Instead, it operates modularly: it compiles a set of Dart files into a JavaScript module. A DDC compilation step requires a set of input Dart files and a set of summaries of dependencies. It performs modular type checking as part of this compilation step, and, if the input type checks, it generates a JavaScript module (e.g., ES6, AMD, or CommonJS). The browser (i.e., the JavaScript runtime) loads and links the generated modules when running the application. During development, a compilation step only needs to be rerun if the Dart files or summaries it relies upon change. For most changes, only a very small part of your code will require recompilation. Moreover, modules that are unchanged can be cached in the browser.
EcmaScript 6
DDC attempts to map Dart to idiomatic EcmaScript 6 (ES6) as cleanly as possible, and it relies heavily on static typing to do this. In general, where Dart concepts map directly to ES6, DDC generates code accordingly. For example, Dart classes are mapped to ES6 classes, Dart fields to ES6 properties, Dart getters/setters to ES6 getters/setters, Dart methods to ES6 methods, and so on. In most cases, names are preserved and calling conventions are natural JavaScript ones.
There are some import caveats where Dart concepts do not map directly:
- Libraries. Multiple Dart libraries are mapped to a single JS module. Each library appears as a first class object in the generated JS module, with its top-level symbols as members. We currently use a heuristic (based upon file paths) to ensure unique naming of generated library objects.
- Generics. Dart generics are reified, i.e., they are preserved at runtime. Generic classes are mapped to factories that, given one or more type parameters, return an actual ES6 class (e.g.,
HashMap$(core.String, core.int)produces a class that represents a HashMap from strings to ints). Similarly, generic methods are mapped to factories that, given one or more type parameters, return a method. - Dynamic. DDC supports dynamically typed code (i.e., Dart's
dynamictype), but it will typically generate less readable and less efficient ES6 output as many type checks must be deferred to runtime. All dynamic operations are invoked via runtime helper code. - Constructors. Dart supports multiple, named and factory constructors for a given class with a different initialization order for fields. Today, these are mapped to instance or static methods on the generated ES6 class.
- Private members. Dart maps private members (e.g., private fields or methods) to ES6 symbols. For example,
a._xmay map toa[_x]where_xis a symbol only defined in the scope of the generated library. - Scoping. Dart scoping rules and reserved words are slightly different than JavaScript. While we try to preserve names wherever possible, in certain cases, we are required to rename.
In general, the current conventions (i.e., the Application Binary Interface or ABI in compiler terminology) should not be considered stable. We reserve the right to change these in the future.
Browser support
DDC currently supports Chrome stable (though users have had success running on FireFox and Safari). In the near future, we expect to target all common modern browsers that support ES6. ES6 itself is in active development across all modern browsers, but at advanced stages of support: