Eric Seidel
ed8cea1463
* fix: improve inflate error handling and validate compressed patches Addresses #2989: "pipe reader has been dropped" / "failed to fill whole buffer" errors during patch inflation were masking the real root cause. Three changes: 1. Join the decompression thread and propagate its error as the primary failure, rather than fire-and-forget logging. The patching thread's broken-pipe error is a side-effect, not the cause. Also drop the pipe reader before joining to avoid deadlock when patching fails. 2. Validate the downloaded compressed patch (non-empty, valid zstd magic bytes) before attempting decompression, so corrupt/truncated downloads produce a clear error instead of cryptic pipe errors. 3. Log the download size in download_to_path to help diagnose truncated downloads in the field. * docs: expand comment on drop(fresh_r) to clarify deadlock risk * feat: log app_id, patch number, and version before download * test: add inflate tests for corrupt data and invalid magic * test: cover decompression-error-as-primary-cause path in inflate Uses a valid zstd frame followed by a corrupt second frame so that bipatch::Reader::new succeeds but decompression fails midway, verifying that the decompression error is reported as the primary cause.
Updater library
This is the Rust side of the Shorebird code push system. This is built
in Rust with a C API for easy calling from other languages, most notably
for linking into libflutter.so.
The primary modification Shorebird makes to the stock Flutter engine is adding support for the updater library (this repo). The updater library is written in Rust and is used to update the code running in the Flutter app. The updater library is built as a static library and is linked into the Flutter engine during build time.
Parts
library: Runtime library linked into Flutter Engine to unpack and apply updates. Build into libupdater.a and linked into libflutter.so.patch: Developer tooling to package Shorebird updates ("patches"). Built intopatch.exeand downloaded and run byshorebirdcommand line tool: https://github.com/shorebirdtech/shorebird/tree/main/packages/shorebird_cli.shorebird_code_push: The Dart bindings for communicating with the updater library from within a Flutter app. Published to pub.dev, usage is optional by developers.
Most interesting code is in the library directory. There is also
a README.md in that directory explaining the design.
Developing
It's best to edit this repository from within an engine checkout. See BUILDING_ENGINE.md for instructions on how to set up an engine checkout.
The workflow I use involves 2 to 3 VSC windows:
- Opening the engine
src.
In that terminal I:
cd third_party/updater
- To build the updater as part of the engine:
cargo ndk --target aarch64-linux-android build --release && \
ninja -C ../../out/android_release_arm64 && say "done"
The cargo part should not be needed, but I haven't yet done the work to integrate the Rust code into the gn files for the Flutter engine yet.
I add say "done" to the end as linking can take several minutes for release
Android builds.
-
In a second window, I open
code third_party/updater. I do this because otherwise therust_analyzercan't seem to find the rust code. We could fix this by adding the directory to the VSC workspace, but I'm not sure where we would put the workspace file in the first place.srcis actuallyshorebirdtech/buildrootand is controlled viagclientbyshorebirdtech/engine/DEPS. -
In a third window I open my test app. e.g.:
flutter create test_app
cd test_app
shorebird init
shorebird release
code .
- To run the test app with my local engine I use:
shorebird run --local-engine-src-path $HOME/Documents/GitHub/engine/src \
--local-engine android_release_arm64
You may also need to build out/host_release once as flutter build looks for
some Dart .dill files in host_release.
Coverage
We'd like to get to 100% coverage but aren't there yet.
https://github.com/taiki-e/cargo-llvm-cov is the best tool I've found for generating coverage reports.
Install: https://github.com/taiki-e/cargo-llvm-cov#installation
cargo llvm-cov will then generate the report.