Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests for XS Node.js bundler parity #2252

Open
Tracked by #400
kriskowal opened this issue Apr 29, 2024 · 0 comments
Open
Tracked by #400

Integration tests for XS Node.js bundler parity #2252

kriskowal opened this issue Apr 29, 2024 · 0 comments

Comments

@kriskowal
Copy link
Member

kriskowal commented Apr 29, 2024

Refs: #400

Establish tests that demonstrate that SES and XS native compartments have parity in integration with the kitchen sink behaviors of Endo/Agoric bundles.

Design

It should be possible to use @endo/compartment-mapper/bundle.js with a new "xs" tag to create a script that entrains a JSON bundle and importBundle with all its dependencies such that xst can run to completion and compare the output against an oracle. In combination with #2250, this will remove Babel from the transitive dependencies of importBundle.

@kriskowal kriskowal changed the title Establish tests that demonstrate that SES and XS native compartments have parity in integration with the kitchen sink behaviors of Endo/Agoric bundles Integration tests for XS Node.js bundler parity Apr 29, 2024
kriskowal added a commit that referenced this issue Jun 4, 2024
Closes: #2295 
Refs: #400, #2252

## Description

This change adds a mode to the `bundle-source` command with the initial
flag `--no-transforms` that generates “endo zip base64” style bundles
without applying the module-to-program transform and SES shim censorship
evasion transforms, such that the original files on disk appear in the
zip file. This is a preparatory step, necessary for building test
artifacts, in advance of full support for this bundle style.

### Security Considerations

`bundle-source` is part of the Endo and Agoric toolkit and it, or its
surrogate, participate in the toolchain for generating content that can
be confined by Hardened JavaScript, but is not trusted by Hardened
JavaScript at runtime. It does however _currently_ run with all the
authority of the developer in their development environment and its
integrity must be carefully guarded.

### Scaling Considerations

No improvements expected at this time, but in pursuit of #400, it may be
possible to move the heavy and performance sensitive JavaScript
transform components from `bundle-source` to `import-bundle` and only
suffer the performance cost of these transforms on Node.js, where those
costs are more readily born by some runtimes. Precompiled bundles may
continue to be the preferred medium for deployment to the web, for
example.

### Documentation Considerations

We will need to advertise the `--no-transforms` flag eventually, since
there will be a period where it is advisable if not necessary to
generate contracts and caplets targeting the XS runtime.

### Testing Considerations

I have included a test that verifies the API behavior and manually run
the following to verify behavior for the CLI:

```sh
rm -rf bundles
yarn bundle-source --no-transforms --cache-json bundles demo/circular/a.js circular-a
rm -rf circular-a
mkdir -p circular-a
jq -r .endoZipBase64 bundles/bundle-circular-a.json | base64 -d > circular-a/circular-a.zip
(cd circular-a; unzip circular-a.zip)
jq . circular-a/compartment-map.json
# verifying the final module entires have parser: 'mjs'
```

### Compatibility Considerations

This flag is opt-in and breaks no prior behaviors. This introduces a new
entry to the build cache meta-data and may cause some bundles to be
regenerated one extra time after upgrading.

### Upgrade Considerations

This should not impact upgrade, though it participates in the greater
#400 story which will require xsnap upgrades to come to bear.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant