#78 Agoric Upgrade 17: Orchestration Enhancements, Validator Node Memory Improvements

:wave: Hello Agoric Validators & BLD Community,

Agoric OpCo engineers have released the agoric-upgrade-17 software upgrade for the agoric-3 chain.

This release brings exciting new features and enhancements to Orchestration and also improvements to reduce the storage and memory footprint required of validator nodes. For Orchestration, it enables developers to create ICA accounts, fund the accounts, and then use ICQ to query the balances. These features build on an important foundation providing developers with an enhanced developer experience when building cross-chain.

The following new features are included in this release:

  • #9890: query support in orchestration flows
  • #10029: orchestration account balance queries
  • #10032: app.toml configuration for vat snapshot and transcript database entry retention
  • #10036: app.toml configuration for vat snapshot and transcript file archiving
  • #9900: reduce contract bundle size

The release contains at least the following fixes:

  • #9961: Remotable/Presence garbage collection edge cases

The full set of changes in this release is also available.

We’ve prepared the following:

Milestone Testing

By running long-lived testnets and using that environment to evaluate software before promoting it to mainnet, validators play a vital role in maintaining a healthy, robust network for the Agoric community. Qualifying or certifying any new software release as production ready requires significant testing, and Agoric OpCo recommends that validators perform the following milestone tests to ensure functionality on Emerynet before launching an on-chain governance proposal on the agoric-3 mainnet.

Note: Ensure that you’re up to date on golang and node versions for this release, and that you’ve upgraded to the latest version of Cosmovisor that supports the upgrade handler. See below for information on Node.js version management.

Milestone tests include:

  • Performing the upgrade on a test node
  • Restarting a validator node
  • Testing state sync
    • Create a state sync snapshot
    • Spinning up a node using state sync
  • Submitting a test proposal (e.g., a chain parameter change)

Creating an Emerynet upgrade proposal:

Please note that the naming conventions have changed and Emerynet and mainnet now uses the same upgrade name. Confirm the commit hash and upgrade name BEFORE submitting a proposal.

# Edit as needed

FROM_WALLET=yourwallet

UPGRADE_HEIGHT="1234-get-blockheight-from-estimator"

# Verify values

UPGRADE_TO="agoric-upgrade-17"

CHAIN_ID="agoric-emerynet-8"

COMMIT_ID=$(git rev-parse HEAD)

ZIP_URL="https://github.com/Agoric/agoric-sdk/archive/${COMMIT_ID}.zip"

CHECKSUM=sha256:$(curl -L "$ZIP_URL" -o- | shasum -a 256 | cut -d' ' -f1)

UPGRADE_INFO="{\"binaries\":{\"any\":\"$ZIP_URL//agoric-sdk-$COMMIT_ID?checksum=$CHECKSUM\"},\"source\":\"$ZIP_URL?checksum=$CHECKSUMchecksum\"}"

agd tx gov submit-proposal software-upgrade $UPGRADE_TO --upgrade-info="$UPGRADE_INFO" --upgrade-height="$UPGRADE_HEIGHT" --title="Upgrade to $UPGRADE_TO" --description="This proposal if voted will upgrade the chain to $UPGRADE_TO" --from=$FROM_WALLET --chain-id=$CHAIN_ID

When the testnet milestones are complete and validators have fully qualified the release on Emerynet, the testnet coordinator should inform Agoric OpCo to promote the release from rc to final and update tags accordingly, then create and submit a similar on-chain proposal to upgrade the agoric-3 chain to agoric-upgrade-17.

Creating a Mainnet upgrade proposal:

Please note that the naming conventions have changed and Emerynet and mainnet will use the same upgrade name. Confirm the commit hash and upgrade name BEFORE submitting a proposal.

# Edit as needed

FROM_WALLET=yourwallet

UPGRADE_HEIGHT="1234-get-blockheight-from-estimator"

# Verify values

UPGRADE_TO="agoric-upgrade-17"

CHAIN_ID="agoric-3"

COMMIT_ID=$(git rev-parse HEAD)

ZIP_URL="[https://github.com/Agoric/agoric-sdk/archive/${COMMIT_ID}.zip](https://github.com/Agoric/agoric-sdk/archive/$%7BCOMMIT_ID%7D.zip)"

CHECKSUM=sha256:$(curl -L "$ZIP_URL" -o- | shasum -a 256 | cut -d' ' -f1)

UPGRADE_INFO="{\"binaries\":{\"any\":\"$ZIP_URL//agoric-sdk-${COMMIT_ID}?checksum=$CHECKSUM\"},\"source\":\"$ZIP_URL?checksum=$CHECKSUM\"}"

agd tx gov submit-proposal software-upgrade $UPGRADE_TO --upgrade-info="$UPGRADE_INFO" --upgrade-height="$UPGRADE_HEIGHT" --title="Upgrade to $UPGRADE_TO" --description="This proposal if voted will upgrade the chain to $UPGRADE_TO" --from=$FROM_WALLET --chain-id=$CHAIN_ID

Note for anyone generating state-sync snapshots or restoring from state-sync

State-sync snapshots now only include minimal data to restore a node, and the new configuration settings will help further reduce requirements of non-archival nodes. However, there may still be continued performance issues related to state-sync. In particular, we’ve observed that on some deployments, the snapshot taking and restoring process can take multiple hours, require about 20GB of temporary free disk space, and 16GB of memory.

Note: the agd snapshots export command has been fixed, and can now be used to generate a snapshot export of the latest application state (while the node is not running). Combined with other snapshots commands and the agd tendermint bootstrap-state command, this can be used to restore a node (state-sync pruning) without having to connect the node to the p2p network.

Note for managing Node.js versions

We recommend avoiding using nvm or similar tools to manage the Node.js version, and instead rely on a package installed globally through the system package manager. Tools like nvm only affect the current shell session, and unless care is taken to configure the agd service environment to also use nvm with the same Node.js version, there is a risk that the Node.js version used when building may be different than the one when running the service, resulting in errors when trying to start the service. We are looking at ways to simplify this dependency management requirement specific to the Agoric chain.

Note for anyone running archive nodes

This release introduces config options for managing the retention of data in the JS database in a new [swingset] section of app.toml (see release notes). While for archive nodes (cosmos configured with pruning = "nothing") the default is to retain historical transcripts, we recommend that these nodes be explicit and set vat-transcript-retention = “archival”.

Changelog:

  • Sept. 26, 2024: Updated the release page link from release candidate to final version

Emerynet has been successfully upgraded to agoric-upgrade-17!

1 Like

Tested IBC transfer from emerynet to osmosis testnet and back which was successful. Used TS Relayer (Confio Relayer) to send the transactions.

Osmosis TX: 9AA4626167B7BB3015CD3C65597A059045A9869DA5FF91815EA2F2DBB2A27787
Emerynet TX:
9980172C2AE4BC256F9E9E2462B3E5100789323C6BD64782DA462463CFC4F087

2 Likes

Emerynet milestone testing has been complete by combined efforts from Pathrock, KJ Nodes, and Hindsight. See Discord updates for details and discussion.

for ref: emerynet #72 carried 2024-09-23

1 Like

The chain upgrade was successful and agoric-upgrade-17 is now live on mainnet! Big thanks to the validator community for another successful upgrade!

And a shout out to Hindsight for coordinating the upgrade process!

for ref: Proposal 78 carried Oct 5th 2024.