Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: add transfer with memo compatibility tests #2640

Merged
merged 10 commits into from
Nov 2, 2022
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"chain-a": ["release-v2.5.x", "v2.4.2"],
"chain-b": ["release-v2.5.x", "v2.4.2"],
colin-axner marked this conversation as resolved.
Show resolved Hide resolved
"entrypoint": ["TestTransferTestSuite"],
"test": [
"TestMsgTransfer_Succeeds_Nonincentivized",
"TestMsgTransfer_Fails_InvalidAddress",
"TestMsgTransfer_Timeout_Nonincentivized",
"TestMsgTransfer_WithMemo",
"TestSendEnabledParam",
"TestReceiveEnabledParam"
],
Comment on lines +5 to +12
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might be nice if in the future we can just have test exclusions, I forget why it was difficult to list all possible tests

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's possible to list all tests explicitly, the tradeoff is ease of maintenance. This syntax isn't anything we're in control of, this is the regular github action json expansion. So we can't easily add in any sort of our own logic to filter things in a certain way.

We can explicitly list an array of items, but each item has 5 or 6 properties. I would be in favour of more smaller json files focused on a specific thing even if there is some duplication rather than the long list to maintain.

In the other actions we have the concept of a test exclusion, and that's possible because we have some code that is dynamically generating the matrix that github expects. That is also always an option, to write an additional, script which has knowledge about specifics.

"chain-binary": ["simd"],
"chain-image": ["ghcr.io/cosmos/ibc-go-simd"]
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"chain-a": ["release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am adding to tips of release branches here, so that we can test that transfer with memo works between v3.4.x and v2.5.x, but I am unsure if this is supported by the e2e framework, so let's give it a try and see what happens...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah I left my below comments before seeing this. This one might be tricky as the first part of the compatibility test process is building the the release-x.y.x image. In this case some of those images won't exist. As a work around you could launch those compatibility tests for the images that don't exist manually then cancel them after the image is built.

"chain-b": ["release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"entrypoint": ["TestTransferTestSuite"],
"test": [
"TestMsgTransfer_Succeeds_Nonincentivized",
"TestMsgTransfer_Fails_InvalidAddress",
"TestMsgTransfer_Timeout_Nonincentivized",
"TestMsgTransfer_WithMemo",
"TestSendEnabledParam",
"TestReceiveEnabledParam"
],
"chain-binary": ["simd"],
"chain-image": ["ghcr.io/cosmos/ibc-go-simd"]
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"chain-a": ["release-v4.2.x"],
"chain-b": ["release-v4.2.x"],
"entrypoint": ["TestIncentivizedTransferTestSuite"],
"test": [
"TestMsgPayPacketFee_AsyncSingleSender_Succeeds",
"TestMsgPayPacketFee_InvalidReceiverAccount",
"TestMultiMsg_MsgPayPacketFeeSingleSender",
"TestMsgPayPacketFee_SingleSender_TimesOut",
"TestPayPacketFeeAsync_SingleSender_NoCounterPartyAddress",
"TestMsgPayPacketFee_AsyncMultipleSenders_Succeeds"
],
"chain-binary": ["simd"],
"chain-image": ["ghcr.io/cosmos/ibc-go-simd"]
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"chain-a": ["release-v4.2.x", "v4.1.1", "release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"chain-b": ["release-v4.2.x", "v4.1.1", "release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"entrypoint": ["TestTransferTestSuite"],
"test": [
"TestMsgTransfer_Succeeds_Nonincentivized",
"TestMsgTransfer_Fails_InvalidAddress",
"TestMsgTransfer_Timeout_Nonincentivized",
"TestMsgTransfer_WithMemo",
"TestSendEnabledParam",
"TestReceiveEnabledParam"
],
"chain-binary": ["simd"],
"chain-image": ["ghcr.io/cosmos/ibc-go-simd"]
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"chain-a": ["release-v5.1.x", "v4.1.1"],
"chain-b": ["release-v5.1.x", "v4.1.1"],
"entrypoint": ["TestIncentivizedTransferTestSuite"],
"test": [
"TestMsgPayPacketFee_AsyncSingleSender_Succeeds",
"TestMsgPayPacketFee_InvalidReceiverAccount",
"TestMultiMsg_MsgPayPacketFeeSingleSender",
"TestMsgPayPacketFee_SingleSender_TimesOut",
"TestPayPacketFeeAsync_SingleSender_NoCounterPartyAddress",
"TestMsgPayPacketFee_AsyncMultipleSenders_Succeeds"
],
"chain-binary": ["simd"],
"chain-image": ["ghcr.io/cosmos/ibc-go-simd"]
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"chain-a": ["release-v5.1.x", "v5.0.1", "release-v4.2.x", "v4.1.1", "release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"chain-b": ["release-v5.1.x", "v5.0.1", "release-v4.2.x", "v4.1.1", "release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"entrypoint": ["TestTransferTestSuite"],
"test": [
"TestMsgTransfer_Succeeds_Nonincentivized",
"TestMsgTransfer_Fails_InvalidAddress",
"TestMsgTransfer_Timeout_Nonincentivized",
"TestMsgTransfer_WithMemo",
"TestSendEnabledParam",
"TestReceiveEnabledParam"
],
"chain-binary": ["simd"],
"chain-image": ["ghcr.io/cosmos/ibc-go-simd"]
}
Original file line number Diff line number Diff line change
@@ -1,11 +1,12 @@
{
"chain-a": ["release-v6.0.x", "v5.0.0", "v4.1.0", "v3.3.0", "v2.4.0"],
"chain-b": ["release-v6.0.x", "v5.0.0", "v4.1.0", "v3.3.0", "v2.4.0"],
"chain-a": ["release-v6.0.x", "release-v5.1.x", "v5.0.1", "release-v4.2.x", "v4.1.1", "release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"chain-b": ["release-v6.0.x", "release-v5.1.x", "v5.0.1", "release-v4.2.x", "v4.1.1", "release-v3.4.x", "v3.3.1", "release-v2.5.x", "v2.4.2"],
"entrypoint": ["TestTransferTestSuite"],
"test": [
"TestMsgTransfer_Succeeds_Nonincentivized",
"TestMsgTransfer_Fails_InvalidAddress",
"TestMsgTransfer_Timeout_Nonincentivized",
"TestMsgTransfer_WithMemo",
"TestSendEnabledParam",
"TestReceiveEnabledParam"
],
Expand Down
4 changes: 4 additions & 0 deletions .github/workflows/e2e-compatibility.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,11 @@ on:
required: true
type: choice
options:
- release/v2.5.x
- release/v3.4.x
- release/v4.2.x
- release/v5.0.x
- release/v5.1.x
- release/v6.0.x

env:
Expand Down