Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stabilize broken test suite #350

Closed
Keyrxng opened this issue Oct 23, 2024 · 3 comments · Fixed by #345
Closed

Stabilize broken test suite #350

Keyrxng opened this issue Oct 23, 2024 · 3 comments · Fixed by #345

Comments

@Keyrxng
Copy link
Contributor

Keyrxng commented Oct 23, 2024

Cypress has been broken for the past two weeks just about and should be stabilized as it's an important part of review for this CI to be green.

Another task should be made to address the problem regarding the fact that the workflow is not an active part of pull request CI as it has allowed PRs through in the last two weeks which have completely overlooked this area of development.

@Keyrxng
Copy link
Contributor Author

Keyrxng commented Oct 23, 2024

about 2 hours and is priority 3 I'd say since it's an essential part of review

Copy link
Contributor

ubiquity-os bot commented Oct 24, 2024

@Keyrxng the deadline is at Thu, Oct 24, 6:26 PM UTC

Copy link
Contributor

ubiquity-os bot commented Oct 25, 2024

 [ 61.955 UUSD ] 

@Keyrxng
Contributions Overview
ViewContributionCountReward
IssueTask150
IssueSpecification111.37
IssueComment10.585
ReviewComment190
Conversation Incentives
CommentFormattingRelevanceReward
Cypress has been broken for the past two weeks just about and sh…
3.79
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 72
  wordValue: 0.1
  result: 3.79
111.37
about 2 hours and is priority 3 I'd say since it's an essential …
1.17
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 18
  wordValue: 0.1
  result: 1.17
0.50.585
Resolves https://github.com/ubiquity/pay.ubq.fi/issues/350Rela…
7.5
content:
  content:
    p:
      score: 0
      elementCount: 11
    ul:
      score: 1
      elementCount: 1
    li:
      score: 0.5
      elementCount: 3
    a:
      score: 5
      elementCount: 1
  result: 7.5
regex:
  wordCount: 150
  wordValue: 0
  result: 0
0.90
1. It's still possible for anvil to panic and crash unrelated to…
2
content:
  content:
    ol:
      score: 1
      elementCount: 1
    li:
      score: 0.5
      elementCount: 2
    p:
      score: 0
      elementCount: 2
  result: 2
regex:
  wordCount: 45
  wordValue: 0
  result: 0
0.850
I can't remember exactly what the error was mate but it looked a…
0
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 37
  wordValue: 0
  result: 0
0.70
it was duplicated and has two steps here doing the same thing bu…
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 40
  wordValue: 0
  result: 0
0.60
Agree with you that retry should be part of `rpc-handler`…
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 94
  wordValue: 0
  result: 0
0.80
you can't really do that in CI though and CI should be stable so…
0
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 40
  wordValue: 0
  result: 0
0.750
Where we pull all of our data from inside `rpc-handler` …
0
content:
  content:
    p:
      score: 0
      elementCount: 7
  result: 0
regex:
  wordCount: 110
  wordValue: 0
  result: 0
0.650
I've opened a [task](https://github.com/ubiquity/rpc-handler/iss…
5
content:
  content:
    p:
      score: 0
      elementCount: 1
    a:
      score: 5
      elementCount: 1
  result: 5
regex:
  wordCount: 19
  wordValue: 0
  result: 0
0.50
@EresDev you had this as it's own step before but that's not rig…
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 42
  wordValue: 0
  result: 0
0.70
https://github.com/ubq-testing/pay.ubq.fi/actions/runs/115043441…
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 42
  wordValue: 0
  result: 0
0.550
I think there is logic missing inside the cards feature that is …
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 57
  wordValue: 0
  result: 0
0.60
I also investigated why `blockscan` was giving us 404 er…
0
content:
  content:
    p:
      score: 0
      elementCount: 3
  result: 0
regex:
  wordCount: 111
  wordValue: 0
  result: 0
0.70
The tests have been failing consistently for the past two weeks,…
0
content:
  content:
    p:
      score: 0
      elementCount: 3
  result: 0
regex:
  wordCount: 84
  wordValue: 0
  result: 0
0.850
QA of the tests now working:https://github.com/ubq-testing/pay…
6.5
content:
  content:
    p:
      score: 0
      elementCount: 4
    hr:
      score: 0
      elementCount: 1
    ul:
      score: 1
      elementCount: 1
    li:
      score: 0.5
      elementCount: 1
    a:
      score: 5
      elementCount: 1
  result: 6.5
regex:
  wordCount: 74
  wordValue: 0
  result: 0
0.80
I create a permit with a function that uses `cy.wrap` to…
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 65
  wordValue: 0
  result: 0
0.60
I hear you. I'm sure you authored those tests but you were pulli…
0
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 66
  wordValue: 0
  result: 0
0.650
Sorry your message read like I'd need to create a new one agains…
0
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 40
  wordValue: 0
  result: 0
0.550
Hardcoded the permit as requested but I'm still using the `c…
0
content:
  content:
    p:
      score: 0
      elementCount: 4
  result: 0
regex:
  wordCount: 84
  wordValue: 0
  result: 0
0.750
https://github.com/ubq-testing/pay.ubq.fi/actions/runs/114872086…
2
content:
  content:
    p:
      score: 0
      elementCount: 3
    ol:
      score: 1
      elementCount: 1
    li:
      score: 0.5
      elementCount: 2
  result: 2
regex:
  wordCount: 136
  wordValue: 0
  result: 0
0.70

 [ 7.682625 UUSD ] 

@EresDev
Contributions Overview
ViewContributionCountReward
ReviewComment117.682625
Conversation Incentives
CommentFormattingRelevanceReward
This is problematic. This means one test has a dependency on oth…
3.79
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 72
  wordValue: 0.1
  result: 3.79
0.90.85525
Yes, tests are passing now. I ran multiple times, and one test w…
5.18
content:
  content:
    p:
      score: 0
      elementCount: 4
  result: 0
regex:
  wordCount: 104
  wordValue: 0.1
  result: 5.18
0.50.6525
any reason for removing this?
0.39
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 5
  wordValue: 0.1
  result: 0.39
0.40.0415
sorting and retrying should be part of `rpc-handler`. Le…
1.65
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 27
  wordValue: 0.1
  result: 1.65
0.80.3275
wss error could be just a normal failure like other rpc. I remem…
2.1
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 36
  wordValue: 0.1
  result: 2.1
0.60.32
Isn't it better to use `getFastestRpcProvider`, and not …
0.83
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 12
  wordValue: 0.1
  result: 0.83
0.70.14775
The retry logic helps with starting the anvil. It doesn't help a…
2.78
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 50
  wordValue: 0.1
  result: 2.78
0.40.283
For CI, your solution seems useful. You can keep it then. Even…
3.25
content:
  content:
    p:
      score: 0
      elementCount: 2
  result: 0
regex:
  wordCount: 60
  wordValue: 0.1
  result: 3.25
0.60.485
This makes a precondition that test-1 must pass before test-2.…
4.5
content:
  content:
    p:
      score: 0
      elementCount: 3
  result: 0
regex:
  wordCount: 88
  wordValue: 0.1
  result: 4.5
0.91.0175
If you are referring to test "should reveal a redeem code after …
1.49
content:
  content:
    p:
      score: 0
      elementCount: 1
  result: 0
regex:
  wordCount: 24
  wordValue: 0.1
  result: 1.49
0.50.18375
I gave it a run. Rpc is working nicely for me. However, there ar…
14.43
content:
  content:
    p:
      score: 0
      elementCount: 4
    ol:
      score: 1
      elementCount: 2
    li:
      score: 0.5
      elementCount: 2
    img:
      score: 5
      elementCount: 1
  result: 8
regex:
  wordCount: 134
  wordValue: 0.1
  result: 6.43
0.853.368875

 [ 2.788 UUSD ] 

@rndquu
Contributions Overview
ViewContributionCountReward
ReviewComment12.788
Conversation Incentives
CommentFormattingRelevanceReward
1. Local claims seems to be working fine2. Hope this PR adds m…
3.94
content:
  content:
    ol:
      score: 1
      elementCount: 1
    li:
      score: 0.5
      elementCount: 3
    p:
      score: 0
      elementCount: 3
  result: 2.5
regex:
  wordCount: 23
  wordValue: 0.1
  result: 1.44
0.22.788

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants