Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE] AsyncSubstrateInterface Overhaul (with Sync AsyncSubstrate) #2526

Open
wants to merge 222 commits into
base: staging
Choose a base branch
from
Open

[DO NOT MERGE] AsyncSubstrateInterface Overhaul (with Sync AsyncSubstrate) #2526

wants to merge 222 commits into from
+6,982 −14,469

Conversation

thewhaleking
Copy link
Contributor

@thewhaleking thewhaleking commented Dec 6, 2024 •
edited
Loading

Before merging, this needs to be thoroughly manually tested.

Changes Subtensor (not AsyncSubtensor) to use AsyncSubstrateInterface through a wrapper. Adjusts the rest of Subtensor to handle this (including tests). Also improves the handling of reconnection in AsyncSubstrateInterface, which directly improves the sync version of it.

Removes all our ensure_connected wrappers, because we are now able to do the reconnection logic directly in the (Async)SubstrateInterface

TODO:

  • Port all methods of py-substrate-interface to async substrate interface
  • Port all methods of subtensor to async_subtensor
  • Improve connection logic
  • Make SubstrateInterface use AsyncSubstrateInterface
  • Remove all non-AsyncSubstrateInterface-level reconnection handling/logic
  • Speed

Important to know for users of release:

  • All py-substrate-interface exceptions (especially SubstrateRequestException) will need to be caught from bittensor.core.errors rather than substrateinterface.exceptions.
  • The base websocket object inside SubstrateInterface has changed.

@thewhaleking thewhaleking marked this pull request as ready for review December 10, 2024 12:53
@thewhaleking thewhaleking changed the title [WIP] sync AsyncSubstrateInterface Sync AsyncSubstrateInterface Dec 10, 2024
@thewhaleking thewhaleking requested a review from a team December 10, 2024 13:59
@thewhaleking thewhaleking force-pushed the feat/thewhaleking/new-sync-substrate branch 2 times, most recently from d81be92 to a35276a Compare December 10, 2024 18:32
This was referenced Dec 10, 2024
Open
Merged
@thewhaleking thewhaleking changed the title Sync AsyncSubstrateInterface AsyncSubstrateInterface Overhaul (with Sync AsyncSubstrate) Dec 12, 2024
@thewhaleking thewhaleking force-pushed the feat/thewhaleking/new-sync-substrate branch 3 times, most recently from e5c8451 to 8383fce Compare December 16, 2024 17:49
@thewhaleking thewhaleking marked this pull request as draft December 16, 2024 20:04
@thewhaleking thewhaleking force-pushed the feat/thewhaleking/new-sync-substrate branch 2 times, most recently from 914b86a to 59778da Compare December 16, 2024 23:01
@roman-opentensor roman-opentensor mentioned this pull request Dec 17, 2024
Open
1 task
thewhaleking and others added 2 commits January 8, 2025 22:55
@thewhaleking
Reverted change.
59739f2
@thewhaleking
Merge pull request #2565 from opentensor/feat/roman/async-to-sync-via…
af6396d 
…-wrapper

[SDK] Get rid of py-substrate-interface (DO NOT MERGE)
@thewhaleking thewhaleking marked this pull request as ready for review January 8, 2025 20:56
@thewhaleking thewhaleking changed the title AsyncSubstrateInterface Overhaul (with Sync AsyncSubstrate) [DO NOT MERGE] AsyncSubstrateInterface Overhaul (with Sync AsyncSubstrate) Jan 8, 2025
roman-opentensor and others added 23 commits January 8, 2025 19:34
@roman-opentensor
fix tests
2ce909f
@thewhaleking
Removed substrate-interface from requirements
1ff431e
@thewhaleking
More stripping of py-substrate-interface
19ac760
@thewhaleking
Completely removed py-substrate-interface.
dc60e03
@thewhaleking
Docstrings update
d897b70
@thewhaleking
Fix tests
4609355
@thewhaleking
Merge branch 'staging' into feat/thewhaleking/new-sync-substrate
9a669a4
@thewhaleking
Name shadowing.
46a1468
@thewhaleking
Import/type fixes.
5913108
@thewhaleking
Return self from __aenter__
9ec7acf
@thewhaleking
Ensure correct loop is used always
b31764f
@thewhaleking
Use async_substrate_interface rather than the local version.
6106c18
@thewhaleking
Update utils
66c64a8
@roman-opentensor
replace imports + cleanup + ruff
9dcfcae
@roman-opentensor
temporally use repo instead of pypi package
0bda527
@roman-opentensor
ruff
344a412
@roman-opentensor
Merge pull request #2572 from opentensor/feat/thewhaleking/use-library
1f85164 
Uses the new async_substrate_interface lib
@roman-opentensor
update deps
2aec7f6
@roman-opentensor
update deps
c99aaee
@roman-opentensor
Merge remote-tracking branch 'origin/feat/thewhaleking/new-sync-subst…
528817c 
…rate' into feat/thewhaleking/new-sync-substrate

# Conflicts:
#	requirements/prod.txt
@roman-opentensor
update deps
ee6f834
@roman-opentensor
update deps
c31520e
@roman-opentensor
add nonce to root set weights
6b8776e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
async migration do not merge
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@thewhaleking @zyzniewski-reef @roman-opentensor