feat: all-in-one mirror configs function

[kemingy]

Includes:

• pypi index
• conda channel
• apt source

[gaocegege]

LGTM!

[cutecutecat]

I have an idea of this issue:
We provide

mirror_pip(source='tuna')

equals to

config.pip_index(url="https://pypi.tuna.tsinghua.edu.cn/simple")

and

mirror_apt(source = "sjtu", os = "20.04")

equals to

config.apt_source(source="""
# See http://help.ubuntu.com/community/UpgradeNotes for how to upgrade to
# newer versions of the distribution.
deb https://mirror.sjtu.edu.cn/ubuntu focal main restricted
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal main restricted
deb https://mirror.sjtu.edu.cn/ubuntu focal-updates main restricted
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal-updates main restricted
deb https://mirror.sjtu.edu.cn/ubuntu focal universe
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal universe
deb https://mirror.sjtu.edu.cn/ubuntu focal-updates universe
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal-updates universe
deb https://mirror.sjtu.edu.cn/ubuntu focal multiverse
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal multiverse
deb https://mirror.sjtu.edu.cn/ubuntu focal-updates multiverse
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal-updates multiverse
deb https://mirror.sjtu.edu.cn/ubuntu focal-backports main restricted universe multiverse
# deb-src https://mirror.sjtu.edu.cn/ubuntu focal-backports main restricted universe multiverse
deb http://archive.canonical.com/ubuntu focal partner
# deb-src http://archive.canonical.com/ubuntu focal partner
deb https://mirror.sjtu.edu.cn/ubuntu focal-security main restricted universe multiverse
# deb-src ht

and

mirror_conda(source = "tuna")

equals to

config.conda_channel(channel="""
channels:
  - defaults
show_channel_urls: true
default_channels:
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/r
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/msys2
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free
custom_channels:
  conda-forge: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  msys2: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  bioconda: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  menpo: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch-lts: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  simpleitk: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
""")

And the all-in-one mirror configs function:

mirror(pip="tuna", apt= "sjtu", os = "20.04", conda="tuna")

equals to above.

[gaocegege]

The approach works for me, but I prefer not to flatten the arguments:

mirror(pip="tuna", apt={source="tuna", os="20.04"})

Or we can infer the os version from the base.

/cc @kemingy @VoVAllen

[kemingy]

We can start exposing some internal graph information like OS, Cuda version, and CUDNN version.

Then the interface will be clean: mirror(pip="tuna", apt="tuna", conda="tuna").

[cutecutecat]

I would create a issue and PR of envd first about exposed starlark interface.
This issue will continue after that.

[kemingy]

I think you can work on this one without knowing about the OS. Since the current implementation cannot change the base image. It's always Ubuntu20.04.

tensorchord/envd#1267 may take some time to discuss.

[cutecutecat]

/assign