gopypi is partial implementation of the PEP 503 also known as
the Simple Repository API.
Everybody knows PyPi (The Python Package Index) when it comes to retrieve Python dependencies and
since I needed to store private packages, I decided to make my own implementation with Golang.
This repository was first introduced because GCP was missing a place to store Python package. They added this functionnality recently (https://cloud.google.com/artifact-registry/docs/python/quickstart) and I don't think gopypi has still a meaning atm. (also the fact that it supports only GCS as a backend...)
At the moment, gopypi has been tested and deployed only within Google App Engine. It is handy as it comes with several
features like autoscaling or even TLS termination.
To deploy gopypi in App Engine, just update the app.yaml with the correct
API_KEY that you've generated. You can use this snippet to generate easily a token:
package main
import (
"crypto/rand"
"encoding/base64"
"fmt"
)
func main() {
// Pure bytes generated key.
b := make([]byte, 32)
_, _ = rand.Read(b)
fmt.Printf("%x\n", b)
// If you prefer the base64 encoded version.
s := base64.StdEncoding.EncodeToString(b)
fmt.Printf("%s", s)
}Once you've update the API_KEY environment variable, use gcloud to deploy:
gcloud app deploy app.yamlgopypi needs a private key to sign URLs of packages stored in GCS to let pip download them.
To let the app retrieve this private key, you will need to create it first from the service account that runs the
AppEngine service.
Then, go to the secret manager and create a new key called gopypi-sa-private-key. Store the JSON service account
file there.
Don't forget to add a permission for the service account that runs gopypi to be able to retrieve secrets.
(secretmanager.secrets.get: Secret Manager Viewer roles/secretmanager.viewer)
You can change the name of the secret to use by changing the secret name of the configs/gcp.yaml file.
gopypi leverages GCS to store and serve packages.
Create a bucket with the name gopypi or the one of you choice. (check configs/gcp.yaml and update the bucket value!)
Like for retrieving the secrets, the service account running gopypi will need permissions. Go to the newly create
bucket and add storage.buckets.get for the sa.
That's it you should be good to go!
You can choose the directory structure of your choice for packages as long as you keep the root with packages name. (
e.g. pydantic/... or pydantic/1.8.2/...)
Just use pip as you'd expect to:
pip install --extra-index-url https://<generated_token>:<gopypi server>/simple/ <private_package>Pull requests are always welcome. Don't hesitate to open an issue for questions or changes.
This project is under license GNU GPL V3.