Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Envoy AI Gateway v0.1 design doc #52

Merged
merged 17 commits into from
Jan 30, 2025
Merged

Conversation

yuzisun
Copy link
Contributor

@yuzisun yuzisun commented Dec 25, 2024

This PR documents the envoy ai gateway 0.1 release API and architecture design.

@yuzisun yuzisun requested a review from a team as a code owner January 29, 2025 01:21
Signed-off-by: Dan Sun <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
@yuzisun yuzisun changed the title WIP: AI Gateway Design Proposal docs: Envoy AI Gateway Design Proposal Jan 29, 2025
Signed-off-by: Dan Sun <[email protected]>
@mathetake
Copy link
Member

meta question: should we call this simply v1 design doc or something like that? I guess it's not a proposal per-se but more of a like a design doc

@yuzisun
Copy link
Contributor Author

yuzisun commented Jan 29, 2025

meta question: should we call this simply v1 design doc or something like that? I guess it's not a proposal per-se but more of a like a design doc

true, rewording to v1 design doc

@yuzisun yuzisun changed the title docs: Envoy AI Gateway Design Proposal docs: Envoy AI Gateway v0.1 design doc Jan 29, 2025
Copy link
Member

@mathetake mathetake left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looking correct implementation pov. If we don't publish this on the website then I think we don't need to spend too much time on this (like wording backend vs provider etc) and i can approve after @missBerg takes a look.

we are going to have a similar page in the website like the high level Architecture right? @missBerg

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think we also need an arrow from Envoy Extension Policy to Envoy Gateway Controller, just like the one from HTTPRoute?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looking cool (and correct on how the rate limit works)!

docs/proposals/001-ai-gateway-proposal/proposal.md Outdated Show resolved Hide resolved
docs/proposals/001-ai-gateway-proposal/proposal.md Outdated Show resolved Hide resolved
docs/proposals/001-ai-gateway-proposal/proposal.md Outdated Show resolved Hide resolved
docs/proposals/001-ai-gateway-proposal/proposal.md Outdated Show resolved Hide resolved
docs/proposals/001-ai-gateway-proposal/proposal.md Outdated Show resolved Hide resolved
Signed-off-by: Dan Sun <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
@mathetake mathetake merged commit 1ff7110 into envoyproxy:main Jan 30, 2025
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants