Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document Index Template API #4480

Open
guilload opened this issue Jan 30, 2024 · 2 comments · May be fixed by #5669
Open

Document Index Template API #4480

guilload opened this issue Jan 30, 2024 · 2 comments · May be fixed by #5669
Assignees
Labels
documentation Improvements or additions to documentation

Comments

@guilload
Copy link
Member

No description provided.

@guilload guilload added the documentation Improvements or additions to documentation label Jan 30, 2024
@Mo3m3n
Copy link

Mo3m3n commented Jan 31, 2025

Hey @guilload the index template api is very useful and automatic index creations helps when we want to avoid big indexes by letting the client partition (daily indexes for example) and route queries to the right index.
I have seen that this is only implemented in the code but there no config parameter to enable the auto_create_indexes.
Is it possible to enable this via a config param ?
Is the Index Template API gonna be publicly released and documented ?
Thanks

@rdettai rdettai linked a pull request Feb 6, 2025 that will close this issue
@Mo3m3n
Copy link

Mo3m3n commented Feb 12, 2025

@guilload FYI the issue I came across is maybe not a documentation one, cause I was able follow this internal doc last time https://github.com/quickwit-oss/quickwit/blob/main/docs/internals/template-index.md
But the problem is at the ingestion step I got the following error:

$ curl -XPOST "http://127.0.0.1:7280/api/v1/stackoverflow-foo/ingest" --data-binary @stackoverflow.posts.transformed-10000.json
{
  "message": "index `stackoverflow-foo` not found"
}

So I thought this was because of the auto_create_indexes is not enabled by default, but I was wrong, we can see it is enabled when the the control plane is started

The only relevant line log I have found is

2025-02-12T15:01:17.054Z ERROR quickwit_ingest::ingest_api_service: failed to find index index_id=stackoverflow-foo 

I do have the template created though:

$ curl -XGET http://127.0.0.1:7280/api/v1/templates | grep -B2 stackoverflow
  {
    "version": "0.8",
    "template_id": "stackoverflow",
    "index_id_patterns": [
      "stackoverflow*"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
Status: No status
Development

Successfully merging a pull request may close this issue.

3 participants