Skip to content

Adding an LLM Inference Service Tutorials page#605

Open
SeanCondon wants to merge 3 commits intokserve:mainfrom
aicatalyst-team:scLlmisvcTutorials
Open

Adding an LLM Inference Service Tutorials page#605
SeanCondon wants to merge 3 commits intokserve:mainfrom
aicatalyst-team:scLlmisvcTutorials

Conversation

@SeanCondon
Copy link
Copy Markdown

@SeanCondon SeanCondon commented Mar 11, 2026

Adding a new Tutorials page under Model Serving -> Generative Inference -> LLMInference to point to the docs/samples/llmisvc tutorials in the main website as suggested by @sivanantha321

Note: Now that PR 5150 on kserve has been merged, this can be reviewed.

Proposed Changes

@netlify
Copy link
Copy Markdown

netlify bot commented Mar 11, 2026

Deploy Preview for elastic-nobel-0aef7a ready!

Name Link
🔨 Latest commit 26e6cc7
🔍 Latest deploy log https://app.netlify.com/projects/elastic-nobel-0aef7a/deploys/69cfba8017798500099b450e
😎 Deploy Preview https://deploy-preview-605--elastic-nobel-0aef7a.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a Tutorials landing page under Model Serving → Generative Inference → LLMInferenceService to direct users to the upstream kserve/kserve LLMInferenceService tutorial content, and updates sidebar metadata for the Envoy AI Gateway tutorial page to improve navigation.

Changes:

  • Add docs/model-serving/generative-inference/llmisvc/tutorials.md with links to upstream LLMInferenceService tutorial directories.
  • Register the new Tutorials page in sidebars.ts under the LLMInferenceService section.
  • Add missing sidebar frontmatter (sidebar_label, sidebar_position) to llmisvc-envoy-ai-gateway.md.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

File Description
sidebars.ts Adds the new Tutorials doc to the LLMInferenceService sidebar entries.
docs/model-serving/generative-inference/llmisvc/tutorials.md New Tutorials landing page linking to upstream kserve/kserve tutorial content.
docs/model-serving/generative-inference/llmisvc/llmisvc-envoy-ai-gateway.md Adds sidebar metadata to improve labeling/ordering in the docs nav.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Signed-off-by: SeanCondon <scondon@redhat.com>
Signed-off-by: SeanCondon <scondon@redhat.com>
Signed-off-by: SeanCondon <scondon@redhat.com>
@SeanCondon SeanCondon force-pushed the scLlmisvcTutorials branch from 521c73d to 26e6cc7 Compare April 3, 2026 13:02
@SeanCondon
Copy link
Copy Markdown
Author

Reviewers, can you take a look at this please? @alexagriffith @theofpa
It's based off a review comment made when I was adding a sample for llmisvc over on the main kserve repo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants