Skip to content

[tutorial] Embedding Gemma2 RAG on edge - #440

Merged
bebechien merged 7 commits into
google-gemma:mainfrom
lucifertrj:embeddinggemma2
Oct 26, 2026
Merged

bebechien merged 7 commits into
google-gemma:mainfrom
lucifertrj:embeddinggemma2

Conversation

@lucifertrj

@lucifertrj lucifertrj commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Adds a new end-to-end app, RAG on Edge, demonstrating Retrieval-Augmented Generation running fully on-device

The pipeline indexes the Gemma 4 technical report PDF and answers questions about it using:

  • Qdrant Edge for vector search engine
  • EmbeddingGemma2 (embeddinggemma-2-740m) for retrieval embeddings
  • Gemma 4 E2B for generation

Both engines run on a local GPU backend via LiteRT-LM.

Screenshot:
Screenshot 2026-10-15 at 22 53 56

@review-notebook-app

Copy link
Copy Markdown

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@lucifertrj lucifertrj changed the title [apps] Embedding Gemma2 RAG on edge [tutorial] Embedding Gemma2 RAG on edge Oct 25, 2026
@lucifertrj

Copy link
Copy Markdown
Contributor Author

@bebechien moved the app to tutorial, can you check

Comment thread apps/README.md

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you move this change to tutorials/README.md instead?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@bebechien bebechien left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@bebechien
bebechien merged commit 5c52c72 into google-gemma:main Oct 26, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants