feat: code base indexing engine

[akostadinov]

Quick Check ✨

• I've taken a look at existing feature requests
• This feature request relates to GAIA UI (Open-WebUI)

What's on your mind?

Hello, it will be super useful to integrate some code repository indexing system. This is already a proven approach used by deepwiki where searching within a large codebase happens very fast and with low resources.

If this mechanism is history aware, that would be even better to allow historic changes discovery. Not to mention if it can search PRs that can also provide important insights even if PRs were closed.

[itomek]

Hi @akostadinov can you provide more details please?

[akostadinov]

@itomek , idk what more to say. If you open deepwiki.com and choose a project, you can ask questions. It works really fast because it indexes the project in advance.

If you ask your local agent about your code base, it first starts retrieving files, searching and whatnot. While this works quiet well (albeit slow) with advanced models like sonnet/opus and big enough context, that's definitely not a good approach for local, what gaia seems to be aiming for.

If one can index the codebase into a RAG-like something, it might be much easier for a local model to find its way.

[itomek]

got it! Thanks for the clarification! That's a really good idea!

[itomek]

@akostadinov is this what you had in mind: #721 ?