Add functionality for a branching factor #17
Merged
+189
−135
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 2 commits
November 9, 2022 22:22
viveksilimkhan1
pushed a commit
to viveksilimkhan1/llama_index
that referenced
this pull request
Oct 30, 2023
* Merged template() and parse() into task(). * Use spacy_llm.registry. * Synch with main. * Move python-dotenv to dev requirements. * Fix typing in llm.py. * Use TypeVars for typing. * Fix typing for prompt Callable. * Revert "Use spacy_llm.registry." This reverts commit 88fa3aaaa37bedac03539d72e692a5902ffba8d1. * Use alternative registry approach. * Move python-dotenv back to requirements.txt. * Move prompt config into API config. * Introduce spacy-llm.registry. * Update test sentence. * Inverse api-prompt config flow. Inject api into prompt Callable to simplify config. * Merge api.py into prompt.py. * Add aliases for template and parse callables. * Add alias for prompt Callable. * Rename registry handle. * Add warning for mismatching types. * Simplify type check. * Update spacy_llm/registry/prompt.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Add test for type checking/warning. * Undo registry changes. Rename prompt to query. Inverse api-query nesting. Reframed role of api(). * Update spacy_llm/pipeline/llm.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Rename TypeVars. Shorten registry handles. * Update spacy_llm/registry/api.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Simplify registry handles for backends Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Rename 'api' to 'backend'. * Remove leftover comments. * Update spacy_llm/pipeline/llm.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Fix misnamed variable Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Update spacy_llm/registry/task.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Update registry handles for query functions. * Update readme. * Bump version. * Change sequence of backend params. * Update README.md Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> --------- Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
Disiok
pushed a commit
that referenced
this pull request
Nov 3, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds a child branching factor for each parent node, so that instead of just exploring one child, it has the option to pick multiple children to explore, and refine the answer across multiple children. GPT Index does this recursively at every parent node, offering tons of opportunities to refine and expand the answer!
Example usage below (with branch factor 2):
Here's branch factor 1 (the existing approach):
As we can see the answer is much more detailed in the first.