Tree Summarize

Load Data

from llama_index import SimpleDirectoryReader

reader = SimpleDirectoryReader(
    input_files=["../data/paul_graham/paul_graham_essay.txt"]
)

docs = reader.load_data()

text = docs[0].text

Summarize

from llama_index.response_synthesizers import TreeSummarize

summarizer = TreeSummarize(verbose=True)

response = await summarizer.aget_response("who is Paul Graham?", [text])

6 text chunks after repacking
1 text chunks after repacking

print(response)

Paul Graham is a computer scientist, writer, artist, entrepreneur, investor, and essayist. He is best known for his work in artificial intelligence, Lisp programming, and writing the book On Lisp, as well as for co-founding the startup accelerator Y Combinator and for his essays on technology, business, and start-ups. He is also the creator of the programming language Arc and the Lisp dialect Bel.