DeepLake 阅读器¶

如果您在 colab 上打开此 Notebook，您可能需要安装 LlamaIndex 🦙。

输入 [ ]

%pip install llama-index-readers-deeplake

%pip install llama-index-readers-deeplake

输入 [ ]

!pip install llama-index

!pip install llama-index

输入 [ ]

import getpass
import os
import random
import textwrap

from llama_index.core import VectorStoreIndex
from llama_index.readers.deeplake import DeepLakeReader


os.environ["OPENAI_API_KEY"] = getpass.getpass("open ai api key: ")

import getpass import os import random import textwrap from llama_index.core import VectorStoreIndex from llama_index.readers.deeplake import DeepLakeReader os.environ["OPENAI_API_KEY"] = getpass.getpass("open ai api key: ")

输入 [ ]

reader = DeepLakeReader()
query_vector = [random.random() for _ in range(1536)]
documents = reader.load_data(
    query_vector=query_vector,
    dataset_path="hub://activeloop/paul_graham_essay",
    limit=5,
)

reader = DeepLakeReader() query_vector = [random.random() for _ in range(1536)] documents = reader.load_data( query_vector=query_vector, dataset_path="hub://activeloop/paul_graham_essay", limit=5, )

/Users/adilkhansarsen/Documents/work/LlamaIndex/llama_index/GPTIndex/lib/python3.9/site-packages/deeplake/util/warnings.py:7: UserWarning: Checking out dataset in read only mode as another machine has locked this version for writing.
  warnings.warn(*args, **kwargs)

-

This dataset can be visualized in Jupyter Notebook by ds.visualize() or at https://app.activeloop.ai/activeloop/paul_graham_essay

\

hub://activeloop/paul_graham_essay loaded successfully.

输入 [ ]

index = VectorStoreIndex.from_documents(documents)
query_engine = index.as_query_engine()
response = query_engine.query("What was a hard moment for the author?")
print(textwrap.fill(str(response), 100))

index = VectorStoreIndex.from_documents(documents) query_engine = index.as_query_engine() response = query_engine.query("作者经历过的艰难时刻是什么？") print(textwrap.fill(str(response), 100))

INFO:llama_index.token_counter.token_counter:> [build_index_from_nodes] Total LLM token usage: 0 tokens
INFO:llama_index.token_counter.token_counter:> [build_index_from_nodes] Total embedding token usage: 14220 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total LLM token usage: 3975 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total embedding token usage: 9 tokens

 A hard moment for the author was when he realized that the AI programs of the time were not going
to be able to understand natural language and bridge the gap between what they could do and actually
understanding natural language. He had expected college to help him understand the ultimate truths,
but instead he found that the other fields took up so much of the space of ideas that there wasn't
much left for these supposed ultimate truths. He also found himself in a situation where the
students and faculty had an arrangement that didn't require either to learn or teach anything, and
he was the only one painting the nude model. He was also painting still lives in his bedroom at
night on scraps of canvas due to his financial situation.