OpenAI 嵌入¶

如果您正在 Colab 上打开此 Notebook，您可能需要安装 LlamaIndex 🦙。

In [ ]

%pip install llama-index-embeddings-openai

%pip install llama-index-embeddings-openai

In [ ]

!pip install llama-index

!pip install llama-index

In [ ]

import os

os.environ["OPENAI_API_KEY"] = "sk-..."

import os os.environ["OPENAI_API_KEY"] = "sk-..."

In [ ]

from llama_index.embeddings.openai import OpenAIEmbedding
from llama_index.core import Settings

embed_model = OpenAIEmbedding(embed_batch_size=10)
Settings.embed_model = embed_model

from llama_index.embeddings.openai import OpenAIEmbedding from llama_index.core import Settings embed_model = OpenAIEmbedding(embed_batch_size=10) Settings.embed_model = embed_model

使用 OpenAI text-embedding-3-large 和 text-embedding-3-small¶

注意，您可能需要更新您的 OpenAI 客户端：pip install -U openai

In [ ]

# get API key and create embeddings
from llama_index.embeddings.openai import OpenAIEmbedding

embed_model = OpenAIEmbedding(model="text-embedding-3-large")

embeddings = embed_model.get_text_embedding(
    "Open AI new Embeddings models is great."
)

# 获取 API 密钥并创建嵌入 from llama_index.embeddings.openai import OpenAIEmbedding embed_model = OpenAIEmbedding(model="text-embedding-3-large") embeddings = embed_model.get_text_embedding( "Open AI new Embeddings models is great." )

In [ ]

print(embeddings[:5])

print(embeddings[:5])

[-0.011500772088766098, 0.02457442320883274, -0.01760469563305378, -0.017763426527380943, 0.029841400682926178]

In [ ]

print(len(embeddings))

print(len(embeddings))

3072

In [ ]

# get API key and create embeddings
from llama_index.embeddings.openai import OpenAIEmbedding

embed_model = OpenAIEmbedding(
    model="text-embedding-3-small",
)

embeddings = embed_model.get_text_embedding(
    "Open AI new Embeddings models is awesome."
)

# 获取 API 密钥并创建嵌入 from llama_index.embeddings.openai import OpenAIEmbedding embed_model = OpenAIEmbedding( model="text-embedding-3-small", ) embeddings = embed_model.get_text_embedding( "Open AI new Embeddings models is awesome." )

In [ ]

print(len(embeddings))

print(len(embeddings))

1536

改变输出嵌入的维度¶

注意：请确保您拥有最新的 OpenAI 客户端

In [ ]

# get API key and create embeddings
from llama_index.embeddings.openai import OpenAIEmbedding


embed_model = OpenAIEmbedding(
    model="text-embedding-3-large",
    dimensions=512,
)

embeddings = embed_model.get_text_embedding(
    "Open AI new Embeddings models with different dimensions is awesome."
)
print(len(embeddings))

# 获取 API 密钥并创建嵌入 from llama_index.embeddings.openai import OpenAIEmbedding embed_model = OpenAIEmbedding( model="text-embedding-3-large", dimensions=512, ) embeddings = embed_model.get_text_embedding( "Open AI new Embeddings models with different dimensions is awesome." ) print(len(embeddings))

512