pe.embedding.text.sentence_transformer module

class pe.embedding.text.sentence_transformer.SentenceTransformer(model, batch_size=2000)

Bases: Embedding

Compute the Sentence Transformers embedding of text.

__init__(model, batch_size=2000)

Constructor.

Parameters:

• model (str) – The Sentence Transformers model to use

• batch_size (int, optional) – The batch size to use for computing the embedding, defaults to 2000

property column_name

The column name to be used in the data frame.

compute_embedding(data)

Compute the Sentence Transformers embedding of text.

Parameters:

data (pe.data.Data) – The data object containing the text

Returns:

The data object with the computed embedding

Return type:

pe.data.Data