QVAC Logo

ragChunk( )

Chunks documents into smaller pieces for embedding.

function ragChunk(params): Promise<RagDoc[]>;

Part of the segregated flow: ragChunk()embed()ragSaveEmbeddings()

Parameters

NameTypeRequired?Description
paramsobjectThe chunking parameters
params.documentsstring | string[]Documents to chunk
params.chunkOptsChunkOptionsChunking options

ChunkOptions

FieldTypeRequired?Description
chunkSizenumberMaximum chunk size
chunkOverlapnumberOverlap between chunks
chunkStrategy"character" | "paragraph"Chunking strategy
splitStrategy"character" | "word" | "token" | "sentence" | "line"Text splitting strategy

Returns

Promise<RagDoc[]> — Array of chunk results.

FieldTypeDescription
idstringChunk identifier
contentstringChunk text content

Throws

ErrorWhen
RAG_CHUNK_FAILEDThe chunking operation fails

Example

const chunks = await ragChunk({
  documents: ["Long document text here..."],
  chunkOpts: {
    chunkSize: 256,
    chunkOverlap: 50,
    chunkStrategy: "paragraph",
  },
});

On this page