Skip to content

[Enhancement]: Batch note embedding for faster bulk indexing #13

@HahaBill

Description

@HahaBill

Right now notes are embedded one at a time. processNextNote sends a single chunk to the worker and waits for the result before sending the next, so there's only ever one request in flight. This can be slow for a large number of notes and it scales linearly with note count.

Figure out how to do this concurrently/in parallel.

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions