v2.2.1

v2.2.1

Add:

• Added src/test.sh helper script to run the solution tests with XPlat code coverage and generate HTML, Markdown, and text coverage reports.
• Added regression tests in BugDiscoveryTests and DiskVectorDatabaseTests to cover paging metadata, empty database stream round-tripping, disk persistence reload behavior, immediate visibility of disk-backed writes, and immediate reopen-after-delete persistence.
• Added CoverageExpansionTests to extend coverage across model types, exception hierarchy, ID generators, VectorTextResult, TextDataLoader, DatabaseFile, memory store branches, and obsolete serialization wrappers.
• Added DiskStoreRegressionTests to validate disk-backed vocabulary and vector store serialization, deserialization, enumeration, and persistence behavior.

Fixed:

• Fixed .Search() / .SearchAsync() result paging metadata so TotalPages is calculated from the total result count instead of echoing the requested page size.
• Fixed MemoryVectorDatabase<TMetadata> deserialization from an empty binary stream so ID generation resets correctly instead of failing when no items exist.
• Fixed BasicDiskVectorStore read-after-write behavior so added items are immediately visible to Count, GetIds(), ContainsKey(), enumeration, and search before the background disk flush completes.
• Fixed BasicDiskVectorStore delete persistence to avoid WAL truncation races when a database is reopened immediately after delete operations.
• Fixed reopened disk-backed databases to correctly expose persisted IDs and search results after checkpoint recovery.
• Fixed BasicDiskVocabularyStore.DeserializeFromJsonStreamAsync so deserialized vocabularies restore the in-memory lookup cache as well as the persisted vocabulary map.
• Fixed BasicDiskVectorStore.SerializeToJsonStreamAsync to flush pending operations before serialization and persist actual vector items rather than only index offsets.
• Fixed BasicDiskVectorStore.DeserializeFromJsonStreamAsync to rebuild item storage, index, visible IDs, and cache from serialized vector items.
• Updated the package version to 2.2.1 and refreshed the copyright year range to 2024-2026.

Notes:

• Added coveragereport to .gitignore to keep generated coverage artifacts out of source control.

v2.2.0

Add:

• Added BasicDiskVectorDatabase to provide a basic automatically disk persistent vector database, and associated BasicDiskVectorStore and BasicDiskVocabularyStore.

v2.1.3

What's Changed

Add:

• Added IBatchEmbeddingsGenerator and .AddTextsAsync to support batch adding of texts to database.
• Added OpenAI support for IBatchEmbeddingsGenerator
• Added IVectorTextResultItem.Similarity and marked IVectorTextResultItem.VectorComparison obsolete. VectorComparison will be removed in the future.
• Added more comment metadata to code

v2.1.2

What's Changed

Fixed:

• Fixed a bug when loading saved database from file/stream where IntIdGenerator or NumericIdGenerator lose max Id, resulting in adding new texts to database causes existing texts to be overwritten. This specifically affected SharpVector.OpenAI and SharpVector.Ollama libraries but the fix is implemented within the core Build5Nines.SharpVector library.

Nuget

dotnet add package Build5Nines.SharpVector --version 2.1.2

v2.1.1

What's Changed

Added:

• Add optional filter parameter to .Search and .SearchAsync methods that is of type Func<TMetadata, bool> that is called for each text item in the database for more advanced filtering prior to performing vector similarity search and returning results. If undefined or null it's ignored.
• add Metadata documentation & LICENSE file reference change for future by @crpietschmann in #71

Full Changelog: v2.1.0...v2.1.1

Nuget

dotnet add package Build5Nines.SharpVector --version 2.1.1

v2.1.0

What's Changed

Add:

• Added VectorTextResultItem.Id property so it's easy to get the database ID for search results if necessary.
• IVectorDatabase now inherits from IEnumerable so you can easily look through the texts documents that have been added to the database.

Fixed:

• Fixed text tokenization to correctly remove special characters
• Update BasicTextPreprocessor to support Emoji characters too
• Refactorings for more Clean Code

Breaking Changes:

• The .Search and .SearchAsync methods now return a IVectorTextResultItem<TId, TDocument, TMetadata> instead of VectorTextResultItem<TDocument, TMetadata>. If you're using things like the documentation shows, then you wont see any changes or have any issues with this update.

Full Changelog: v2.0.4...v2.1.0

Nuget

dotnet add package Build5Nines.SharpVector --version 2.1.0
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.3
dotnet add package Build5Nines.SharpVector.Ollama --version 2.0.3

v2.0.4

What's Changed

Add:

• Add Ollama support via Build5Nines.SharpVector.Ollama nuget package
• Added Build5Nines.SharpVector.Embeddings.IEmbeddingsGenerator to support creating external embeddings providers
• Added Build5Nines.OpenAI.IOpenAIMemoryVectorDatabase interface

Fixed:

• Internal refactoring of save/load database persistence file code to make more maintainable and reusable going forward.
• Implement some performance tweaks in the code; adding const string and other best practices to help overall performance for handling larger amounts of data.

Full Changelog: v2.0.2...v2.0.4

Nuget

dotnet add package Build5Nines.SharpVector --version 2.0.4
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.3
dotnet add package Build5Nines.SharpVector.Ollama --version 2.0.3

v2.0.2

What's Changed:

Add:

• Add SerializeToBinaryStream and DeserializeFromBinaryStream methods to replace (and mark obselete) SerializeToJsonStream and DeserializeFromJsonStream methods. They read/write binary zip file data, not json, so they were named incorrectly.

Fixed:

• Fixed .LoadFromFile method that was previously inaccessible.

Nuget

dotnet add package Build5Nines.SharpVector --version 2.0.2
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.2

v2.0.1

Added:

• Expose internal vector array of VectorTextItem from VectorTextResultItem.Vectors property, to make vector array accessible for consuming code in cases where access is required. This is mostly for more flexible usage of the library.
• Added Overlapping Window text chunking (TextChunkingMethod.OverlappingWindow) to TextDataLoader for enhanced document segmentation with overlapping content, improving metadata extraction and search result relevance.

Fixed:

• When using Data.TextDataLoader with TextChunkingMethod.FixedLength it was splitting on a space character which wouldn't work correctly with Chinese text characters. This is now fixed to work correctly with Chinese characters too.

v2.0.0

What's Changed

Added:

• Add data persistence capability to save/load from a file or to/from a Stream (Both SharpVector and SharpVector.OpenAI)
• Add Chinese language/character support

Breaking Change:

• Refactor IVocabularyStore to be used within MemoryDictionaryVectorStoreWithVocabulary. This simplifies implementation of MemoryVectorDatabaseBase, and helps to enable data persistence capability.

Notes:

• The breaking change only applies if the base classes are being used. If the BasicMemoryVectorDatabase is being used, this will likely not break applications that depend on this library. However, in some instances where explicitly depending on VectorTextResult it's properties (without using var in consuming code) there might be minor code changes needed when migrating from previous versions of the library.

Nuget

dotnet add package Build5Nines.SharpVector --version 2.0.0
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.0

Full Changelog: v1.0.1...v2.0.0