Changelog

Changelog#

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unreleased]#

Changed#

  • Instead of evaluating with queries (vectors), evaluate with locations (integers) in the corpus. AxServiceOptimizer is responsible for performing retrieval.

v0.1.0 - 2024-02-12#

Added#

  • Factory methods.

  • Metrics to gain insights to how well the model and the corpus are performing.

  • Getting started guide.

Changed#

  • Organization of ensemble experiments. Added scripts for collection and visualization.

  • Miscellaneous bug fix and documentation.

v0.0.4 - 2024-02-05#

Added#

  • Glue dataset.

  • Support for embedding multiple columns in the storage.

  • Manager and Exam utility.

Changed#

  • Split language models abstractions into generative and classifiers.

  • Storage now supports retriving slices and list of indices.

v0.0.3 - 2024-01-24#

Added#

  • Website added.

  • LanguageModels support prediction via logits.

Changed#

  • Optimizers uses a generator like interface.

v0.0.2 - 2024-01-20#

Changed#

  • Decoupling of state into different components.

  • Evaluators renamed to Adaptors.

v0.0.1 - 2024-01-18#

Added#

  • Auto release to PyPI.

  • A few implementations for baselines.

Changed#

  • Index now support batch size != 1 and k != 1.

  • Batch size mandatary for Index, Embedders, LanguageModel, and Optimizer.

  • Visualization change.

v0.0.0 - 2024-01-10#

Added#

  • Index - Faiss, Hnswlib, Polar, Whitening.

  • Storage - Pandas, Datasets

  • Embedders - SentenceTransformers

  • Corpus - Composed

  • LanguageModel - Huggingface

  • Scores - BLEU (NLTK, SacreBLEU), Rouge (Rouge, RougeScore), Exact

  • Adaptor - BigBench

  • Optimizer - Ax / BoTorch, KMeans