Fetching the paper…

Reading the bibliography…

2023

Thistle: A Vector Database in Rust

Windsor, Brad, Choi, Kevin

Original
PDF
Post on X

Understand

We present Thistle, a fully functional vector database.

Thistle is an entry into the domain of latent knowledge use in answering search queries, an ongoing research topic at both start-ups and search engine companies.
We implement Thistle with several well-known algorithms, and benchmark results on the MS MARCO dataset.
Results help clarify the latent knowledge domain as well as the growing Rust ML ecosystem.

Thistle: A Vector Database in Rust · Around

Built on

Okapi at trec-3
Stephen E Robertson, Steve Walker, Susan Jones, Micheline M Hancock-Beaulieu, Mike Gatford, et al. 1995 · 1995
Earlier work this paper cites.
word2vec explained: deriving mikolov et al.’s negative-sampling word-embedding method
Original
Yoav Goldberg and Omer Levy. 2014 · 2014
Earlier work this paper cites.
The rust language
Nicholas D Matsakis and Felix S Klock II. 2014 · 2014
Earlier work this paper cites.

Similar

Wikidata: a free collaborative knowledgebase
Original
Denny Vrandečić and Markus Krötzsch. 2014 · 2014
Cited alongside, same era.
Ms marco: A human generated machine reading comprehension dataset
Original
Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, Mir Rosenberg, Xia Song, Alina Stoica, Saurabh Tiwary, and Tong Wang. 2018 · 2018
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Original
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Cited alongside, same era.
Which programming language is fastest?
Cited in the paper.

Then

Deep contextualized word representations
Original
Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018
Later among the works it cites.
Understanding searches better than ever before
Pandu Nayak. 2019 · 2019
Later among the works it cites.
Sentence-bert: Sentence embeddings using siamese bert-networks
Original
Nils Reimers and Iryna Gurevych. 2019 · 2019
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…