Vec2Vec: A Compact Neural Network Approach for Transforming Text Embeddings with High Fidelity

Understand

Vector embeddings have become ubiquitous tools for many language-related tasks.

• A leading embedding model is OpenAI's text-ada-002 which can embed approximately 6,000 words into a 1,536-dimensional vector.
• While powerful, text-ada-002 is not open source and is only available via API.
• We trained a simple neural network to convert open-source 768-dimensional MPNet embeddings into text-ada-002 embeddings.