Fetching the paper…

Reading the bibliography…

2022

RuCLIP -- new models and experiments: a technical report

Shonenkov, Alex, Kuznetsov, Andrey, Dimitrov, Denis et al.

Original
PDF
Post on X

Understand

In the report we propose six new implementations of ruCLIP model trained on our 240M pairs.

The accuracy results are compared with original CLIP model with Ru-En translation (OPUS-MT) on 16 datasets from different domains.
Our best implementations outperform CLIP + OPUS-MT solution on most of the datasets in few-show and zero-shot tasks.
In the report we briefly describe the implementations and concentrate on the conducted experiments.

RuCLIP -- new models and experiments: a technical report · Around

Built on

“Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision”, 2021
Original
Chao Jia et al · 2021
Earlier work this paper cites.
“Combined Scaling for Zero-shot Transfer Learning”, 2021
Original
Hieu Pham et al · 2021
Earlier work this paper cites.

Similar

“Learning Transferable Visual Models From Natural Language Supervision”, 2021
Original
Alec Radford et al · 2021
Cited alongside, same era.

Then

“Zero-Shot Text-to-Image Generation”, 2021
Original
Aditya Ramesh et al · 2021
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…