Fetching the paper…
Reading the bibliography…
Current protein language models (PLMs) learn protein representations mainly based on their sequences, thereby well capturing co-evolutionary information, but they are unable to explicitly acquire protein functions, which is the end goal of protein representation learning.
The low polarity of many membrane proteins
Capaldi, R. A. and Vanderkooi, G · 1972
Earlier work this paper cites.
Scop: a structural classification of proteins database for the investigation of sequences and structures
Murzin, A. G., Brenner, S. E., Hubbard, T., and Chothia, C · 1995
Earlier work this paper cites.
The swiss-prot protein sequence database and its supplement trembl in 2000
Bairoch, A. and Apweiler, R · 2000
Earlier work this paper cites.
Factors enhancing protein thermostability
Kumar, S., Tsai, C.-J., and Nussinov, R · 2000
Earlier work this paper cites.
Implications of protein flexibility for drug discovery
Teague, S. J · 2003
Earlier work this paper cites.
Correlation between gene expression profiles and protein–protein interactions within and across genomes
Bhardwaj, N. and Lu, H · 2005
Earlier work this paper cites.
Protein and amino acid requirements in human nutrition , volume 935
Organization, W. H. and University, U. N · 2007
Earlier work this paper cites.
Visualizing data using t-sne
Van der Maaten, L. and Hinton, G · 2008
Earlier work this paper cites.
Autodock vina: improving the speed and accuracy of docking with a new scoring function, efficient optimization, and multithreading
Trott, O. and Olson, A. J · 2010
Earlier work this paper cites.
Pubmed: the bibliographic database
Canese, K. and Weis, S · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2014
Earlier work this paper cites.
Deeploc: prediction of protein subcellular localization using deep learning
Almagro Armenteros, J. J., Sønderby, C. K., Sønderby, S. K., Nielsen, H., and Winther, O · 2017
Earlier work this paper cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017
Earlier work this paper cites.
Representation learning with contrastive predictive coding
Oord, A. v. d., Li, Y., and Vinyals, O · 2018
Earlier work this paper cites.
Clustering huge protein sequence sets in linear time
Steinegger, M. and Söding, J · 2018
Earlier work this paper cites.
Scibert: A pretrained language model for scientific text
Beltagy, I., Lo, K., and Cohan, A · 2019
Earlier work this paper cites.
Using deep learning to annotate the protein universe
Bileschi, M. L., Belanger, D., Bryant, D., Sanderson, T., Carter, B., Sculley, D., DePristo, M. A., and Colwell, L. J · 2019
Earlier work this paper cites.
Uniprot: a worldwide hub of protein knowledge
Consortium, U · 2019
Earlier work this paper cites.
Probing biomedical embeddings from language models
Jin, Q., Dhingra, B., Cohen, W. W., and Lu, X · 2019
Earlier work this paper cites.
Generalization through memorization: Nearest neighbor language models
Khandelwal, U., Levy, O., Jurafsky, D., Zettlemoyer, L., and Lewis, M · 2019
Cited alongside, same era.
Gemme: a simple and fast global epistatic model predicting mutational effects
Laine, E., Karami, Y., and Carbone, A · 2019
Cited alongside, same era.
Evaluating protein transfer learning with tape
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, P., Canny, J., Abbeel, P., and Song, Y · 2019
Cited alongside, same era.
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., and Hinton, G · 2020
Cited alongside, same era.
Splat: Speech-language joint pre-training for spoken language understanding
Chung, Y.-A., Zhu, C., and Zeng, M · 2020
Cited alongside, same era.
Text2mol: Cross-modal molecule retrieval with natural language queries
Edwards, C., Zhai, C., and Ji, H · 2021
Later among the works it cites.
Disease variant prediction with deep generative models of evolutionary data
Frazer, J., Notin, P., Dias, M., Gomez, A., Min, J. K., Brock, K., Gal, Y., and Marks, D. S · 2021
Later among the works it cites.
Structure-based protein function prediction using graph convolutional networks
Gligorijević, V., Renfrew, P. D., Kosciolek, T., Leman, J. K., Berenberg, D., Vatanen, T., Chandler, C., Taylor, B. C., Fisk, I. M., Vlamakis, H., et al · 2021
Later among the works it cites.
Domain-specific language model pretraining for biomedical natural language processing
Gu, Y., Tinn, R., Cheng, H., Lucas, M., Usuyama, N., Liu, X., Naumann, T., Gao, J., and Poon, H · 2021
Later among the works it cites.
Highly accurate protein structure prediction with alphafold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Elnaggar, A., Heinzinger, M., Dallago, C., Rihawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., Steinegger, M., et al · 2020
Cited alongside, same era.
Deciphering interaction fingerprints from protein molecular surfaces using geometric deep learning
Gainza, P., Sverrisson, F., Monti, F., Rodola, E., Boscaini, D., Bronstein, M., and Correia, B · 2020
Cited alongside, same era.
Momentum contrast for unsupervised visual representation learning
He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R · 2020
Cited alongside, same era.
Intrinsic-extrinsic convolution and pooling for learning on 3d protein structures
Hermosilla, P., Schäfer, M., Lang, M., Fackelmann, G., Vázquez, P. P., Kozlíková, B., Krone, M., Ritschel, T., and Ropinski, T · 2020
Cited alongside, same era.
Learning from protein structure with geometric vector perceptrons
Jing, B., Eismann, S., Suriana, P., Townshend, R. J., and Dror, R · 2020
Cited alongside, same era.
Biobert: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., and Kang, J · 2020
Cited alongside, same era.
Self-supervised contrastive learning of protein representations by mutual information maximization
Lu, A. X., Zhang, H., Ghassemi, M., and Moses, A. M · 2020
Cited alongside, same era.
Language models enable zero-shot prediction of the effects of mutations on protein function
Meier, J., Rao, R., Verkuil, R., Liu, J., Sercu, T., and Rives, A · 2021
Later among the works it cites.
Speech-language pre-training for end-to-end spoken language understanding
Qian, Y., Bianv, X., Shi, Y., Kanda, N., Shen, L., Xiao, Z., and Zeng, M · 2021
Later among the works it cites.
Learning transferable visual models from natural language supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al · 2021
Later among the works it cites.
Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al · 2021
Later among the works it cites.
Fast end-to-end learning on protein surfaces
Sverrisson, F., Feydy, J., Correia, B. E., and Bronstein, M. M · 2021
Later among the works it cites.
Videoclip: Contrastive pre-training for zero-shot video-text understanding
Xu, H., Ghosh, G., Huang, P.-Y., Okhonko, D., Aghajanyan, A., Metze, F., Zettlemoyer, L., and Feichtenhofer, C · 2021
Later among the works it cites.
Language models of protein sequences at the scale of evolution enable accurate structure prediction
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., dos Santos Costa, A., Fazel-Zarandi, M., Sercu, T., Candido, S., et al · 2022
Later among the works it cites.
Multi-modal molecule structure-text model for text-based retrieval and editing
Liu, S., Nie, W., Wang, C., Lu, J., Qiao, Z., Liu, L., Tang, J., Xiao, C., and Anandkumar, A · 2022
Later among the works it cites.
Embeddings from protein language models predict conservation and variant effects
Marquet, C., Heinzinger, M., Olenyi, T., Dallago, C., Erckert, K., Bernhofer, M., Nechaev, D., and Rost, B · 2022
Later among the works it cites.
Progen2: exploring the boundaries of protein language models
Nijkamp, E., Ruffolo, J., Weinstein, E. N., Naik, N., and Madani, A · 2022
Later among the works it cites.
Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval
Notin, P., Dias, M., Frazer, J., Hurtado, J. M., Gomez, A. N., Marks, D., and Gal, Y · 2022
Later among the works it cites.
Flava: A foundational language and vision alignment model
Singh, A., Hu, R., Goswami, V., Couairon, G., Galuba, W., Rohrbach, M., and Kiela, D · 2022
Later among the works it cites.
Torchdrug: A powerful and flexible machine learning platform for drug discovery
Zhu, Z., Shi, C., Zhang, Z., Liu, S., Xu, M., Yuan, X., Zhang, Y., Chen, J., Cai, H., Lu, J., et al · 2022
Later among the works it cites.
Zhang, Z., Xu, M., Lozano, A., Chenthamarakshan, V., Das, P., and Tang, J · 2023
Closest in time.