Fetching the paper…
Reading the bibliography…
Low-Rank Adaptation (LoRA) is a widely used technique for fine-tuning large pre-trained or foundational models across different modalities and tasks.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
The eICU Collaborative Research Database, a freely available multi-center database for critical care research
Tom J Pollard, Alistair EW Johnson, Jesse D Raffa, Leo A Celi, Roger G Mark, and Omar Badawi. 2018 · 2018
Earlier work this paper cites.
Parameter-efficient transfer learning for NLP
Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019 · 2019
Earlier work this paper cites.
Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer Learning
Zhaojiang Lin, Andrea Madotto, and Pascale Fung. 2020 · 2020
Earlier work this paper cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020
Earlier work this paper cites.
A transformer architecture for stress detection from ecg
Behnam Behinaein, Anubhav Bhatti, Dirk Rodenburg, Paul Hungler, and Ali Etemad. 2021 · 2021
Earlier work this paper cites.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al · 2021
Earlier work this paper cites.
Prediction of late-onset sepsis in preterm infants using monitoring signals and machine learning
Laura Cabrera-Quiros, Deedee Kommers, Maria K Wolvers, Laurien Oosterwijk, Niek Arents, Jacqueline van der Sluijs-Bens, Eduardus JE Cottaar, Peter Andriessen, and Carola van Pul. 2021 · 2021
Earlier work this paper cites.
LoRA: Low-Rank Adaptation of Large Language Models
Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al · 2021
Earlier work this paper cites.
AdapterDrop: On the Efficiency of Adapters in Transformers
Andreas Rücklé, Gregor Geigle, Max Glockner, Tilman Beck, Jonas Pfeiffer, Nils Reimers, and Iryna Gurevych. 2021 · 2021
Earlier work this paper cites.
Your Day in Your Pocket: Complex Activity Recognition from Smartphone Accelerometers
Emma Bouton-Bessac, Lakmal Meegahapola, and Daniel Gatica-Perez. 2022 · 2022
Earlier work this paper cites.
Three things everyone should know about vision transformers
Hugo Touvron, Matthieu Cord, Alaaeldin El-Nouby, Jakob Verbeek, and Hervé Jégou. 2022 · 2022
Cited alongside, same era.
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Elad Ben Zaken, Yoav Goldberg, and Shauli Ravfogel. 2022 · 2022
Cited alongside, same era.
Foundational models defining a new era in vision: A survey and outlook
Muhammad Awais, Muzammal Naseer, Salman Khan, Rao Muhammad Anwer, Hisham Cholakkal, Mubarak Shah, Ming-Hsuan Yang, and Fahad Shahbaz Khan. 2023 · 2023
Cited alongside, same era.
Interpreting forecasted vital signs using n-beats in sepsis patients
Anubhav Bhatti, Naveen Thangavelu, Marium Hassan, Choongmin Kim, San Lee, Yonghwan Kim, and Jang Yong Kim. 2023 · 2023
Cited alongside, same era.
Strong Baselines for Parameter-Efficient Few-Shot Fine-Tuning
Samyadeep Basu, Shell Hu, Daniela Massiceti, and Soheil Feizi. 2024 · 2024
Closest in time.
AttX: Attentive cross-connections for fusion of wearable signals in emotion recognition
Anubhav Bhatti, Behnam Behinaein, Paul Hungler, and Ali Etemad. 2024a · 2024
Closest in time.
Vital sign forecasting for sepsis patients in ICUs
Anubhav Bhatti, Yuwei Liu, Chen Dan, Bingjie Shen, San Lee, Yonghwan Kim, and Jang Yong Kim. 2024b · 2024
Closest in time.
Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunity
Raman Dutt, Linus Ericsson, Pedro Sanchez, Sotirios A Tsaftaris, and Timothy Hospedales. 2024 · 2024
Closest in time.
Large language models are zero-shot time series forecasters
Nate Gruver, Marc Finzi, Shikai Qiu, and Andrew G Wilson. 2024 · 2024
Closest in time.
AdvLoRA: Adversarial Low-Rank Adaptation of Vision-Language Models
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Azul Garza and Max Mergenthaler-Canseco. 2023 · 2023
Cited alongside, same era.
Remote Heart Rate Monitoring in Smart Environments from Videos with Self-supervised Pre-training
Divij Gupta and Ali Etemad. 2023 · 2023
Cited alongside, same era.
EEG-based Cognitive Load Classification using Feature Masked Autoencoding and Emotion Transfer Learning
Dustin Pulver, Prithila Angkan, Paul Hungler, and Ali Etemad. 2023 · 2023
Cited alongside, same era.
Lag-llama: Towards foundation models for time series forecasting
Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar, Marin Biloš, Hena Ghonia, Nadhir Vincent Hassen, Anderson Schneider, et al · 2023
Cited alongside, same era.
Llama: Open and efficient foundation language models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al · 2023
Cited alongside, same era.
Chronos: Learning the language of time series
Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Sundar Rangapuram, Sebastian Pineda Arango, Shubham Kapoor, et al · 2024
Cited alongside, same era.
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications
Charith Chandra Sai Balne, Sreyoshi Bhaduri, Tamoghna Roy, Vinija Jain, and Aman Chadha. 2024 · 2024
Cited alongside, same era.
Yuheng Ji, Yue Liu, Zhicheng Zhang, Zhao Zhang, Yuting Zhao, Gang Zhou, Xingwei Zhang, Xinwang Liu, and Xiaolong Zheng. 2024 · 2024
Closest in time.
GPT4MTS: Prompt-based Large Language Model for Multimodal Time-series Forecasting
Furong Jia, Kevin Wang, Yixiang Zheng, Defu Cao, and Yan Liu. 2024 · 2024
Closest in time.
Foundation and large language models: fundamentals, challenges, opportunities, and social impacts
Devon Myers, Rami Mohawesh, Venkata Ishwarya Chellaboina, Anantha Lakshmi Sathvik, Praveen Venkatesh, Yi-Hui Ho, Hanna Henshaw, Muna Alhawawreh, David Berdik, and Yaser Jararweh. 2024 · 2024
Closest in time.
An analysis of physiological and psychological responses in virtual reality and flat screen gaming
Ritik Vatsal, Shrivatsa Mishra, Rushil Thareja, Mrinmoy Chakrabarty, Ojaswa Sharma, and Jainendra Shukla. 2024 · 2024
Closest in time.
Unified training of universal time series forecasting transformers
Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, and Doyen Sahoo. 2024 · 2024
Closest in time.