Fetching the paper…
Reading the bibliography…
Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning paradigms.
An algorithm for quadratic programming
Frank M, Wolfe P, others · 1956
Earlier work this paper cites.
Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation
Hansen N, Ostermeier A · 1996
Earlier work this paper cites.
Neural tangent kernel: Convergence and generalization in neural networks
Jacot A, Hongler C, Gabriel F · 2018
Earlier work this paper cites.
Glue: A multi-task benchmark and analysis platform for natural language understanding
Wang A, Singh A, Michael J, Hill F, Levy O, Bowman S R · 2018
Earlier work this paper cites.
BERT: pre-training of deep bidirectional transformers for language understanding
Devlin J, Chang M, Lee K, Toutanova K · 2019
Earlier work this paper cites.
Parameter-efficient transfer learning for NLP
Houlsby N, Giurgiu A, Jastrzebski S, Morrone B, Laroussilhe d Q, Gesmundo A, Attariyan M, Gelly S · 2019
Earlier work this paper cites.
Neural architecture search: A survey
Elsken T, Metzen J H, Hutter F · 2019
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V · 2019
Earlier work this paper cites.
Measuring massive multitask language understanding
Hendrycks D, Burns C, Basart S, Zou A, Mazeika M, Song D, Steinhardt J · 2020
Earlier work this paper cites.
The power of scale for parameter-efficient prompt tuning
Lester B, Al-Rfou R, Constant N · 2021
Earlier work this paper cites.
Intrinsic dimensionality explains the effectiveness of language model fine-tuning
Aghajanyan A, Gupta S, Zettlemoyer L · 2021
Earlier work this paper cites.
Compacter: Efficient low-rank hypercomplex adapter layers
Mahabadi R K, Henderson J, Ruder S · 2021
Earlier work this paper cites.
Bitfit: Simple parameter-efficient fine-tuning for transformer-based masked language-models
Zaken E B, Goldberg Y, Ravfogel S · 2022
Earlier work this paper cites.
Lora: Low-rank adaptation of large language models
Hu E J, Shen Y, Wallis P, Allen-Zhu Z, Li Y, Wang S, Wang L, Chen W · 2022
Earlier work this paper cites.
Valipour M, Rezagholizadeh M, Kobyzev I, Ghodsi A · 2022
Earlier work this paper cites.
Parameter-efficient finetuning of transformers for source code
Ayupov S, Chirkova N · 2022
Earlier work this paper cites.
Krona: Parameter efficient tuning with kronecker adapter
Edalati A, Tahaei M S, Kobyzev I, Nia V P, Clark J J, Rezagholizadeh M · 2022
Earlier work this paper cites.
Towards a unified view of parameter-efficient transfer learning
He J, Zhou C, Ma X, Berg-Kirkpatrick T, Neubig G · 2022
Earlier work this paper cites.
Sinkformers: Transformers with doubly stochastic attention
Sander M E, Ablin P, Blondel M, Peyré G · 2022
Earlier work this paper cites.
Differentially private low-rank adaptation of large language model using federated learning
Liu X Y, Zhu R, Zha D, Gao J, Zhong S, Qiu M · 2022
Earlier work this paper cites.
Palm: Scaling language modeling with pathways
Chowdhery A, Narang S, Devlin J, Bosma M, Mishra G, Roberts A, Barham P, Chung H W, Sutton C, Gehrmann S, Schuh P, Shi K, Tsvyashchenko S, Maynez J, Rao A, Barnes P, Tay Y, Shazeer N, Prabhakaran V, Reif E, Du N, Hutchinson B, Pope R, Bradbury J, Austin J, Isard M, Gur-Ari G, Yin P, Duke T, Levskaya A, Ghemawat S, Dev S, Michalewski H, Garcia X, Misra V, Robinson K, Fedus L, Zhou D, Ippolito D, Luan D, Lim H, Zoph B, Spiridonov A, Sepassi R, Dohan D, Agrawal S, Omernick M, Dai A M, Pillai T S, Pellat M, Lewkowycz A, Moreira E, Child R, Polozov O, Lee K, Zhou Z, Wang X, Saeta B, Diaz M, Firat O, Catasta M, Wei J, Meier-Hellstern K, Eck D, Dean J, Petrov S, Fiedel N · 2023
Earlier work this paper cites.
Longlora: Efficient fine-tuning of long-context large language models
Chen Y, Qian S, Tang H, Lai X, Liu Z, Han S, Jia J · 2023
Earlier work this paper cites.
Parameter-efficient fine-tuning of large-scale pre-trained language models
Ding N, Qin Y, Yang G, Wei F, Yang Z, Su Y, Hu S, Chen Y, Chan C, Chen W, Yi J, Zhao W, Wang X, Liu Z, Zheng H, Chen J, Liu Y, Tang J, Li J, Sun M · 2023
Earlier work this paper cites.
A survey of large language models
Zhao W X, Zhou K, Li J, Tang T, Wang X, Hou Y, Min Y, Zhang B, Zhang J, Dong Z, others · 2023
Earlier work this paper cites.
A kernel-based view of language model fine-tuning
Malladi S, Wettig A, Yu D, Chen D, Arora S · 2023
Earlier work this paper cites.
The expressive power of low-rank adaptation
Zeng Y, Lee K · 2023
Earlier work this paper cites.
Relora: High-rank training through low-rank updates
Lialin V, Muckatira S, Shivagunde N, Rumshisky A · 2023
Earlier work this paper cites.
Sinklora: Enhanced efficiency and chat capabilities for long-context large language models
Zhang H · 2023
Earlier work this paper cites.
Delta-lora: Fine-tuning high-rank parameters with the delta of low-rank matrices
Zi B, Qi X, Wang L, Wang J, Wong K, Zhang L · 2023
Earlier work this paper cites.
Adaptive budget allocation for parameter-efficient fine-tuning
Zhang Q, Chen M, Bukharin A, He P, Cheng Y, Chen W, Zhao T · 2023
Earlier work this paper cites.
Structure-aware low-rank adaptation for parameter-efficient fine-tuning
Hu Y, Xie Y, Wang T, Chen M, Pan Z · 2023
Earlier work this paper cites.
Increlora: Incremental parameter allocation method for parameter-efficient fine-tuning
Zhang F, Li L, Chen J, Jiang Z, Wang B, Qian Y · 2023
Earlier work this paper cites.
Sparse low-rank adaptation of pre-trained language models
Ding N, Lv X, Wang Q, Chen Y, Zhou B, Liu Z, Sun M · 2023
Earlier work this paper cites.
Bayesian low-rank adaptation for large language models
Yang A X, Robeyns M, Wang X, Aitchison L · 2023
Earlier work this paper cites.
PILLOW: enhancing efficient instruction fine-tuning via prompt matching
Qi Z, Tan X, Shi S, Qu C, Xu Y, Qi Y · 2023
Earlier work this paper cites.
Lora ensembles for large language model fine-tuning
Wang X, Aitchison L, Rudolph M · 2023
Earlier work this paper cites.
Construct-vl: Data-free continual structured VL concepts learning
Smith J S, Cascante-Bonilla P, Arbelle A, Kim D, Panda R, Cox D D, Yang D, Kira Z, Feris R, Karlinsky L · 2023
Earlier work this paper cites.
To be or not to be? an exploration of continuously controllable prompt engineering
Sun Y, Li M, Cao Y, Wang K, Wang W, Zeng X, Zhao R · 2023
Earlier work this paper cites.
Composing parameter-efficient modules with arithmetic operations
Zhang J, Chen S, Liu J, He J · 2023
Earlier work this paper cites.
Task arithmetic with lora for continual learning
Chitale R, Vaidya A, Kane A, Ghotkar A · 2023
Earlier work this paper cites.
Token-level adaptation of lora adapters for downstream task generalization
Belofsky J · 2023
Earlier work this paper cites.
Effective and parameter-efficient reusing fine-tuned models
Jiang W, Lin B, Shi H, Zhang Y, Li Z, Kwok J T · 2023
Earlier work this paper cites.
Lorahub: Efficient cross-task generalization via dynamic lora composition
Huang C, Liu Q, Lin B Y, Pang T, Du C, Lin M · 2023
Earlier work this paper cites.
Compeft: Compression for communicating parameter efficient updates via sparsification and quantization
Yadav P, Choshen L, Raffel C, Bansal M · 2023
Earlier work this paper cites.
Parameter efficient multi-task model fusion with partial linearization
Tang A, Shen L, Luo Y, Zhan Y, Hu H, Du B, Chen Y, Tao D · 2023
Earlier work this paper cites.
Loramoe: Alleviate world knowledge forgetting in large language models via moe-style plugin
Dou S, Zhou E, Liu Y, Gao S, Zhao J, Shen W, Zhou Y, Xi Z, Wang X, Fan X, Pu S, Zhu J, Zheng R, Gui T, Zhang Q, Huang X · 2023
Earlier work this paper cites.
Mixture of cluster-conditional lora experts for vision-language instruction tuning
Gou Y, Liu Z, Chen K, Hong L, Xu H, Li A, Yeung D, Kwok J T, Zhang Y · 2023
Earlier work this paper cites.
Moelora: An moe-based parameter efficient fine-tuning method for multi-task medical applications
Liu Q, Wu X, Zhao X, Zhu Y, Xu D, Tian F, Zheng Y · 2023
Earlier work this paper cites.
Multilora: Democratizing lora for better multi-task learning
Wang Y, Lin Y, Zeng X, Zhang G · 2023
Earlier work this paper cites.
Sira: Sparse mixture of low rank adaptation
Zhu Y, Wichers N, Lin C, Wang X, Chen T, Shu L, Lu H, Liu C, Luo L, Chen J, Meng L · 2023
Earlier work this paper cites.
Octavius: Mitigating task interference in mllms via moe
Chen Z, Wang Z, Wang Z, Liu H, Yin Z, Liu S, Sheng L, Ouyang W, Qiao Y, Shao J · 2023
Earlier work this paper cites.
Batched low-rank adaptation of foundation models
Wen Y, Chaudhuri S · 2023
Earlier work this paper cites.
Lora-fa: Memory-efficient low-rank adaptation for large language models fine-tuning
Zhang L, Zhang L, Shi S, Chu X, Li B · 2023
Earlier work this paper cites.
Loraprune: Pruning meets low-rank parameter-efficient fine-tuning
Zhang M, Chen H, Shen C, Yang Z, Ou L, Yu X, Zhuang B · 2023
Earlier work this paper cites.
Lorashear: Efficient large language model structured pruning and knowledge recovery
Chen T, Ding T, Yadav B, Zharkov I, Liang L · 2023
Earlier work this paper cites.
Parameter-efficient fine-tuning with layer pruning on free-text sequence-to-sequence modeling
Zhu Y, Yang X, Wu Y, Zhang W · 2023
Earlier work this paper cites.
Vera: Vector-based random matrix adaptation
Kopiczko D J, Blankevoort T, Asano Y M · 2023
Earlier work this paper cites.
Qa-lora: Quantization-aware low-rank adaptation of large language models
Xu Y, Xie L, Gu X, Chen X, Chang H, Zhang H, Chen Z, Zhang X, Tian Q · 2023
Earlier work this paper cites.
Loftq: Lora-fine-tuning-aware quantization for large language models
Li Y, Yu Y, Liang C, He P, Karampatziakis N, Chen W, Zhao T · 2023
Earlier work this paper cites.
Aspen: High-throughput lora fine-tuning of large language models with a single gpu
Ye Z, Li D, Tian J, Lan T, Zuo J, Duan L, Lu H, Jiang Y, Sha J, Zhang K, Tang M · 2023
Earlier work this paper cites.
S-lora: Serving thousands of concurrent lora adapters
Sheng Y, Cao S, Li D, Hooper C, Lee N, Yang S, Chou C, Zhu B, Zheng L, Keutzer K, others · 2023
Earlier work this paper cites.
SLoRA: Federated parameter efficient fine-tuning of language models
Babakniya S, Elkordy A R, Ezzeldin Y H, Liu Q, Song K, El-Khamy M, Avestimehr S · 2023
Earlier work this paper cites.
FedMS: Federated learning with mixture of sparsely activated foundations models
Wu P, Li K, Wang T, Wang F · 2023
Earlier work this paper cites.
Heterogeneous loRA for federated fine-tuning of on-device foundation models
Cho Y J, Liu L, Xu Z, Fahrezi A, Barnes M, Joshi G · 2023
Earlier work this paper cites.
pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
Yi L, Yu H, Wang G, Liu X, Li X · 2023
Earlier work this paper cites.
PrivateLoRA for efficient privacy preserving LLM
Wang Y, Lin Y, Zeng X, Zhang G · 2023
Earlier work this paper cites.
Label supervised llama finetuning
Li Z, Li X, Liu Y, Xie H, Li J, Wang F L, Li Q, Zhong X · 2023
Earlier work this paper cites.
Steering large language models for machine translation with finetuning and in-context learning
Alves D M, Guerreiro N M, Alves J, Pombal J, Rei R, Souza d J G C, Colombo P, Martins A F T · 2023
Earlier work this paper cites.
Assessing translation capabilities of large language models involving english and indian languages
Mujadia V, Urlana A, Bhaskar Y, Pavani P A, Shravya K, Krishnamurthy P, Sharma D M · 2023
Earlier work this paper cites.
Repairllama: Efficient representations and fine-tuned adapters for program repair
Silva A, Fang S, Monperrus M · 2023
Earlier work this paper cites.
Stelocoder: a decoder-only LLM for multi-language to python code translation
Pan J, Sadé A, Kim J, Soriano E, Sole G, Flamant S · 2023
Earlier work this paper cites.
Efficient RLHF: reducing the memory usage of PPO
Santacroce M, Lu Y, Yu H, Li Y, Shen Y · 2023
Earlier work this paper cites.
Sun S, Gupta D, Iyyer M · 2023
Cited alongside, same era.
Bayesian low-rank adaptation for large language models
Yang A X, Robeyns M, Wang X, Aitchison L · 2023
Cited alongside, same era.
Bioinstruct: Instruction tuning of large language models for biomedical natural language processing
Tran H, Yang Z, Yao Z, Yu H · 2023
Cited alongside, same era.
Parameter-efficient fine-tuning of llama for the clinical domain
Gema A P, Daines L, Minervini P, Alex B · 2023
Cited alongside, same era.
Does combining parameter-efficient modules improve few-shot transfer accuracy?
Asadi N, Beitollahi M, Khalil Y H, Li Y, Zhang G, Chen X · 2024
Closest in time.
Multimodal instruction tuning with conditional mixture of lora
Shen Y, Xu Z, Wang Q, Cheng Y, Yin W, Huang L · 2024
Closest in time.
X-lora: Mixture of low-rank adapter experts, a flexible framework for large language models with applications in protein mechanics and design
Buehler E L, Buehler M J · 2024
Closest in time.
Moral: Moe augmented lora for llms’ lifelong learning
Yang S, Ali M A, Wang C, Hu L, Wang D · 2024
Closest in time.
Mixture-of-loras: An efficient multitask tuning method for large language models
Feng W, Hao C, Zhang Y, Han Y, Wang H · 2024
Closest in time.
Multi-task dense prediction via mixture of low-rank experts
Yang Y, Jiang P, Hou Q, Zhang H, Chen J, Li B · 2024
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Toma A, Lawler P R, Ba J, Krishnan R G, Rubin B B, Wang B · 2023
Cited alongside, same era.
Suryakiran at mediqa-sum 2023: Leveraging lora for clinical dialogue summarization
Suri K, Mishra P, Saha S, Singh A · 2023
Cited alongside, same era.
Ivygpt: Interactive chinese pathway language model in medical domain
Wang R, Duan Y, Lam C, Chen J, Xu J, Chen H, Liu X, Pang P C, Tan T · 2023
Cited alongside, same era.
SM70: A large language model for medical devices
Bhatti A, Parmar S, Lee S · 2023
Cited alongside, same era.
Financial news analytics using fine-tuned llama 2 GPT model
Pavlyshenko B M · 2023
Cited alongside, same era.
Fingpt: Democratizing internet-scale data for financial large language models
Liu X, Wang G, Zha D · 2023
Cited alongside, same era.
Facechain: A playground for human-centric artificial intelligence generated content
Liu Y, Yu C, Shang L, He Y, Wu Z, Wang X, Xu C, Xie H, Wang W, Zhao Y, Zhu L, Cheng C, Chen W, Yao Y, Zhou W, Xu J, Wang Q, Chen Y, Xie X, Sun B · 2023
Cited alongside, same era.
Calliffusion: Chinese calligraphy generation and style transfer with diffusion modeling
Liao Q, Xia G, Wang Z · 2023
Cited alongside, same era.
Closest in time.
Mtlora: Low-rank adaptation approach for efficient multi-task learning
Agiza A R SN. M · 2024
Closest in time.
Higher layers need more lora experts
Gao C, Chen K, Rao J, Sun B, Liu R, Peng D, Zhang Y, Guo X, Yang J, Subrahmanian V S · 2024
Closest in time.
Llava-mole: Sparse mixture of lora experts for mitigating data conflicts in instruction finetuning mllms
Chen S, Jie Z, Ma L · 2024
Closest in time.
Mixture-of-subspaces in low-rank adaptation
Wu T, Wang J, Zhao Z, Wong N · 2024
Closest in time.
Lora-sp: streamlined partial parameter adaptation for resource efficient fine-tuning of large language models
Wu Y, Xiang Y, Huo S, Gong Y, Liang P · 2024
Closest in time.
Aflora: Adaptive freezing of low rank adaptation in parameter efficient fine-tuning of large models
Liu Z, Kundu S, Li A, Wan J, Jiang L, Beerel P A · 2024
Closest in time.
Dropbp: Accelerating fine-tuning of large language models by dropping backward propagation
Woo S, Park B, Kim B, Jo M, Kwon S, Jeon D, Lee D · 2024
Closest in time.
Lora-xs: Low-rank adaptation with extremely small number of parameters
Bałazy K, Banaei M, Aberer K, Tabor J · 2024
Closest in time.
Lora-drop: Efficient lora parameter pruning based on output evaluation
Zhou H, Lu X, Xu W, Zhu C, Zhao T · 2024
Closest in time.
Vb-lora: Extreme parameter efficient fine-tuning with vector banks
Li Y, Han S, Ji S · 2024
Closest in time.
Parameter-efficient fine-tuning with discrete fourier transform
Gao Z, Wang Q, Chen A, Liu Z, Wu B, Chen L, Li J · 2024
Closest in time.
Qlora: Efficient finetuning of quantized llms
Dettmers T, Pagnoni A, Holtzman A, Zettlemoyer L · 2024
Closest in time.
Apiq: Finetuning of 2-bit quantized large language model
Liao B, Monz C · 2024
Closest in time.
L4q: Parameter efficient quantization-aware training on large language models via lora-wise lsq
Jeon H, Kim Y, Kim J j · 2024
Closest in time.
Punica: Multi-tenant lora serving
Chen L, Ye Z, Wu Y, Zhuo D, Ceze L, Krishnamurthy A · 2024
Closest in time.
Caraserve: Cpu-assisted and rank-aware lora serving for generative llm inference
Li S, Lu H, Wu T, Yu M, Weng Q, Chen X, Shan Y, Yuan B, Wang W · 2024
Closest in time.
Yan Y, Tang S, Shi Z, Yang Q · 2024
Closest in time.
Improving LoRA in privacy-preserving federated learning
Sun Y, Li Z, Li Y, Ding B · 2024
Closest in time.
Bai J, Chen D, Qian B, Yao L, Li Y · 2024
Closest in time.
A fast, performant, secure distributed training framework for large language model
Huang W, Wang Y, Cheng A, Zhou A, Yu C, Wang L · 2024
Closest in time.
Zhang Y, Wang M, Wu Y, Tiwari P, Li Q, Wang B, Qin J · 2024
Closest in time.
Speaker attribution in german parliamentary debates with qlora-adapted large language models
Bornheim T, Grieger N, Blaneck P G, Bialonski S · 2024
Closest in time.
Autore: Document-level relation extraction with large language models
Xue L, Zhang D, Dong Y, Tang J · 2024
Closest in time.
Fine-tuning large language models for domain-specific machine translation
Zheng J, Hong H, Wang X, Su J, Liang Y, Wu S · 2024
Closest in time.
Personalized lora for human-centered text understanding
Zhang Y, Wang J, Yu L, Xu D, Zhang X · 2024
Closest in time.
Y-tuning: An efficient tuning paradigm for large-scale pre-trained models via label representation learning
Liu Y, An C, Qiu X · 2024
Closest in time.
Delving into parameter-efficient fine-tuning in code change learning: An empirical study
Liu S, Keung J, Yang Z, Liu F, Zhou Q, Liao Y · 2024
Closest in time.
An empirical study on jit defect prediction based on bert-style model
Guo Y, Gao X, Jiang B · 2024
Closest in time.
Analyzing the effectiveness of large language models on text-to-sql synthesis
Roberson R, Kaki G, Trivedi A · 2024
Closest in time.
Perl:parameter efficient reinforcement learning from human feedback
Sidahmed H, Phatale S, Hutcheson A, Lin Z, Chen Z, Yu Z, Jin J, Komarytsia R, Ahlheim C, Zhu Y, Chaudhary S, Li B, Ganesh S, Byrne B, Hoffmann J, Mansoor H, Li W, Rastogi A, Dixon L · 2024
Closest in time.
Dmoerm: Recipes of mixture-of-experts for effective reward modeling
Quan S · 2024
Closest in time.
Improving reinforcement learning from human feedback with efficient reward model ensemble
Zhang S, Chen Z, Chen S, Shen Y, Sun Z, Gan C · 2024
Closest in time.
Uncertainty-penalized reinforcement learning from human feedback with diverse reward lora ensembles
Zhai Y, Zhang H, Lei Y, Yu Y, Xu K, Feng D, Ding B, Wang H · 2024
Closest in time.
Bayesian reward models for LLM alignment
Yang A X, Robeyns M, Coste T, Wang J, Bou-Ammar H, Aitchison L · 2024
Closest in time.
Assertion detection large language model in-context learning lora fine-tuning
Ji Y, Yu Z, Wang Y · 2024
Closest in time.
Finllama: Financial sentiment classification for algorithmic trading applications
Konstantinidis T, Iacovides G, Xu M, Constantinides T G, Mandic D P · 2024
Closest in time.
Ra-cfgpt: Chinese financial assistant with retrieval-augmented large language model
Li J, Lei Y, Bian Y, Cheng D, Ding Z, Jiang C · 2024
Closest in time.
Db-gpt: Large language model meets database
Zhou X, Sun Z, Li G · 2024
Closest in time.
Diffstyler: Diffusion-based localized image style transfer
Li S · 2024
Closest in time.
Implicit style-content separation using b-lora
Frenkel Y, Vinker Y, Shamir A, Cohen-Or D · 2024
Closest in time.
Li L, Zeng H, Yang C, Jia H, Xu D · 2024
Closest in time.
OMG: occlusion-friendly personalized multi-concept generation in diffusion models
Kong Z, Zhang Y, Yang T, Wang T, Zhang K, Wu B, Chen G, Liu W, Luo W · 2024
Closest in time.
Customizing 360-degree panoramas through text-to-image diffusion models
Wang H, Xiang X, Fan Y, Xue J · 2024
Closest in time.
Resadapter: Domain consistent resolution adapter for diffusion models
Cheng J, Xie P, Xia X, Li J, Wu J, Ren Y, Li H, Xiao X, Zheng M, Fu L · 2024
Closest in time.
Continual diffusion with stamina: Stack-and-mask incremental adapters
Smith J S, Hsu Y C, Kira Z, Shen Y, Jin H · 2024
Closest in time.
Customize-a-video: One-shot motion customization of text-to-video diffusion models
Ren Y, Zhou Y, Yang J, Shi J, Liu D, Liu F, Kwon M, Shrivastava A · 2024
Closest in time.
As-plausible-as-possible: Plausibility-aware mesh deformation using 2d diffusion priors
Yoo S, Kim K, Kim V G, Sung M · 2024
Closest in time.
Dragtex: Generative point-based texture editing on 3d mesh
Zhang Y, Xu Q, Zhang L · 2024
Closest in time.
Samlp: A customized segment anything model for license plate detection
Ding H, Gao J, Yuan Y, Wang Q · 2024
Closest in time.
Sam-based instance segmentation models for the automation of structural damage detection
Ye Z, Lovell L, Faramarzi A, Ninic J · 2024
Closest in time.
Segment any cell: A sam-based auto-prompting fine-tuning framework for nuclei segmentation
Na S, Guo Y, Jiang F, Ma H, Huang J · 2024
Closest in time.
Tracking meets lora: Faster training, larger model, stronger performance
Lin L, Fan H, Zhang Z, Wang Y, Xu Y, Ling H · 2024
Closest in time.
Dong X, Zhang P, Zang Y, Cao Y, Wang B, Ouyang L, Wei X, Zhang S, Duan H, Cao M, Zhang W, Li Y, Yan H, Gao Y, Zhang X, Li W, Li J, Chen K, He C, Zhang X, Qiao Y, Lin D, Wang J · 2024
Closest in time.
Collavo: Crayon large language and vision model
Lee B, Park B, Kim C W, Ro Y M · 2024
Closest in time.
Yeo J H, Han S, Kim M, Ro Y M · 2024
Closest in time.
TPLLM: A traffic prediction framework based on pretrained large language models
Ren Y, Chen Y, Liu S, Wang B, Yu H, Cui Z · 2024
Closest in time.
Fomenko V, Yu H, Lee J, Hsieh S, Chen W · 2024
Closest in time.
Lotr: Low tensor rank weight adaptation
Bershatsky D, Cherniuk D, Daulbaev T, Mikhalev A, Oseledets I V · 2024
Closest in time.
Analyzing and reducing catastrophic forgetting in parameter efficient tuning
Ren W, Li X, Wang L, Zhao T, Qin W · 2024
Closest in time.
Galore: Memory-efficient LLM training by gradient low-rank projection
Zhao J, Zhang Z, Chen B, Wang Z, Anandkumar A, Tian Y · 2024
Closest in time.
Lora learns less and forgets less
Biderman D, Ortiz J J G, Portes J, Paul M, Greengard P, Jennings C, King D, Havens S, Chiley V, Frankle J, Blakeney C, Cunningham J P · 2024
Closest in time.
Sltrain: a sparse plus low-rank approach for parameter and memory efficient pretraining
Han A, Li J, Huang W, Hong M, Takeda A, Jawanpuria P, Mishra B · 2024
Closest in time.
ELRT: efficient low-rank training for compact convolutional neural networks
Sui Y, Yin M, Gong Y, Xiao J, Phan H, Yuan B · 2024
Closest in time.
Periodiclora: Breaking the low-rank bottleneck in lora optimization
Meng X, Dai D, Luo W, Yang Z, Wu S, Wang X, Wang P, Dong Q, Chen L, Sui Z · 2024
Closest in time.
Tied-lora: Enhancing parameter efficiency of lora with weight tying
Renduchintala A, Konuk T, Kuchaiev O · 2024
Closest in time.
Heterogeneous federated learning: State-of-the-art and research challenges
Ye M, Fang X, Du B, Yuen P C, Tao D · 2024
Closest in time.