Efficient Attention Mechanisms for Vision Transformers on Edge Devices
Alex Chen, Sarah Zhang, Michael Roberts
We propose a novel sparse attention mechanism that reduces computational complexity while maintaining accuracy for vision transformers deployed on edge devices.
Multimodal Learning with Cross-Attention Fusion
Alex Chen, Emily Wang
A new approach to multimodal learning that uses cross-attention mechanisms to effectively fuse information from text, images, and structured data.
LoRA-XL: Scaling Low-Rank Adaptation for Very Large Language Models
Alex Chen, David Liu, Jennifer Kim
We extend LoRA to efficiently fine-tune models with 100B+ parameters using a hierarchical low-rank decomposition approach.
Real-time Object Detection: A Survey of Modern Approaches
Alex Chen
A comprehensive survey of real-time object detection methods, covering architectures, optimization techniques, and deployment strategies.