Arxiv Papers

This study examines Large Language Models' generalization strategies in reasoning tasks, revealing distinct data influences for factual versus reasoning questions, highlighting procedural knowledge's role in their reasoning processes. https://arxiv.org/abs//2411.12580 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:07:23

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models

Duration:00:23:08

[QA] Introducing Milabench: Benchmarking Accelerators for AI

Mila developed Milabench, a custom benchmarking suite for deep learning workloads in HPC, based on extensive research and community input, featuring 26 primary and 16 optional benchmarks. https://arxiv.org/abs//2411.11940 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:07:15

Introducing Milabench: Benchmarking Accelerators for AI

Duration:00:26:13

[QA] Does Prompt Formatting Have Any Impact on LLM Performance?

This paper investigates how different prompt templates impact the performance of Large Language Models, revealing significant variations in effectiveness, particularly in code translation tasks. https://arxiv.org/abs//2411.10541 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:06:49

Does Prompt Formatting Have Any Impact on LLM Performance?

Duration:00:09:14

[QA] Steering Language Model Refusal with Sparse Autoencoders

The paper explores using sparse autoencoders to steer language model activations for safer responses, improving refusal behavior while noting potential negative impacts on overall performance. https://arxiv.org/abs//2411.11296 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:07:45

Steering Language Model Refusal with Sparse Autoencoders

Duration:00:24:02

[QA] LLaVA-o1: Let Vision Language Models Reason Step-by-Step

11/17/2024

LLaVA-o1 is a novel Vision-Language Model that enhances reasoning in visual question-answering through structured multistage processes, outperforming larger models with fewer training samples. https://arxiv.org/abs//2411.10440 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:07:53

LLaVA-o1: Let Vision Language Models Reason Step-by-Step

11/17/2024

Duration:00:17:55

[QA] Refusal in LLMs is an Affine Function

The paper introduces affine concept editing (ACE) for controlling language model behavior through activation manipulation, demonstrating improved precision in managing refusal responses across various prompts. https://arxiv.org/abs//2411.09003 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:07:49

Refusal in LLMs is an Affine Function

Duration:00:08:52

[QA] Cut Your Losses in Large-Vocabulary Language Models

The paper introduces Cut Cross-Entropy (CCE), a method that significantly reduces memory usage during training of large language models by optimizing cross-entropy loss computation without sacrificing performance. https://arxiv.org/abs//2411.09009 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:08:00

Cut Your Losses in Large-Vocabulary Language Models

Duration:00:17:27

[QA] Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Models

Add-it is a training-free approach for semantic image editing that seamlessly integrates objects into images using a weighted extended-attention mechanism, achieving state-of-the-art results without fine-tuning. https://arxiv.org/abs//2411.07232 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:06:57

Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Models

Duration:00:19:23

[QA] Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models

The SPA framework enhances user experience by generating diverse, high-quality responses from foundation models using synthetic data and data attribution methods, improving performance in code generation and natural language tasks. https://arxiv.org/abs//2411.06722 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Duration:00:07:19

Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models