Artificial Intelligence

Advancing LLM Reasoning Generalists with Preference Trees
We introduce Eurus, a suite of large language models (LLMs) optimized for reasoning. Finetuned from Mistral-7B and CodeLlama-70B, Eurus …
PDF 引用 代码
Advancing LLM Reasoning Generalists with Preference Trees
OpenPRM: Building Open-domain Process-based Reward Models with Preference Trees
Scaling inference-time computation is increasingly seen as the next frontier in scaling laws for large language models. Previous work …
PDF 引用 代码
OpenPRM: Building Open-domain Process-based Reward Models with Preference Trees
Towards AI-45^{\circ} Law: A Roadmap to Trustworthy AGI
Ensuring Artificial General Intelligence (AGI) reliably avoids harmful behaviors is a critical challenge, especially for systems with …
PDF 引用
Towards AI-45^{\circ} Law: A Roadmap to Trustworthy AGI
Automating exploratory proteomics research via language models.
With the development of artificial intelligence, its contribution to science is evolving from simulating a complex problem to …
PDF 引用
Automating exploratory proteomics research via language models.
Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines.
Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current …
PDF 引用 代码
Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines.
Empowering private tutoring by chaining large language models.
Artificial intelligence has been applied in various aspects of online education to facilitate teaching and learning. However, few …
PDF 引用 代码
Empowering private tutoring by chaining large language models.
Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices
As one of the most popular and sought-after generative models in the recent years, diffusion models have sparked the interests of many …
PDF 引用 代码
Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices
On the token distance modeling ability of higher RoPE attention dimension
Length extrapolation algorithms based on Rotary position embedding (RoPE) have shown promising results in extending the context length …
PDF 引用 代码
On the token distance modeling ability of higher RoPE attention dimension
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
Improving the effectiveness and efficiency of large language models (LLMs) simultaneously is a critical yet challenging research goal. …
PDF 引用 代码
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anything
Segmenting anything is a ground-breaking step toward artificial general intelligence, and the Segment Anything Model (SAM) greatly …
PDF 引用 代码
SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anything