ArXiv Search Plugin

A powerful Dify plugin for searching and retrieving scientific papers from the ArXiv repository. This plugin enables seamless integration of academic research capabilities into your AI applications.

🔬 What is ArXiv?

ArXiv is a free distribution service and open-access archive for scholarly articles in physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering, systems science, and economics. Founded in 1991, it hosts over 2 million research papers and is widely used by researchers worldwide.

✨ Features

• Comprehensive Search: Search by keywords, author names, or ArXiv IDs
• Rich Metadata: Returns publication dates, titles, authors, and abstracts
• Configurable Results: Customize the number of results and content length
• Error Handling: Robust error handling for API failures and edge cases
• AI-Powered Summaries: Automatic summarization of search results using Dify's model capabilities

🚀 Quick Start

Installation

1. From Plugin Marketplace (Recommended)

   • Navigate to the Dify Plugin Marketplace
   • Search for "ArXiv"
   • Click "Install" to add it to your workspace

2. Manual Installation

Basic Usage

Once installed, you can use the ArXiv plugin in three ways:

1. Agent Applications

Add the ArXiv tool to your Agent and interact naturally:

2. Chatflow Applications

Add an ArXiv tool node to your chatflow for automated research workflows.

3. Workflow Applications

Integrate ArXiv searches into complex automation pipelines.

📖 Usage Examples

Search by Keywords

Search by Author

Search by ArXiv ID

Advanced Search Queries

⚙️ Configuration

Plugin Parameters

Advanced Configuration (Code Level)

The class supports additional configuration:

🛠️ Development

Project Structure

Key Components

1. ArxivAPIWrapper ()

The core wrapper around the ArXiv API with features:

• Query validation and truncation
• Error handling for network issues
• Result formatting and content limiting
• Metadata extraction

2. ArxivSearchTool

Dify tool implementation that:

• Validates input parameters
• Invokes the ArXiv API wrapper
• Generates AI-powered summaries of results
• Returns formatted responses

Adding Custom Features

To extend the plugin functionality:

1. Modify Search Parameters

2. Add Custom Filtering

3. Enhance Output Format

🔧 API Reference

ArxivAPIWrapper Methods

Performs an ArXiv search and returns formatted results.

Parameters:

• : Search query string (max 300 characters)

Returns:

• Formatted string with paper details or error message

Example:

Error Handling

The plugin handles several error scenarios:

🧪 Testing

Manual Testing

1. Install the plugin in your Dify workspace
2. Create a simple Agent application
3. Add the ArXiv tool
4. Test with various query types:
   • Keywords: "neural networks"
   • Author: "Yann LeCun"
   • ArXiv ID: "1706.03762"

Unit Testing

🤝 Contributing

We welcome contributions! Here's how to get started:

1. Fork the Repository
2. Create a Feature Branch
3. Make Your Changes
4. Test Thoroughly
5. Submit a Pull Request

Contribution Guidelines

• Follow Python PEP 8 style guidelines
• Add docstrings to new functions
• Include tests for new features
• Update documentation as needed

📚 Resources

ArXiv Resources

• ArXiv.org - Official ArXiv website
• ArXiv API Documentation
• ArXiv Python Library - Official Python wrapper

Dify Resources

• Dify Documentation
• Plugin Development Guide
• Dify Community

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🐛 Troubleshooting

Common Issues

Issue: "No good Arxiv Result was found"

• Solution: Try different keywords, check spelling, or broaden your search terms

Issue: "Arxiv exception: HTTPError"

• Solution: Check internet connection or try again later (ArXiv may be temporarily unavailable)

Issue: Results are truncated

• Solution: Increase in the configuration

Issue: Tool not appearing in Dify

• Solution: Ensure plugin is properly installed and workspace is refreshed

Debug Mode

Enable debug logging for detailed error information:

📊 Performance Notes

• Rate Limits: ArXiv has rate limiting; avoid excessive concurrent requests
• Response Time: Searches typically take 1-3 seconds depending on query complexity
• Memory Usage: Plugin uses minimal memory (~1MB as configured)
• Content Limits: Results are truncated to prevent memory issues with large papers

🔄 Version History

• v0.0.2: Current version with enhanced error handling and AI summaries
• v0.0.1: Initial release with basic search capabilities