A powerful terminal-based tool for intelligent URL filtering with multiple filtering strategies and colorful interface.
-
Keyword-based Filtering
- Filter URLs containing specified keywords
- Keep one unique URL per keyword while preserving non-matching URLs
- Case-sensitive keyword matching
-
Parameter-based Filtering
- Analyze URLs based on query parameters
- Keep one unique URL per parameter name
- Ignores parameter values for filtering
-
Parameter Value Filtering
- Search for keywords within parameter names/values
- Show URLs containing keywords in query parameters
- Full parameter content scanning
-
Parameter Presence Filtering
- Separate URLs with parameters from clean URLs
- Filter out all parameter-less URLs
Requirements:
- Python 3.6+
- Linux/macOS terminal (recommended)
- Windows: Use WSL/PowerShell with pygments
# Install required packages
pip install coloramapython3 url_filter_pro.py-
Efficiency: Process thousands of URLs in seconds
-
Precision: Multiple filtering strategies for different needs
-
Flexibility: Combine with other CLI tools (grep, awk, etc.)
-
Organization: Clean up URL lists for penetration testing
-
Audit: Identify tracking parameters in marketing URLs
-
Research: Analyze URL structures for web scraping
HAPPY HUNTING--🍃
