A powerful and user-friendly command-line interface tool for extracting web data and exporting it to CSV format. Built with Python, this tool provides an intuitive way to scrape web content with professional-grade features and error handling.
- User-friendly CLI Interface with rich formatting and progress indicators
- Robust Error Handling with comprehensive logging
- Data Preview capability with formatted tables
- Flexible CSS Selector support for precise data extraction
- CSV Export with automatic timestamp tracking
- Professional-grade Logging system
- URL Validation and sanitization
- Custom User-Agent handling
- Session Management for improved performance
- Python 3.8 or higher
- pip (Python package installer)
- Clone the repository:
git clone https://github.com/yourusername/web-scraper-cli.git
cd web-scraper-cli- Create a virtual environment:
python -m venv venv- Activate the virtual environment:
- On Windows:
venv\Scripts\activate
- On macOS/Linux:
source venv/bin/activate
- Install the required dependencies:
pip install -r requirements.txt