Web Scraper

Key Features:

• URL Input: Allows you to specify the web address you want to scrape.

• Optional CSS Selector: You can provide a CSS selector (e.g., p, h1, .product-name, #my-id) to target and extract specific elements from the webpage. If no selector is provided, it defaults to extracting all paragraphs and links.

• Custom User-Agent: You can set a custom User-Agent header for your requests, which can help in mimicking a regular web browser and potentially avoid some basic anti-scraping measures.

• Scraping and Display: Fetches the webpage content, extracts the data based on your settings, and displays it in a scrollable text area within the application.

• Error Handling: Includes basic error handling for network issues (e.g., URL not found, connection errors) and displays messages in the status bar and output area.

• Multi-format Export: Allows you to export the scraped data into three formats:

  • Text (.txt): A simple human-readable text file.

  • CSV (.csv): Structured data suitable for spreadsheets.

  • JSON (.json): Structured data suitable for programmatic consumption.

• Responsive GUI: The layout adjusts to some extent when the window is resized.

• Non-blocking UI: The scraping process runs in a separate thread, ensuring the GUI remains responsive while data is being fetched.