Releases · S4M8/intel-extractor

@S4M8

Intel Extractor: v0.2.4 - Cross-Platform Browser Compatibility and Citizen Record Capture

Cross-Platform Browser Support: Introduced a dynamic browser executable path detection mechanism that supports Windows, Linux, and macOS operating systems.
Citizen Record Extraction: Added capability to capture and store unique Citizen Record numbers during organization member profile scraping.
Database Schema Update: Introduced a new citizenRecord column in the SQLite database to persistently store Citizen Record information.

Efficient Scraping: The scraping strategy has been revamped to directly target the Star Citizen API, eliminating the need to scroll through the DOM. This translates to faster and more reliable data extraction.
Organization Verification: The tool now includes functions to verify the existence of an organization before proceeding with data collection.
Pagination Handling: Intel Extractor can now determine the number of pages required to scrape all member dossiers within an organization, ensuring comprehensive data capture.
Detailed Citizen Data: Extracted information now includes not just basic details like name and handle, but also location and fluency information from individual member profiles (optional).
SQLite Database Integration: Scraped data is now stored in a centralized SQLite database, facilitating easier management and analysis.
Separate CSV Export: While data is stored in the database, a separate CSV file containing all scanned member URLs is still generated for reference.

Full Changelog: https://github.com/neon-nomad/intel-extractor/commits/v0.2.3