Holy moly what a wild month it has been! The ticker keeps ticking on downloads and we’ve included our user top requests in this release. Are we missing something? Let us know!
API/Web Proxy Support
A proxy server can now be used as a gateway between crul and the internet for core Web ( open, requests, scrape, form) and API (api) commands. Proxy servers are a useful way to provide varying levels of functionality, security, and privacy depending on your use case, needs, or company policy.
Support for http, https, socks4, socks5 and pac proxies comes out of the box. Party at Crul’s - bring your own proxy!
Related Links: Proxy web page request || Proxy API request
Headless Browser Stealth
Remotely controlling a web browser leaves traces called browser fingerprints. Browser fingerprints can be used to distinguish a remotely controlled browser from a normal user controlled web browser.
By default, in Crul 1.1.0 ‘Browser Stealth’ mode is enabled, hiding the browser's remote control state by erasing the browser fingerprint that is associated with a non-human user.
Fetch ZIP Archives to Scan and Extract
ZIP archives can now be fetched (api command) with the ability to scan metadata and read/serialize specific files into tabular format.
New commands for HTML content extraction
The new parseHTMLTable command allows for simplified conversion of HTML tables into Crul’s tabular format. Easy to process and export as a csv! The new parseArticle command can turn web pages containing an article into a standardized data structure of article content, headline, author etc.
Related Links: HTML table extraction || HTML article extraction
And much much more...
Join our Community
We started up the Crul discord channel recently, come hang out and ask us any questions. Some of the features and fixes in this release come from your requests!
Crul’n IT,
Nic and Carl