0.5.0
0.5.0 (2025-01-02)
🚀 Features
- Add possibility to use None as no proxy in tiered proxies (#760) (0fbd017) by @Pijukatel
- Add
use_state
context method (#682) (868b41e) by @Mantisus - Add pre-navigation hooks router to AbstractHttpCrawler (#791) (0f23205) by @Pijukatel
- Add example of how to integrate Camoufox into PlaywrightCrawler (#789) (246cfc4) by @Pijukatel
- Expose event types, improve on/emit signature, allow parameterless listeners (#800) (c102c4c) by @janbuchar
- Add stop method to BasicCrawler (#807) (6d01af4) by @Pijukatel
- Add
html_to_text
helper function (#792) (2b9d970) by @Pijukatel - [breaking] Implement
RequestManagerTandem
, removeadd_request
fromRequestList
, accept any iterable inRequestList
constructor (#777) (4172652) by @janbuchar
🐛 Bug Fixes
- Fix circular import in
KeyValueStore
(#805) (8bdf49d) by @Mantisus - [breaking] Refactor service usage to rely on
service_locator
(#691) (1d31c6c) by @vdusek - Pass
verify
in httpx client (#802) (074d083) by @Mantisus - Fix
page_options
forPlaywrightBrowserPlugin
(#796) (bd3bdd4) by @Mantisus - Fix event migrating handler in
RequestQueue
(#825) (fd6663f) by @Mantisus - Respect user configuration for work with status codes (#812) (8daf4bd) by @Mantisus
abort-on-error
for successive runs (#834) (0cea673) by @Mantisus- Relax ServiceLocator restrictions (#837) (aa3667f) by @janbuchar
- Fix typo in exports (#841) (8fa6ac9) by @janbuchar
Refactor
- [breaking] Refactor HttpCrawler, BeautifulSoupCrawler, ParselCrawler inheritance (#746) (9d3c269) by @Pijukatel
- [breaking] Remove
json_
andorder_no
fromRequest
(#788) (5381d13) by @Mantisus - [breaking] Rename PwPreNavContext to PwPreNavCrawlingContext (#827) (84b61a3) by @vdusek
- [breaking] Rename PlaywrightCrawler kwargs: browser_options, page_options (#831) (ffc6048) by @Pijukatel
- [breaking] Update the crawlers & storage clients structure (#828) (0ba04d1) by @vdusek