错误信息: 爬取任务失败: rakuten_nuts (https://item.rakuten.co.jp/nuts/cotopaxi-tasra16l/) - Page.title: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\rakuten_nuts_scraper.py", line 23, in parse_page
self.logger.debug(f"页面标题: {await page.title()}")
^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 9766, in title
return mapping.from_maybe_impl(await self._impl_obj.title())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 827, in title
return await self._main_frame.title()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 864, in title
return await self._channel.send("title", None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.title: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/batac16l) - Page.query_selector: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 24, in parse_page
product_list_div = await page.query_selector('div.fs-c-productList__list')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 8087, in query_selector
await self._impl_obj.query_selector(selector=selector, strict=strict)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 410, in query_selector
return await self._main_frame.query_selector(selector, strict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 348, in query_selector
await self._channel.send("querySelector", None, locals_to_params(locals()))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.query_selector: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/tasra) -
Traceback (most recent call last):
File "D:\workspace\cotopaxi\venv\Lib\site-packages\aiohttp\client_reqrep.py", line 539, in start
message, payload = await protocol.read() # type: ignore[union-attr]
^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\aiohttp\streams.py", line 680, in read
await self._waiter
asyncio.exceptions.CancelledError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 39, in parse_page
await self.send_task_exception_notification(self.task_config["name"], self.url)
File "D:\workspace\cotopaxi\core\scraper.py", line 374, in send_task_exception_notification
await session.get(full_url, timeout=aiohttp.ClientTimeout(total=5))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\aiohttp\client.py", line 779, in _request
resp = await handler(req)
^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\aiohttp\client.py", line 757, in _connect_and_send_request
await resp.start(conn)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\aiohttp\client_reqrep.py", line 534, in start
with self._timer:
^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\aiohttp\helpers.py", line 713, in __exit__
raise asyncio.TimeoutError from exc_val
TimeoutError
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/batac16l) - Page.query_selector: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 24, in parse_page
product_list_div = await page.query_selector('div.fs-c-productList__list')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 8087, in query_selector
await self._impl_obj.query_selector(selector=selector, strict=strict)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 410, in query_selector
return await self._main_frame.query_selector(selector, strict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 348, in query_selector
await self._channel.send("querySelector", None, locals_to_params(locals()))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.query_selector: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/allpita) - Page.query_selector: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 24, in parse_page
product_list_div = await page.query_selector('div.fs-c-productList__list')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 8087, in query_selector
await self._impl_obj.query_selector(selector=selector, strict=strict)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 410, in query_selector
return await self._main_frame.query_selector(selector, strict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 348, in query_selector
await self._channel.send("querySelector", None, locals_to_params(locals()))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.query_selector: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/nido) - Page.query_selector: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 24, in parse_page
product_list_div = await page.query_selector('div.fs-c-productList__list')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 8087, in query_selector
await self._impl_obj.query_selector(selector=selector, strict=strict)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 410, in query_selector
return await self._main_frame.query_selector(selector, strict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 348, in query_selector
await self._channel.send("querySelector", None, locals_to_params(locals()))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.query_selector: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/kapai1-5l) - Page.query_selector: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 24, in parse_page
product_list_div = await page.query_selector('div.fs-c-productList__list')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 8087, in query_selector
await self._impl_obj.query_selector(selector=selector, strict=strict)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 410, in query_selector
return await self._main_frame.query_selector(selector, strict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 348, in query_selector
await self._channel.send("querySelector", None, locals_to_params(locals()))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.query_selector: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: nutscollection (https://www.nutscollection.jp/c/tasra) - Page.query_selector: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 99, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\nutscollection_scraper.py", line 24, in parse_page
product_list_div = await page.query_selector('div.fs-c-productList__list')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 8087, in query_selector
await self._impl_obj.query_selector(selector=selector, strict=strict)
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 410, in query_selector
return await self._main_frame.query_selector(selector, strict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 348, in query_selector
await self._channel.send("querySelector", None, locals_to_params(locals()))
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.query_selector: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: rakuten_nuts (https://item.rakuten.co.jp/nuts/cotopaxi-batac16/) - Page.title: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 94, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\rakuten_nuts_scraper.py", line 23, in parse_page
self.logger.debug(f"页面标题: {await page.title()}")
^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 9766, in title
return mapping.from_maybe_impl(await self._impl_obj.title())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 827, in title
return await self._main_frame.title()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 864, in title
return await self._channel.send("title", None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.title: Execution context was destroyed, most likely because of a navigation
错误信息: 爬取任务失败: rakuten_nuts (https://item.rakuten.co.jp/nuts/cotopaxi-tasra16l/) - Page.title: Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
File "D:\workspace\cotopaxi\core\scraper.py", line 94, in scrape
products_data = await self.parse_page(page)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\plugins\rakuten_nuts_scraper.py", line 23, in parse_page
self.logger.debug(f"页面标题: {await page.title()}")
^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\async_api\_generated.py", line 9766, in title
return mapping.from_maybe_impl(await self._impl_obj.title())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_page.py", line 827, in title
return await self._main_frame.title()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_frame.py", line 864, in title
return await self._channel.send("title", None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "D:\workspace\cotopaxi\venv\Lib\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.title: Execution context was destroyed, most likely because of a navigation