• 'pip install logparser' on host '127.0.0.1:6800' and run command 'logparser'. Or wait until LogParser parses the log.

PROJECT (event_scrapers), SPIDER (silver_mine_art)

  • Log analysis
  • Log categorization
  • View log
  • Crawler.stats
  • projectevent_scrapers
    spidersilver_mine_art
    job43b45d26698611f18a810050565fa5d9
    first_log_time2026-06-16 15:21:24
    latest_log_time2026-06-16 15:21:59
    runtime0:00:35
    crawled_pages 1
    scraped_items 0
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count1
    log_warning_count2
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A
    • WARNING+

    • error_logs
      1 in total

      2026-06-16 15:21:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://silvermineart.asapconnected.com/#CourseIndex> (referer: None)
      Traceback (most recent call last):
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 355, in iter_errback
          yield next(it)
                ^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 311, in __next__
          return next(self.data)
                 ^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 311, in __next__
          return next(self.data)
                 ^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy_zyte_api/_middlewares.py", line 237, in process_spider_output
          for item_or_request in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 61, in process_spider_output
          yield from super().process_spider_output(response, result)
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy_zyte_api/_middlewares.py", line 261, in process_spider_output
          for item_or_request in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/event-list-scraping/event_scrapers/spiders/silver_mine_art.py", line 94, in parse_2
          driver = webdriver.Chrome(options=options)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/chrome/webdriver.py", line 46, in __init__
          super().__init__(
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/chromium/webdriver.py", line 67, in __init__
          super().__init__(command_executor=executor, options=options)
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 257, in __init__
          self.start_session(capabilities)
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 352, in start_session
          response = self.execute(Command.NEW_SESSION, caps)["value"]
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 432, in execute
          self.error_handler.check_response(response)
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/errorhandler.py", line 232, in check_response
          raise exception_class(message, screen, stacktrace)
      selenium.common.exceptions.SessionNotCreatedException: Message: session not created: Chrome instance exited. Examine ChromeDriver verbose log to determine the cause.; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
      Stacktrace:
      #0 0x55c086ecf29a <unknown>
      #1 0x55c0868b1449 <unknown>
      #2 0x55c0868ef4ec <unknown>
      #3 0x55c0868ea6d9 <unknown>
      #4 0x55c08693a0c6 <unknown>
      #5 0x55c0869397ac <unknown>
      #6 0x55c0868f9132 <unknown>
      #7 0x55c0868f9f41 <unknown>
      #8 0x55c086e95737 <unknown>
      #9 0x55c086e93f39 <unknown>
      #10 0x55c086e7ec26 <unknown>
      #11 0x55c086e94ada <unknown>
      #12 0x55c086e66bd0 <unknown>
      #13 0x55c086ebbc28 <unknown>
      #14 0x55c086ebbdc5 <unknown>
      #15 0x55c086ecde1e <unknown>
      #16 0x746a9e49caa4 <unknown>
      #17 0x746a9e529c6c <unknown>
      
    • warning_logs
      2 in total

      2026-06-16 15:21:25 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/pipelines/__init__.py:47: ScrapyDeprecationWarning: EventScrapersPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(pipe.process_item)
      
      2026-06-16 15:21:25 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py:490: ScrapyDeprecationWarning: event_scrapers.spiders.silver_mine_art.ListingSpider defines the deprecated start_requests() method. start_requests() has been deprecated in favor of a new method, start(), to support asynchronous code execution. start_requests() will stop being called in a future version of Scrapy. If you use Scrapy 2.13 or higher only, replace start_requests() with start(); note that start() is a coroutine (async def). If you need to maintain compatibility with lower Scrapy versions, when overriding start_requests() in a spider class, override start() as well; you can use super() to reuse the inherited start() implementation without copy-pasting. See the release notes of Scrapy 2.13 for details: https://docs.scrapy.org/en/2.13/news.html
        warn(
      

      INFO

      DEBUG

    • scrapy_version

      2.14.1
    • telnet_console

      127.0.0.1:6023
    • telnet_password

      4408aebcb92dc621
    • latest_crawl

      2026-06-16 15:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://silvermineart.asapconnected.com/#CourseIndex> (referer: None)
    • latest_stat

      2026-06-16 15:21:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
    • Head

      2026-06-16 15:21:24 [scrapy.utils.log] INFO: Scrapy 2.14.1 started (bot: event_scrapers)
      2026-06-16 15:21:24 [scrapy.utils.log] INFO: Versions:
      {'lxml': '6.0.2',
       'libxml2': '2.14.6',
       'cssselect': '1.3.0',
       'parsel': '1.10.0',
       'w3lib': '2.0.0',
       'Twisted': '25.5.0',
       'Python': '3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0]',
       'pyOpenSSL': '25.3.0 (OpenSSL 3.5.4 30 Sep 2025)',
       'cryptography': '46.0.3',
       'Platform': 'Linux-6.8.0-90-generic-x86_64-with-glibc2.39'}
      2026-06-16 15:21:24 [scrapy.crawler] DEBUG: Using AsyncCrawlerProcess
      2026-06-16 15:21:24 [asyncio] DEBUG: Using selector: EpollSelector
      2026-06-16 15:21:24 [scrapy.addons] INFO: Enabled addons:
      []
      2026-06-16 15:21:25 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-06-16 15:21:25 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-06-16 15:21:25 [scrapy.extensions.telnet] INFO: Telnet Password: 4408aebcb92dc621
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.logcount.LogCount',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats']
      2026-06-16 15:21:25 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'event_scrapers',
       'FEED_EXPORT_ENCODING': 'utf-8',
       'FEED_URI_PARAMS': <function _feed_uri_params at 0x7f2cf4b28540>,
       'LOG_FILE': '/root/event-list-scraping/logs/event_scrapers/silver_mine_art/43b45d26698611f18a810050565fa5d9.log',
       'NEWSPIDER_MODULE': 'event_scrapers.spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'SPIDER_MODULES': ['event_scrapers.spiders']}
      2026-06-16 15:21:25 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with 'ff9baec'
      2026-06-16 15:21:25 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with 'ff9baec'
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
       'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
       'scrapy.spidermiddlewares.referer.RefererMiddleware',
       'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
       'scrapy.spidermiddlewares.depth.DepthMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIRefererSpiderMiddleware']
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled item pipelines:
      ['event_scrapers.pipelines.EventScrapersPipeline']
      2026-06-16 15:21:25 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/pipelines/__init__.py:47: ScrapyDeprecationWarning: EventScrapersPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(pipe.process_item)
      
      2026-06-16 15:21:25 [scrapy.core.engine] INFO: Spider opened
      2026-06-16 15:21:25 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py:490: ScrapyDeprecationWarning: event_scrapers.spiders.silver_mine_art.ListingSpider defines the deprecated start_requests() method. start_requests() has been deprecated in favor of a new method, start(), to support asynchronous code execution. start_requests() will stop being called in a future version of Scrapy. If you use Scrapy 2.13 or higher only, replace start_requests() with start(); note that start() is a coroutine (async def). If you need to maintain compatibility with lower Scrapy versions, when overriding start_requests() in a spider class, override start() as well; you can use super() to reuse the inherited start() implementation without copy-pasting. See the release notes of Scrapy 2.13 for details: https://docs.scrapy.org/en/2.13/news.html
        warn(
      
      2026-06-16 15:21:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
      2026-06-16 15:21:25 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
      2026-06-16 15:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://silvermineart.asapconnected.com/#CourseIndex> (referer: None)
      2026-06-16 15:21:27 [selenium.webdriver.common.selenium_manager] DEBUG: Selenium Manager binary found at: /root/.venv/lib/python3.12/site-packages/selenium/webdriver/common/linux/selenium-manager
      2026-06-16 15:21:27 [selenium.webdriver.common.selenium_manager] DEBUG: Executing process: /root/.venv/lib/python3.12/site-packages/selenium/webdriver/common/linux/selenium-manager --browser chrome --language-binding python --output json
      2026-06-16 15:21:58 [selenium.webdriver.common.selenium_manager] DEBUG: Driver path: /root/.cache/selenium/chromedriver/linux64/149.0.7827.115/chromedriver
      2026-06-16 15:21:58 [selenium.webdriver.common.selenium_manager] DEBUG: Browser path: /root/.cache/selenium/chrome/linux64/149.0.7827.115/chrome
      2026-06-16 15:21:58 [selenium.webdriver.common.service] DEBUG: Started executable: `/root/.cache/selenium/chromedriver/linux64/149.0.7827.115/chromedriver` in a child process with pid: 416580 using 0 to output -3
      2026-06-16 15:21:58 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://localhost:49335/session {'capabilities': {'firstMatch': [{}], 'alwaysMatch': {'browserName': 'chrome', 'pageLoadStrategy': <PageLoadStrategy.normal: 'normal'>, 'browserVersion': None, 'goog:chromeOptions': {'extensions': [], 'binary': '/root/.cache/selenium/chrome/linux64/149.0.7827.115/chrome', 'args': ['--headless=new', '--disable-gpu', '--no-sandbox', '--window-size=1920,1080']}}}}
      2026-06-16 15:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): localhost:49335
      2026-06-16 15:21:58 [urllib3.connectionpool] DEBUG: http://localhost:49335 "POST /session HTTP/1.1" 500 0
      2026-06-16 15:21:58 [selenium.webdriver.remote.remote_connection] DEBUG: Remote response: status=500 | data={"value":{"error":"session not created","message":"session not created: Chrome instance exited. Examine ChromeDriver verbose log to determine the cause.","stacktrace":"#0 0x55c086ecf29a \u003Cunknown>\n#1 0x55c0868b1449 \u003Cunknown>\n#2 0x55c0868ef4ec \u003Cunknown>\n#3 0x55c0868ea6d9 \u003Cunknown>\n#4 0x55c08693a0c6 \u003Cunknown>\n#5 0x55c0869397ac \u003Cunknown>\n#6 0x55c0868f9132 \u003Cunknown>\n#7 0x55c0868f9f41 \u003Cunknown>\n#8 0x55c086e95737 \u003Cunknown>\n#9 0x55c086e93f39 \u003Cunknown>\n#10 0x55c086e7ec26 \u003Cunknown>\n#11 0x55c086e94ada \u003Cunknown>\n#12 0x55c086e66bd0 \u003Cunknown>\n#13 0x55c086ebbc28 \u003Cunknown>\n#14 0x55c086ebbdc5 \u003Cunknown>\n#15 0x55c086ecde1e \u003Cunknown>\n#16 0x746a9e49caa4 \u003Cunknown>\n#17 0x746a9e529c6c \u003Cunknown>\n"}} | headers=HTTPHeaderDict({'Content-Length': '791', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
      2026-06-16 15:21:58 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
      2026-06-16 15:21:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://silvermineart.asapconnected.com/#CourseIndex> (referer: None)
      Traceback (most recent call last):
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 355, in iter_errback
          yield next(it)
                ^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 311, in __next__
          return next(self.data)
                 ^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 311, in __next__
          return next(self.data)
                 ^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
    • Tail

      []
      2026-06-16 15:21:25 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-06-16 15:21:25 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-06-16 15:21:25 [scrapy.extensions.telnet] INFO: Telnet Password: 4408aebcb92dc621
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.logcount.LogCount',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats']
      2026-06-16 15:21:25 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'event_scrapers',
       'FEED_EXPORT_ENCODING': 'utf-8',
       'FEED_URI_PARAMS': <function _feed_uri_params at 0x7f2cf4b28540>,
       'LOG_FILE': '/root/event-list-scraping/logs/event_scrapers/silver_mine_art/43b45d26698611f18a810050565fa5d9.log',
       'NEWSPIDER_MODULE': 'event_scrapers.spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'SPIDER_MODULES': ['event_scrapers.spiders']}
      2026-06-16 15:21:25 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with 'ff9baec'
      2026-06-16 15:21:25 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with 'ff9baec'
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
       'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
       'scrapy.spidermiddlewares.referer.RefererMiddleware',
       'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
       'scrapy.spidermiddlewares.depth.DepthMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIRefererSpiderMiddleware']
      2026-06-16 15:21:25 [scrapy.middleware] INFO: Enabled item pipelines:
      ['event_scrapers.pipelines.EventScrapersPipeline']
      2026-06-16 15:21:25 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/pipelines/__init__.py:47: ScrapyDeprecationWarning: EventScrapersPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(pipe.process_item)
      
      2026-06-16 15:21:25 [scrapy.core.engine] INFO: Spider opened
      2026-06-16 15:21:25 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py:490: ScrapyDeprecationWarning: event_scrapers.spiders.silver_mine_art.ListingSpider defines the deprecated start_requests() method. start_requests() has been deprecated in favor of a new method, start(), to support asynchronous code execution. start_requests() will stop being called in a future version of Scrapy. If you use Scrapy 2.13 or higher only, replace start_requests() with start(); note that start() is a coroutine (async def). If you need to maintain compatibility with lower Scrapy versions, when overriding start_requests() in a spider class, override start() as well; you can use super() to reuse the inherited start() implementation without copy-pasting. See the release notes of Scrapy 2.13 for details: https://docs.scrapy.org/en/2.13/news.html
        warn(
      
      2026-06-16 15:21:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
      2026-06-16 15:21:25 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
      2026-06-16 15:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://silvermineart.asapconnected.com/#CourseIndex> (referer: None)
      2026-06-16 15:21:27 [selenium.webdriver.common.selenium_manager] DEBUG: Selenium Manager binary found at: /root/.venv/lib/python3.12/site-packages/selenium/webdriver/common/linux/selenium-manager
      2026-06-16 15:21:27 [selenium.webdriver.common.selenium_manager] DEBUG: Executing process: /root/.venv/lib/python3.12/site-packages/selenium/webdriver/common/linux/selenium-manager --browser chrome --language-binding python --output json
      2026-06-16 15:21:58 [selenium.webdriver.common.selenium_manager] DEBUG: Driver path: /root/.cache/selenium/chromedriver/linux64/149.0.7827.115/chromedriver
      2026-06-16 15:21:58 [selenium.webdriver.common.selenium_manager] DEBUG: Browser path: /root/.cache/selenium/chrome/linux64/149.0.7827.115/chrome
      2026-06-16 15:21:58 [selenium.webdriver.common.service] DEBUG: Started executable: `/root/.cache/selenium/chromedriver/linux64/149.0.7827.115/chromedriver` in a child process with pid: 416580 using 0 to output -3
      2026-06-16 15:21:58 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://localhost:49335/session {'capabilities': {'firstMatch': [{}], 'alwaysMatch': {'browserName': 'chrome', 'pageLoadStrategy': <PageLoadStrategy.normal: 'normal'>, 'browserVersion': None, 'goog:chromeOptions': {'extensions': [], 'binary': '/root/.cache/selenium/chrome/linux64/149.0.7827.115/chrome', 'args': ['--headless=new', '--disable-gpu', '--no-sandbox', '--window-size=1920,1080']}}}}
      2026-06-16 15:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): localhost:49335
      2026-06-16 15:21:58 [urllib3.connectionpool] DEBUG: http://localhost:49335 "POST /session HTTP/1.1" 500 0
      2026-06-16 15:21:58 [selenium.webdriver.remote.remote_connection] DEBUG: Remote response: status=500 | data={"value":{"error":"session not created","message":"session not created: Chrome instance exited. Examine ChromeDriver verbose log to determine the cause.","stacktrace":"#0 0x55c086ecf29a \u003Cunknown>\n#1 0x55c0868b1449 \u003Cunknown>\n#2 0x55c0868ef4ec \u003Cunknown>\n#3 0x55c0868ea6d9 \u003Cunknown>\n#4 0x55c08693a0c6 \u003Cunknown>\n#5 0x55c0869397ac \u003Cunknown>\n#6 0x55c0868f9132 \u003Cunknown>\n#7 0x55c0868f9f41 \u003Cunknown>\n#8 0x55c086e95737 \u003Cunknown>\n#9 0x55c086e93f39 \u003Cunknown>\n#10 0x55c086e7ec26 \u003Cunknown>\n#11 0x55c086e94ada \u003Cunknown>\n#12 0x55c086e66bd0 \u003Cunknown>\n#13 0x55c086ebbc28 \u003Cunknown>\n#14 0x55c086ebbdc5 \u003Cunknown>\n#15 0x55c086ecde1e \u003Cunknown>\n#16 0x746a9e49caa4 \u003Cunknown>\n#17 0x746a9e529c6c \u003Cunknown>\n"}} | headers=HTTPHeaderDict({'Content-Length': '791', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
      2026-06-16 15:21:58 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
      2026-06-16 15:21:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://silvermineart.asapconnected.com/#CourseIndex> (referer: None)
      Traceback (most recent call last):
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 355, in iter_errback
          yield next(it)
                ^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 311, in __next__
          return next(self.data)
                 ^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 311, in __next__
          return next(self.data)
                 ^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy_zyte_api/_middlewares.py", line 237, in process_spider_output
          for item_or_request in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 61, in process_spider_output
          yield from super().process_spider_output(response, result)
        File "/root/.venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/base.py", line 60, in process_spider_output
          for o in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/.venv/lib/python3.12/site-packages/scrapy_zyte_api/_middlewares.py", line 261, in process_spider_output
          for item_or_request in result:
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 183, in process_sync
          self._process_spider_exception(
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 256, in _process_spider_exception
          raise exception
        File "/root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 179, in process_sync
          yield from iterable
        File "/root/event-list-scraping/event_scrapers/spiders/silver_mine_art.py", line 94, in parse_2
          driver = webdriver.Chrome(options=options)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/chrome/webdriver.py", line 46, in __init__
          super().__init__(
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/chromium/webdriver.py", line 67, in __init__
          super().__init__(command_executor=executor, options=options)
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 257, in __init__
          self.start_session(capabilities)
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 352, in start_session
          response = self.execute(Command.NEW_SESSION, caps)["value"]
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 432, in execute
          self.error_handler.check_response(response)
        File "/root/.venv/lib/python3.12/site-packages/selenium/webdriver/remote/errorhandler.py", line 232, in check_response
          raise exception_class(message, screen, stacktrace)
      selenium.common.exceptions.SessionNotCreatedException: Message: session not created: Chrome instance exited. Examine ChromeDriver verbose log to determine the cause.; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
      Stacktrace:
      #0 0x55c086ecf29a <unknown>
      #1 0x55c0868b1449 <unknown>
      #2 0x55c0868ef4ec <unknown>
      #3 0x55c0868ea6d9 <unknown>
      #4 0x55c08693a0c6 <unknown>
      #5 0x55c0869397ac <unknown>
      #6 0x55c0868f9132 <unknown>
      #7 0x55c0868f9f41 <unknown>
      #8 0x55c086e95737 <unknown>
      #9 0x55c086e93f39 <unknown>
      #10 0x55c086e7ec26 <unknown>
      #11 0x55c086e94ada <unknown>
      #12 0x55c086e66bd0 <unknown>
      #13 0x55c086ebbc28 <unknown>
      #14 0x55c086ebbdc5 <unknown>
      #15 0x55c086ecde1e <unknown>
      #16 0x746a9e49caa4 <unknown>
      #17 0x746a9e529c6c <unknown>
      
      2026-06-16 15:21:59 [scrapy.core.engine] INFO: Closing spider (finished)
      2026-06-16 15:21:59 [scrapy.extensions.feedexport] INFO: Stored csv feed (0 items) in: output/2026/06/16/silver_mine_art.csv
      2026-06-16 15:21:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
      {'downloader/request_bytes': 236,
       'downloader/request_count': 1,
       'downloader/request_method_count/GET': 1,
       'downloader/response_bytes': 63684,
       'downloader/response_count': 1,
       'downloader/response_status_count/200': 1,
       'elapsed_time_seconds': 33.690323,
       'feedexport/success_count/FileFeedStorage': 1,
       'finish_reason': 'finished',
       'finish_time': datetime.datetime(2026, 6, 16, 13, 21, 59, 149203, tzinfo=datetime.timezone.utc),
       'httpcompression/response_bytes': 355553,
       'httpcompression/response_count': 1,
       'items_per_minute': 0.0,
       'log_count/DEBUG': 11,
       'log_count/ERROR': 1,
       'log_count/INFO': 3,
       'memusage/max': 93016064,
       'memusage/startup': 93016064,
       'response_received_count': 1,
       'responses_per_minute': 1.8181818181818181,
       'scheduler/dequeued': 1,
       'scheduler/dequeued/memory': 1,
       'scheduler/enqueued': 1,
       'scheduler/enqueued/memory': 1,
       'spider_exceptions/SessionNotCreatedException': 1,
       'spider_exceptions/count': 1,
       'start_time': datetime.datetime(2026, 6, 16, 13, 21, 25, 458880, tzinfo=datetime.timezone.utc)}
      2026-06-16 15:21:59 [scrapy.core.engine] INFO: Spider closed (finished)
    • Log

      /1/log/utf8/event_scrapers/silver_mine_art/43b45d26698611f18a810050565fa5d9/?job_finished=True

    • Source

      http://127.0.0.1:6800/logs/event_scrapers/silver_mine_art/43b45d26698611f18a810050565fa5d9.log

  • sourcelog
    last_update_time2026-06-16 15:21:59
    last_update_timestamp1781616119
    downloader/request_bytes236
    downloader/request_count1
    downloader/request_method_count/GET1
    downloader/response_bytes63684
    downloader/response_count1
    downloader/response_status_count/2001
    elapsed_time_seconds33.690323
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2026, 6, 16, 13, 21, 59, 149203, tzinfo=datetime.timezone.utc)
    httpcompression/response_bytes355553
    httpcompression/response_count1
    items_per_minute0.0
    log_count/DEBUG11
    log_count/ERROR1
    log_count/INFO3
    memusage/max93016064
    memusage/startup93016064
    response_received_count1
    responses_per_minute1.8181818181818181
    scheduler/dequeued1
    scheduler/dequeued/memory1
    scheduler/enqueued1
    scheduler/enqueued/memory1
    spider_exceptions/SessionNotCreatedException1
    spider_exceptions/count1
    start_timedatetime.datetime(2026, 6, 16, 13, 21, 25, 458880, tzinfo=datetime.timezone.utc)