-
Head
2026-06-16 03:00:24 [scrapy.utils.log] INFO: Scrapy 2.14.1 started (bot: event_scrapers)
2026-06-16 03:00:24 [scrapy.utils.log] INFO: Versions:
{'lxml': '6.0.2',
'libxml2': '2.14.6',
'cssselect': '1.3.0',
'parsel': '1.10.0',
'w3lib': '2.0.0',
'Twisted': '25.5.0',
'Python': '3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0]',
'pyOpenSSL': '25.3.0 (OpenSSL 3.5.4 30 Sep 2025)',
'cryptography': '46.0.3',
'Platform': 'Linux-6.8.0-90-generic-x86_64-with-glibc2.39'}
2026-06-16 03:00:24 [scrapy.crawler] DEBUG: Using AsyncCrawlerProcess
2026-06-16 03:00:24 [asyncio] DEBUG: Using selector: EpollSelector
2026-06-16 03:00:24 [scrapy.addons] INFO: Enabled addons:
[]
2026-06-16 03:00:24 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-16 03:00:24 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-16 03:00:24 [scrapy.extensions.telnet] INFO: Telnet Password: cabc4ff1657da1a5
2026-06-16 03:00:24 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.logcount.LogCount',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats']
2026-06-16 03:00:24 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'event_scrapers',
'FEED_EXPORT_ENCODING': 'utf-8',
'FEED_URI_PARAMS': <function _feed_uri_params at 0x7f318ee4c540>,
'LOG_FILE': '/root/event-list-scraping/logs/event_scrapers/barrett_bookstore/bebd1409691e11f19d600050565fa5d9.log',
'NEWSPIDER_MODULE': 'event_scrapers.spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'SPIDER_MODULES': ['event_scrapers.spiders']}
2026-06-16 03:00:24 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with 'ff9baec'
2026-06-16 03:00:24 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with 'ff9baec'
2026-06-16 03:00:24 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-06-16 03:00:24 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIRefererSpiderMiddleware']
2026-06-16 03:00:24 [scrapy.middleware] INFO: Enabled item pipelines:
['event_scrapers.pipelines.EventScrapersPipeline']
2026-06-16 03:00:24 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/pipelines/__init__.py:47: ScrapyDeprecationWarning: EventScrapersPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
self._check_mw_method_spider_arg(pipe.process_item)
2026-06-16 03:00:24 [scrapy.core.engine] INFO: Spider opened
2026-06-16 03:00:24 [py.warnings] WARNING: /root/.venv/lib/python3.12/site-packages/scrapy/core/spidermw.py:490: ScrapyDeprecationWarning: event_scrapers.spiders.barrett_bookstore.BarrettBookstoreSpider defines the deprecated start_requests() method. start_requests() has been deprecated in favor of a new method, start(), to support asynchronous code execution. start_requests() will stop being called in a future version of Scrapy. If you use Scrapy 2.13 or higher only, replace start_requests() with start(); note that start() is a coroutine (async def). If you need to maintain compatibility with lower Scrapy versions, when overriding start_requests() in a spider class, override start() as well; you can use super() to reuse the inherited start() implementation without copy-pasting. See the release notes of Scrapy 2.13 for details: https://docs.scrapy.org/en/2.13/news.html
warn(
2026-06-16 03:00:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-06-16 03:00:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/events/2026/08> (referer: None) ['zyte-api']
2026-06-16 03:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/events/2026/09> (referer: None) ['zyte-api']
2026-06-16 03:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/events/2026/12> (referer: None) ['zyte-api']
2026-06-16 03:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/events/2026/07> (referer: None) ['zyte-api']
2026-06-16 03:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/events/2026/06> (referer: None) ['zyte-api']
2026-06-16 03:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-06-16 03:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/event/2026-09-01/pre-order-homemaking-babs> (referer: None) ['zyte-api']
2026-06-16 03:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): 144.91.120.141:80
2026-06-16 03:00:28 [urllib3.connectionpool] DEBUG: http://144.91.120.141:80 "POST /api/v1/raw-events/ HTTP/1.1" 201 2508
2026-06-16 03:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://barrettbookstore.com/event/2026-09-01/pre-order-homemaking-babs>
{'event_url': 'https://barrettbookstore.com/event/2026-09-01/pre-order-homemaking-babs',
'platform': 'Barrett Bookstore',
'platform_hash': 'a4649056ba039c67340f82d9943351d0',
'raw_body': '<article class="eventinstance-full '
'event-details__single-column">\n'
-
Tail
' Thu, 7/23/2026\n'
' <div '
'class="event-details__location--item">\n'
' -\n'
' 7:00pm\n'
' </div>\n'
' </div>\n'
'\n'
' <div class="event-list__details--item '
'event-details__location--location">\n'
' <span '
'class="event-list__details--label">Place: </span>\n'
' \n'
' <div><p class="address" translate="no"><span '
'class="address-line1">Darien Library</span><br>\n'
'<span class="address-line2">1441 Post Road</span><br>\n'
'<span class="locality">Darien</span>, <span '
'class="administrative-area">CT</span> <span '
'class="postal-code">06820</span><br>\n'
'<span class="country">United States</span></p></div>\n'
' \n'
' </div>\n'
' \n'
' <div class="event-details__links">\n'
' <a class="event-details__links--rsvp" '
'href="https://www.darienlibrary.org/event/tentative-author-talk-eric-jay-dolin-wreck-mentor-true-story-death-despair-and-deliverance" '
'target="_blank">RSVP\n'
' <span class="visually-hidden">to \n'
' Partner Event: Eric Jay Dolin at Darien Library\n'
' </span>\n'
' </a>\n'
' </div>\n'
' <div class="event-details__info--tags">\n'
' <div class="event-tag__term"><a '
'href="/events/tags/partner-event">Darien Library</a></div>\n'
' </div>\n'
' </div>\n'
' </div>\n'
'\n'
' <div class="event-details__image">\n'
' <img alt="The alternative text" title="The title text" '
'src="/sites/default/files/styles/event_image_large/public/image/2026/06/11/dolin-library-july-26.png?itok=2rsBON8V" '
'width="601" height="400" loading="lazy">\n'
'\n'
'\n'
' </div>\n'
' \n'
' </div>\n'
'\n'
' <div class="event-details__info--body aba-body">\n'
' <p>Celebrated author Eric Jay Dolin is coming back '
'to Darien Library to discuss his new book, "The Wreck of the '
'Mentor: A True Story of Death, Despair, and Deliverance in the '
'Age of Sail." Selected by The New York Times as one of the most '
'anticipated nonfiction books of 2026! <a '
'href="https://www.darienlibrary.org/event/tentative-author-talk-eric-jay-dolin-wreck-mentor-true-story-death-despair-and-deliverance">Click '
'here to register.</a></p>\n'
'\n'
' </div>\n'
' </article>'}
2026-06-16 03:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/event/2026-07-07/partner-event-beatriz-williams-dca> (referer: None) ['zyte-api']
2026-06-16 03:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): 144.91.120.141:80
2026-06-16 03:00:40 [urllib3.connectionpool] DEBUG: http://144.91.120.141:80 "POST /api/v1/raw-events/ HTTP/1.1" 500 145
2026-06-16 03:00:40 [barrett_bookstore] ERROR: API error 500:
<!doctype html>
<html lang="en">
<head>
<title>Server Error (500)</title>
</head>
<body>
<h1>Server Error (500)</h1><p></p>
</body>
</html>
2026-06-16 03:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://barrettbookstore.com/event/2026-07-07/partner-event-beatriz-williams-dca>
{'event_url': 'https://barrettbookstore.com/event/2026-07-07/partner-event-beatriz-williams-dca',
'platform': 'Barrett Bookstore',
'platform_hash': 'a4649056ba039c67340f82d9943351d0',
'raw_body': '<article class="eventinstance-full '
'event-details__single-column">\n'
' <div class="event-details__top">\n'
'\n'
' <div class="event-details__info">\n'
' <h1 class="event-details__info--title">\n'
' Partner Event: Beatriz Williams at DCA\n'
' </h1>\n'
'\n'
' <div class="event-details__location">\n'
' <div class="event-details__location--item '
'event-details__location--date">\n'
' Tue, 7/7/2026\n'
' <div '
'class="event-details__location--item">\n'
' -\n'
' 6:30pm\n'
' </div>\n'
' </div>\n'
'\n'
' <div class="event-list__details--item '
'event-details__location--location">\n'
' <span '
'class="event-list__details--label">Place: </span>\n'
' \n'
' <div><p class="address" translate="no"><span '
'class="address-line1">Darien Community Association</span><br>\n'
'<span class="address-line2">274 Middlesex Road</span><br>\n'
'<span class="locality">Darien</span>, <span '
'class="administrative-area">CT</span> <span '
'class="postal-code">06820</span><br>\n'
'<span class="country">United States</span></p></div>\n'
' \n'
' </div>\n'
' \n'
' <div class="event-details__links">\n'
' <a class="event-details__links--rsvp" '
'href="https://dariendca.app.neoncrm.com/np/clients/dariendca/eventRegistration.jsp?event=2572" '
'target="_blank">Buy tickets\n'
' <span class="visually-hidden">to \n'
' Partner Event: Beatriz Williams at DCA\n'
' </span>\n'
' </a>\n'
' </div>\n'
' <div class="event-details__info--tags">\n'
' <div class="event-tag__term"><a '
'href="/events/tags/dca">DCA</a></div>\n'
' </div>\n'
' </div>\n'
' </div>\n'
'\n'
' <div class="event-details__image">\n'
' <img alt="The alternative text" title="The title text" '
'src="/sites/default/files/styles/event_image_large/public/image/2026/06/08/beatriz-dca-77.png?itok=aLJ2giDH" '
'width="601" height="400" loading="lazy">\n'
'\n'
'\n'
' </div>\n'
' \n'
' </div>\n'
'\n'
' <div class="event-details__info--body aba-body">\n'
' <p>Join us at the Darien Community Association for a '
'summer evening of cocktails and conversation with the New York '
"Time's bestselling author Beatriz Williams as she discusses her "
'captivating new novel, When You Loved Me — the perfect summer '
'read filled with romance, mystery, family secrets, and a '
'legendary pirate treasure hidden along the New England coast. '
'The evening begins with a reception at 6:30pm, followed by a '
'Q&A with Beatriz at 7:00pm. Your ticket includes wine, light '
'refreshments and a signed hardcover copy of the book. Additional '
'copies of When You Loved Me and other titles by Beatriz Williams '
'will be available for purchase at the event.</p>\n'
'\n'
' </div>\n'
' </article>'}
2026-06-16 03:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://barrettbookstore.com/events/2026/11> (referer: None) ['zyte-api']
2026-06-16 03:00:59 [scrapy.core.engine] INFO: Closing spider (finished)
2026-06-16 03:00:59 [scrapy.extensions.feedexport] INFO: Stored csv feed (10 items) in: output/2026/06/16/barrett_bookstore.csv
2026-06-16 03:00:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 12746,
'downloader/request_count': 17,
'downloader/request_method_count/GET': 17,
'downloader/response_bytes': 725488,
'downloader/response_count': 17,
'downloader/response_status_count/200': 17,
'elapsed_time_seconds': 35.132711,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 6, 16, 1, 0, 59, 537649, tzinfo=datetime.timezone.utc),
'item_scraped_count': 10,
'items_per_minute': 17.142857142857142,
'log_count/DEBUG': 64,
'log_count/ERROR': 2,
'log_count/INFO': 3,
'memusage/max': 93167616,
'memusage/startup': 93167616,
'request_depth_max': 1,
'response_received_count': 17,
'responses_per_minute': 29.142857142857142,
'scheduler/dequeued': 17,
'scheduler/dequeued/memory': 17,
'scheduler/enqueued': 17,
'scheduler/enqueued/memory': 17,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 17,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 6.114291875568383,
'scrapy-zyte-api/mean_response_seconds': 6.1691344693741375,
'scrapy-zyte-api/processed': 17,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 17,
'scrapy-zyte-api/request_args/httpResponseBody': 17,
'scrapy-zyte-api/request_args/httpResponseHeaders': 17,
'scrapy-zyte-api/request_args/url': 17,
'scrapy-zyte-api/status_codes/200': 17,
'scrapy-zyte-api/success': 17,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 6, 16, 1, 0, 24, 404938, tzinfo=datetime.timezone.utc)}
2026-06-16 03:00:59 [scrapy.core.engine] INFO: Spider closed (finished)
-
Log
/1/log/utf8/event_scrapers/barrett_bookstore/bebd1409691e11f19d600050565fa5d9/?job_finished=True
-
Source
http://127.0.0.1:6800/logs/event_scrapers/barrett_bookstore/bebd1409691e11f19d600050565fa5d9.log