Merge pull request #644 from cedarcode/jt--save_scraper_screenshots

upload scraper screenshots in case of failure
cedarcode · Feb 1, 2025 · 2c9a3d5 · 2c9a3d5
2 parents 32c40bf + f4f2663
commit 2c9a3d5
Show file tree

Hide file tree

Showing 2 changed files with 8 additions and 1 deletion.
diff --git a/.github/workflows/scraper.yml b/.github/workflows/scraper.yml
@@ -49,3 +49,10 @@ jobs:
         else
             echo "There were no changes. Nothing to do."
         fi
+    - name: Upload screenshots
+      if: failure()
+      uses: actions/upload-artifact@v4
+      with:
+        name: scraper_screenshot
+        path: ./tmp/capybara
+        retention-days: 5
diff --git a/lib/scraper/bedelias.rb b/lib/scraper/bedelias.rb
@@ -19,7 +19,7 @@ def scrape
       Capybara.configure do |config|
         config.default_driver = ENV["HEADLESS"] == "false" ? :selenium_chrome : :selenium_chrome_headless
         config.run_server = false
-        config.save_path = "tmp"
+        config.save_path = "tmp/capybara"
         config.threadsafe = true
       end