Yeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		nikisweeting on Jan 20, 2021 \| parent \| context \| favorite \| on: Make Your Own Internet Archive with Archive Box Yeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ;) https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv... I don't want to officially endorse using the Google bot user agent, but you're welcome to try it on your own and see if it improves the experience.

mycall on Jan 21, 2021 [–]

How does ArchiveBox function compared to https://archivarix.com? I recently used Archivarix to backup a large website (93k pages), but it messed up the js/css.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact