Feature request: cloning website while maintaining the url structure / removal of index.html

[enrica773]

Hi,

I was wondering if it is possible to add a feature that maintains the url structure more similar to the online website.

So if a url is:

https://domain.com/folder/

SiteOne currently changes it to:

/folder/index.html

I understand that this is needed to use the website on your pc.

But when uploading the cloned website as an emergency backup, then the whole url structure changed.

Is it possible to add a feature that enables SiteOne for emergency backups and reduces the url changes?

[janreges]

Hi @enrica773,

Yes, this exact use (export usable as a temporary static copy of a website with URL preservation) was among my main requirements for this tool from the beginning. My goal is that SiteOne Crawler will in the future also help provide high-availability scenarios, where a static version of the website may be a sufficient failover in some situations.

I still have it in my roadmap (along with nginx/apache configuration recommendations), but unfortunately I won't be able to implement it before 2-3 months.