allow images to be crawled with robots.txt #15687
Replies: 3 comments
-
The |
Beta Was this translation helpful? Give feedback.
-
We are currently tracking the customization of the |
Beta Was this translation helpful? Give feedback.
-
I commented on issue #15421 there, but just in case it's the wrong place, this is a major pain point for our use of Directus Cloud – it affects really common things like setting social metadata images via the CMS, and also causes a lot of errors to be reported in the Google Search Console for pages where we have images being served from Directus. |
Beta Was this translation helpful? Give feedback.
-
Hi!
My frontend serves images like this:
https://my-directus-domain.com/assets/some-asset-id?key=content-image-850
But since the robots.txt at https://my-directus-domain.com/robots.txt disallows crawling of the whole domain the google-crawler can not crawl the images either.
Is there a way to change the robots.txt? Creating a robots.txt in /app/dist/ doesn't do anything.
Cheers
Kamil
Beta Was this translation helpful? Give feedback.
All reactions