I have a website and I notice a lot of bots traffic, I guess trying to extract data from the site. I managed to detect some traffics with scripts, or IP rate limits, but I see I can't detect access that uses Selenium/webdriver.
Does anyone know how can these be detected?
I did see this post: https://stackoverflow.com/questions/33225947/can-a-website-detect-when-you-are-using-selenium-with-chromedriver and starting to check this, but from my tests not all of them are possible.
P.S. Specific parts (clicks, links etc) of our site make our backend work hard and accessing them for scrapping disrupt our regular clients work, therefore I need to block access to those pages but solutions like re-captcha seems too harsh (at least for our sales). So please don't ask me to let it be.
My only question is - does anyone know and willing to share how to detect selenium/webdriver controlled browsers in my website?
I really don't care about the other run-rounds, they are not my responsibility.