The internet is a vast and complex terrain. For humans, sometimes feels like a challenging task to surf its endless links. But what about robots? Do they have the capacity to efficiently navigate this digital universe? Indeed, robots are increasingly being utilized for web navigation. Equipped sophisticated algorithms, they can analyze vast amou