• 2 Posts
  • 12 Comments
Joined 3 years ago
cake
Cake day: July 9th, 2023

help-circle


  • I developed my own scraping system using browser automation frameworks. I also developed a secure storage mechanism to keep my data protected.

    Yeah there is some security, but ultimately if they expose it to me via a username and password, I can use that same information to scrape it. Its helpful that I know my own credentials and have access to all 2FA mechanisms and am not brute forcing lots of logins so it looks normal.

    Some providers protect it their websites with bot detection systems which are hard to bypass, but I’ve closed accounts with places that made it too difficult to do the analysis I need to do.




  • Interesting. I played around with X11 vs Wayland settings just to see what different configurations give me

    • MOZ_ENABLE_WAYLAND=1 /snap/bin/firefox - Exhibits low FPS issue
    • MOZ_ENABLE_WAYLAND=0 DISABLE_WAYLAND=1 /snap/bin/firefox - Actually feels fast like it should be. Most animations feel faster, some are still choppy though. It’s hard to tell.

    It seems like running with X11 sort of the problem? Which seems unexpected and concerns me since I know distros are starting to default to Wayland.