Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)UW
Posts
41
Comments
748
Joined
2 yr. ago

  • It doesn't matter. Port configuration can switch around and the bottleneck is still there. Traffic with in the broadcast domain (i.e. subnet) will handled by the switch alone.

    There is WiFi onboard so it can have some actual benefits, depending on design and how user access resources, but how likely you're going to saturate that 1/2.5G link? Not even you stream some 4K movies from Plex to iPhone will does that.

  • What's the point of having 1G on WAN and 2.5G on LAN? Traffic won't hit the LAN port until it's routed to the Internet, yet the WAN port is the bottleneck.

    Edit: Seems like I switch up the port speed but my point still holds as the bittleneck still exist.

  • I don't a single guide for you but I can layout a road map.

    1. A programming language. I prefer Python.
    2. Basic HTML syntax and CSS selectors
    3. HTTP, specifically methods, status code (no need to memorize all cuz you can go look it up), and cookies

    After you got those foundation ready, you can go on and try to build a webscraper. I advice aginst using Scrapy. Not because it is bad but too overwhelming and abstracted for any beginner. I will instead advice you use requests for HTTP, and BeautifulSoup4 for HTML parsing. You will build a more solid foundation and transition to scrapy later when you need those advanced function.

    When you get stuck, don't afraid to pause on your attempt and read tutorials again. Head to the Python Community on Discord to get interactive help. We welcome noobs as we once were noobs too. Just don't ever mention scraping there as they can't help if they suspect you're trying to do something inappropriate, malicious, or illegal. They are notoriously aginst yt-dlp which frustrates me a bit. Phrase it nicely and in an generic way. I will be there occasionally offering help.

  • There is no simplification that you're looking for. It seems you don't have a programing background. If you really need to scrape something, you need to learn a programing language, HTTP, HTML, and maybe javascript. AFAIK, there is no easy way or point and click scrapper building tool. You will need to invest time and learn. Don't worry, you should be able to get it done in 2-3 months if you do invest your time in.

  • I use BTRFS for snapshots, and auto compression. Maybe it can be done with raids with LVM? AFAIK BTRFS redundancy is basically the same as traditional RAID, similar to using mdadm. Still, you would want a backup strat instead relying on the disk redundancy. I learn that the hardway.