Skip Navigation

User banner
Posts
1
Comments
347
Joined
2 yr. ago

  • Jenkins is neat if you use a shared repo. Yes, the functions are weird (a file is a function, and the function inside is named call.), but having a default list of *Pipeline.Jenksfile (ingestionPipeline, modelPipeline, parserPipeline, dataProductPipeline, etc - data engineer here) is so nice. You can also specify which branch of that repo you are running as well!

    It's less neat if you previously had to migrate off of a Jenkins that had everything running as root, to a Jenkins that doesn't.

    At least if you fix a bug for a function that's used in multiple pipelines, it's fixed everywhere. Or if you fix a bug in a single pipeline, it's fixed for multiple repos.

    edit: the Groovy language isn't great though. Not being able to pass kwargs in my own order, unclear how to define the pipeline (somewhat lacking docs, grabbing working examples from SO). I wish something like Python would've been used instead.

  • Dialectical Materialism

    How about "a tug-of-war between owners and workers for jobs, resources, and technology"

    Three examples:

    Factory Work and Labour Unions

    Early 20th-century factory jobs involved long hours, low pay, and unsafe working conditions. When workers tried to unionize, factory owners often resisted, viewing unionized labour as a threat to profits. This created a direct conflict: owners wanting to keep costs low vs. workers demanding better wages and safer workplaces.

    Automation in Warehouses

    Warehouses (e.g., Amazon fulfilment centres) are increasingly adopting robotic systems to speed up sorting and packing. Employees might feel pressure to meet higher performance metrics set by a partly automated workflow, while also fearing that further automation will reduce human jobs. Here, the “tug-of-war” is between technological efficiency (and profit) vs. workers’ job security and well-being.

    Tech Industry Outsourcing

    Companies sometimes outsource tech-related jobs to countries with cheaper labour costs. This lowers expenses for the company but can lead to local layoffs and economic hardship for employees in higher-wage regions. The conflict revolves around the benefit of increased profit margins for the company vs. the material needs of domestic workers who lose their livelihoods.

  • The USA actually spends several billions, if not trillions on Medicare (meant for the old) and Medicaid (meant for the poor, and single mothers, and young children) combined.

    In 2023, the federal government spent about $848.2 billion on Medicare, accounting for 14% of total federal spending.

    source - and that's just Medicare.

    I agree with you that it's weird that corporations get a bailout, instead of selling the company to competitors, but no need to act like the USA doesn't spend a TON of money on its citizens, keeping their head above water :)

  • Here's a summarization of the summary (also done by AI, because lazy):

    The author recalls his initial reluctance to speak publicly after a past misstep and later revisits the subject by examining how movies, such as 2001: A Space Odyssey and WarGames, dramatize computers. He contrasts these cinematic portrayals with the subtle influence of everyday technologies like email and PowerPoint, and criticizes modern development tools like Visual Studio and IntelliSense for potentially diminishing deep coding skills. Ultimately, he champions a return to fundamental programming to rediscover the pure joy of coding.

  • FFS, you could just have run gzip on it probably.

    Gzip doesn't reduce your data's size by 2000x. Of course this could be done by other languages as well, but running gzip on your data doesn't keep it accessible.

    Even turning the data into a Parquet file would've been a massive improvement, while keeping it accessible, but it likely would not have been 2000x smaller. 10x, maybe.

    edit: zip: about 10x; 7zip about 166x (from ~10GB to 60MB) - still not 2000x

  • Formatted:

     csv
        
    Last Name,First Name,Display Name,Email Address
    Aimonetti,Justin,Aimonetti, Justin W.,Justin.W.Aimonetti@doge.eop.gov
    Atik,Jacob,Atik, Jacob R.,Jacob.R.Atik@doge.eop.gov
    Armstrong,Anthony,Armstrong, Anthony J.,Anthony.J.Armstrong@doge.eop.gov
    Balajadia,Jennifer,Balajadia, Jennifer,Jennifer.Balajadia@doge.eop.gov
    Beynon,Alexandra,Beynon, Alexandra T.,Alexandra.T.Beynon@doge.eop.gov
    Biasini,Riccardo,Biasini, Riccardo N.,Riccardo.N.Biasini@doge.eop.gov
    Bobba,Akash,Bobba, Akash N.,Akash.N.Bobba@doge.eop.gov
    Boizelle,Ashley,Boizelle, Ashley S.,Ashley.S.Boizelle@doge.eop.gov
    Bryant,Emily,Bryant, Emily L.,Emily.L.Bryant@doge.eop.gov
    Burnham,James,Burnham, James,James.Burnham@doge.eop.gov
    Coristine,Edward,Coristine, Edward H.,Edward.H.Coristine@doge.eop.gov
    Davis,Steven,Davis, Steven M.,Steven.M.Davis@doge.eop.gov
    Elez,Marko,Elez, Marko,Marko.Elez@doge.eop.gov
    Farritor,Luke,Farritor, Luke E.,Luke.E.Farritor@doge.eop.gov
    Fox,Joshua,Fox, Joshua,Joshua.Fox@doge.eop.gov
    Hanley,Joshua,Hanley, Joshua A.,Joshua.A.Hanley@doge.eop.gov
    Holmes,Stephanie,Holmes, Stephanie M.,Stephanie.M.Holmes@doge.eop.gov
    Killian,Gautier,Killian, Gautier C.,Gautier.C.Killian@doge.eop.gov
    Kmiec,Keenan,Kmiec, Keenan D.,Keenan.D.Kmiec@doge.eop.gov
    Lahera,Nicholas,Lahera, Nicholas,Nicholas.Lahera@doge.eop.gov
    Lindemann,Kendall,Lindemann, Kendall M.,Kendall.M.Lindemann@doge.eop.gov
    Musk,Elon,Musk, Elon R.,em7m@who.eop.gov
    Peters,Noah,Peters, Noah,Noah.Peters@doge.eop.gov
    Rajpal,Nikhil,Rajpal, Nikhil,Nikhil.Rajpal@doge.eop.gov
    Ramada,Adam,Ramada, Adam,Adam.Ramada@doge.eop.gov
    Raynor,Austin,Raynor, Austin L.,Austin.L.Raynor@doge.eop.gov
    Schutt,Kyle,Schutt, Kyle L.,Kyle.L.Schutt@doge.eop.gov
    Shaotran,Ethan,Shaotran, Ethan,Ethan.Shaotran@doge.eop.gov
    Smith,Brad,Smith, Brad M.,Brad.M.Smith@doge.eop.gov
    Stanley,Christopher,Stanley, Christopher,Christopher.Stanley@doge.eop.gov
    Wick,Jordan,Wick, Jordan M.,Jordan.M.Wick@doge.eop.gov
    Wiles,Susan,Wiles, Susan S.,Susan.S.Wiles@doge.eop.gov
    Young,Christopher,Young, Christopher J.,Christopher.J.Young@doge.eop.gov
    
      
  • Now? That shit has been going on since the 90s. My native population has plateaued since 1990. The only reason the population grew was due to immigrants.

    Same goes for America where a LOT of the populations got fewer and fewer kids since the 90s.

  • Electric. Blanket.

    Get it. Now.

    It's so nice when you feel like shit, and you can just have some local warming, right on your body.

  • Until you use exit codes, which flips the logic.

  • Multiple ones.

    • Wave Function Collapse for an existing tileset (Warcraft 2) - it's really hard to figure out how to build the data on whether a tile fits on a certain side of another tile. From the top of my head: Some 180 tiles total * 4 sides to compare * 180 options per side = 129_600 total checks I would need to do, which is just wayyy too much. Need to figure out how to reduce these checks (or automate them using OpenCV or something - not sure yet)
    • Comparing dual datasets of people who worked on certain games (the games being all Warcraft games), so I can see who worked on Game A, who on Game B, and who on both. Am currently (manually) cleaning up the data, because Blizzard has been very inconsistent in how they structure their credits. At least WoW had everything available in HTML - having to manually copy over 600+ people would be no fun (per expansion).
    • A cryptocoin predictor for my friends and I. One part ingestion from an API into a Postgres DB, one part Streamlit + some stats / data science stuff that I'm very much a beginner in. The platform we're on doesn't provide much predictive power. Using the typical Simple Moving Averages and the like simply doesn't predict clearly enough, IMO.

    Oh, and I'm also setting up a private ProxMox server, over at a friends house, and need to connect that to the NAS over at my house, so we can copy over our data for redundancy/backup purposes.

    I'm bouncing between these projects.

  • How is Nifi? I've seen it pass by at work, as a generic ingestion application, but for most ingestions we're using custom-written Python for better flexibility.

    I've never worked with it, but it looked pretty daunting (as an initial view).

  • I dont know... This Linux thing is pretty great, IMO.

    I get their point, but it feels like it's more about tech being abused by large corporations, trying to squeeze another cent out of you.

  • Back and forth, forever.

  • Years of having good controls has ruined my ability

    Where my WAXD gamers at? The Chaos Engine was a fun game, but the controls were a bit weird.

  • Not to be confused with /r/straightedge, which is about drug-less Punk.

  • I know i’m white

    100% American.

  • 28:02

    I'm not watching all that stuff, because I don't care about Pewdiepie enough.

  • Erasure

    Jump
  • Typical American response.

    Alright, calm down, no need to insult me like that!

    I'm just getting sick of the keyboard warriors that bitch and moan on the internet about the situation, yet have exactly zero plans to do literally anything about it. They could write to their representatives, they could work towards Dems winning local elections, they could become politically active by demonstrating, etc.

    But all I see are online complaints; no plans. Storming the Capitol should be option Z, but maybe Americans can start with Plan A, eh?

  • As Jake the Dog said: "Sucking at something is the first step towards being sorta good at something."