Hacker Newsnew | past | comments | ask | show | jobs | submit | radus's commentslogin

Okay, but why?


I'm working on adding features to the snakemake aws batch executor plugin. The existing plugin supports execution on AWS Batch by dynamically creating job definitions based on rule resource configuration, but was missing support for features like using different containers for different rules, consumable resources, secrets, etc. Two approaches:

1) https://github.com/radusuciu/snakemake-executor-plugin-aws-b... (my fork). Just add the features to the batch job building code 2) https://github.com/radusuciu/snakemake-executor-plugin-aws-b.... This is more experimental and not yet fully working. I wanted to try a few things. a) can we rely on existing job definitions (managed through IaC instead). b) can we implement a fire-and-forget model where the main snakemake process runs on Batch as well? c) Can we slim down the snakemake container by stripping off unnecessary features.


Polars has a much more consistent API, give it a shot.

Regarding your plotting question: use seaborn when you can, but you’ll still need to know matplotlib.


> But are you really going to repair it?

Yes


Polars and duckdb interoperate nicely and can enable this flexibility


Does Polars have a Java library?


I like using EFK (ElasticSearch-Fluent-Kibana) for this


You’re able to aggregate all logs from control plane (all events?), firewall/ ingress, Storage, Autoscaler , CNI, operating system, audit events?


I guess then you've got to abstract one level further and formulate your advice as an allegory.


Example: you want to set your local docker context to the production environment, so that when you type `docker system prune --volumes` you delete your production data.


Right? I always wondered who would use that feature and for what, now it all makes sense!


Honestly this sounds like a massive outage waiting to happen


That’s Ops’s problem later tonight. You have to move fast and break things.


The answer is “it depends”


Quick critique: module contains functions with many parameters, many branches, deep nesting, and multiple return points.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: