🗓️ Feb 16, 2023 | Data pipelines with dagster

Who knew daily updates requires effort and discipline! Anyway today was a good day, managed to get something working regarding publishing events to sns. Dagster cloud environment variables are kind of whack! You can only really drive them manually through the cloud UI. (I later found you can use graphql, still not the best though.) Lots of stuff to crack on with, lots of documentation to write up. Sidebar, it’s really hard to not work from a proper desk 🖥️

February 16, 2023 · Matt Ellis