https://matt-ellis.dev/tags/aws/Recent content in Aws on Matt EllisHugoen-GBThu, 16 Feb 2023 10:46:34 +0000https://matt-ellis.dev/rambles/data-pipelines-with-dagster/Thu, 16 Feb 2023 10:46:34 +0000https://matt-ellis.dev/rambles/data-pipelines-with-dagster/<p>Who knew daily updates requires effort and discipline!</p> <p>Anyway today was a good day, managed to get something working regarding publishing events to SNS.</p> <ul> <li>Dagster cloud environment variables are kind of whack! You can only really drive them manually through the cloud UI. <ul> <li>(I later found you can use graphql, still not the best though.)</li> </ul> </li> <li>Lots of stuff to crack on with, lots of documentation to write up.</li> </ul> <p>Sidebar, it&rsquo;s really hard to not work from a proper desk 🖥️</p>