🗓️ Apr 19, 2023 | A spontaneous symposium 🪄

Since joining my current workplace, I’ve managed to see my esteemed colleagues twice in person. I’ve been there almost 9 months now! It seems kind of weird and I think fully remote working has been somewhat isolating. I love the flexibility it provides, but I’d also like to see my work colleagues more in the flesh. Those pixel faces aren’t quite the same… Anyway, I managed to see them on a spontaneous chance, and it was great....

April 19, 2023 · Matt Ellis

🗓️ Apr 13, 2023 | Rethinking my work routine 🧠

So life has been crazily busy, from seeing family to small holidays it’s been an actioned packed couple of weeks. I’ve 100% decided that daily rambles is not possible for me at the moment, my dicipline is just not there yet! Also I’m 99.99% sure I have ADHD. I’m not diagnosed, but all signs point in that direction. I’ve been trying to improve my workflow to keep me on track and to stop my mind wandering....

April 13, 2023 · Matt Ellis

🗓️ Feb 27, 2023 | A proper desk to work at! 👨‍💻

So my supposed daily ramble has been more of a ramble when you can… Took some time off to go skiing. I came back in one piece which is surprising 🎉 Finally got my desk partially installed. It’s a solid countertop from wall to wall, super heavy and needed 6 people to lift! At somepoint I’ll stain it and setup my monitors. Catching back up today on previous dagster work. It’s apparently crunch time....

February 27, 2023 · Matt Ellis

🗓️ Feb 16, 2023 | Data pipelines with dagster

Who knew daily updates requires effort and discipline! Anyway today was a good day, managed to get something working regarding publishing events to sns. Dagster cloud environment variables are kind of whack! You can only really drive them manually through the cloud UI. (I later found you can use graphql, still not the best though.) Lots of stuff to crack on with, lots of documentation to write up. Sidebar, it’s really hard to not work from a proper desk 🖥️

February 16, 2023 · Matt Ellis

🗓️ Feb 6, 2023 | Digging around dagster 🗡️

Playing around with the dagster local development and trying to build a nice DAG. Dagster has a really nice interface, although some of the naming conventions are kind of cryptic It has a I/O manager for snowflake (Nice!) Setting up and getting started with dagster is super simple. I might dig out the raspberry pi this evening and try get dagster running on it for one of my old projects.

February 6, 2023 · Matt Ellis