Right now, it’s an early MVP — it works, but still has a few bugs and missing features (like Database catalog, API catalog, pipeline merging, Existing DLT script onboarding, etc). I built it because DLT is quite powerful Data pipeline tools where we develop the scripts for pipeline creation, this client idea is to provide an easy way not only for creating, but also scheduling, monitoring, orchestrating, versioning, and more. Also it adds an AI layer to our pipeline management flow.
You can check it out here: https://github.com/nbernardo/dlt-client demo: 1. Creating a basic pipeline: https://lnkd.in/eZw-isTV 2. Scheduling a job for pipeline: https://lnkd.in/eNjsuWT3 3. Pipeline versioning, Data transformation and File system sourceing: https://lnkd.in/eazgrTrM
I’d love feedback, suggestions, or even contributions (ideas, code, etc) if anyone’s interested.
Thanks!
Nakassony Bernardo
0 comments