Free 2 Hour Databricks Lab | Build Your Own ChatGPT (Locally) | Stop Broken Pipelines
Hey folks,
I shared a few things this past week that I think are pretty useful if you’re working with data pipelines, AI setups, or just trying to build better systems overall.
Here’s what you might have missed:
New FREE Databricks Lab + Walkthrough Recording
We just released a new free lab where you build full pipelines in Databricks using Spark Declarative Pipelines, SQL, and Lakeflow Designer.
Here, you learn how to actually build pipelines that are structured, reliable, and easier to manage.
You’ll work with Bronze → Silver → Gold pipelines, orchestration, Delta Lake, Unity Catalog, and also the visual side with Lakeflow Designer.
👉 Work through the Free Lab on YouTube:
I also did a full livestream where I walked through the lab and explained how everything fits together.
If you want a guided start, that recording is probably the easiest way to get into it.
👉 Watch the recording:
I Built My Own “ChatGPT” Locally (Open WebUI + Ollama)
In my latest YouTube video I show you how to run your own ChatGPT-like setup locally.
No API calls. No data leaving your machine.
It’s based on Open WebUI and Ollama, and it’s actually a really practical setup if you want more control or care about privacy.
This is an awesome project if you want something for your portfolio or if you’re thinking about internal AI systems.
👉 Watch the video here:
How to Stop Getting Surprised by Broken Pipelines
This is something I’ve run into a lot.
Pipelines “running fine”… but something is clearly off.
No alerts, no errors, but data is missing or delayed.
In my latest LinkedIn article, I break down why this happens and go into simple ways to fix this without needing a full observability stack.
👉 Read the full article here: https://www.linkedin.com/pulse/how-stop-getting-surprised-broken-pipelines-andreas-kretz-wkqjf
That’s it for this time 🙂
If you check any of these out, I’d be curious what you think. So let me know in the comment sections!
Especially if you try the lab or the local AI setup.
Talk soon,
Andreas
***
Ready to become a Data Engineer? Then join my Learn Data Engineering Academy today!
If you want to build real platforms, master the full stack, and close your skill gaps, check out my Data Engineer Coaching program.
If you are interested, but still have a few burning questions on your mind: feel free to contact me via hello@learndataengineering.com.
For more information and content on Data Engineering, also check out my other blog posts, videos and more on Medium, YouTube and LinkedIn!