Archive - MakeWithData

Frontend is dead. Long live CLI.

The best interface to offer your users might just surprise you.

Jun 2 •

May 2025

Are You Leaking Secrets with Terraform?

Make your Terraform code bulletproof when it comes to sensitive values.

May 27 •

April 2025

Building a Real-Time Satellite Tracking Pipeline with Spark Structured Streaming

Leverage the latest features of Apache Spark 4 to stream, process, and visualize satellite orbit telemetry using public TLE data and real-time…

Apr 15 •

March 2025

Build a MCP Server for AI Access to UniFi Networks (Goose or Claude)

In just a few minutes you can create your own local MCP server and control your UniFi network with AI agents like Goose and Claude.

Mar 30 •

January 2025

Is Haystack better than LangChain?

A battle of LLM frameworks, which is better for your next RAG pipeline? Can we figure it out with the help of Chuck Norris?

Jan 8 •

7 Ways to use AI for Data Products in 2025

AI isn't going anywhere! This year, learn how to stay ahead of the competition and streamline business by integrating AI into your data products.

Jan 6 •

December 2024

Event Driven Design Patterns for Data Engineering

Explore event-driven designs that engineers can use for elegant real-time data processing and ETL.

Dec 18, 2024 •

Spark 4.0 Intro to Custom Data Sources with SQS

Let's explore PySpark's new custom data source feature by making our own source for AWS SQS.

Dec 17, 2024 •

November 2024

Databricks Workflow Mistakes You’re Probably Making (And How to Fix Them)

Today, we will look at many of the most common pitfalls I've seen (and learned the hard myself a time or two) and how to fix them using best practices…

Nov 18, 2024 •

October 2024

Trigger Databricks Jobs on File Arrival

Use this new feature for event-driven Databricks Jobs to trigger when files arrive in your cloud storage. We'll look at 4 example use cases of when you…

Oct 28, 2024 •

Practical Terraform: You're Doing it Wrong (Part 2)

This is Part 2 of the set of practical Terraform tips. Supercharge your Infrastructure-as-Code to be more resilient, easier to maintain, and idiomatic.

Oct 15, 2024 •

Practical Terraform: You're Doing it Wrong (Part 1)

We've all written Terraform IaC that we're not proud of before - it happens. I'm here today to talk about the Terraform you write that you think you're…

Oct 14, 2024 •

Hacking My Traeger Grill

Today I'll show you how I was able to hack my Traeger grill to capture data such as the grill temperature, pellet level, probe goal, and more, as well…

Oct 8, 2024 •

September 2024

Data Engineering: Essential Skills and Tools for 2025

Discover the essential data engineering skills and tools for 2025, including Python, SQL, Apache Spark, Kafka, Delta Lake, cloud platforms, real-time…

Sep 27, 2024 •

June 2024

UniForm: Peace to Delta Lake + Iceberg + Hudi

In case you haven’t been paying attention the last few years, there is a war being waged… a war of which open table data format will come out on top…

Jun 24, 2024 •

May 2024

🍷FineWeb: the new Pile 🤔

FineWeb is a large-scale web corpus created by Hugging Face to train state-of-the-art LLMs but how does it compare to ThePile?

May 2, 2024 •

April 2024

From Beginner to Certified Azure Administrator in Two Weeks

Whether you’re a cloud veteran on Azure, AWS, GCP, or just getting started on your cloud computing and solution architecture journey, official…

Apr 10, 2024 •

AWS Costs Saving Checklist: Quick and Easy Ways to Reduce Your Bills

Review this simple checklist to quickly optimize your AWS cloud costs. No matter how big or small the organization, you can find savings here.

Apr 2, 2024 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts