The engineer behind the pipeline
I'm Kartik, a data engineer who has worked end to end for years: pulling in messy, large-scale data, making it trustworthy, and turning it into pipelines and products people rely on.
Most of my days are spent in Databricks and Spark, designing reliable pipelines, modelling data and tuning performance at scale. But I don't stop at the warehouse: I build the apps, automations and tools that sit on top, so the data actually reaches people.
I also share what I learn as ikartikdev on YouTube.
Into the source
Began in data engineering: ingesting large, messy datasets and learning what it takes to make data trustworthy.
Building the toolkit
Settled into the modern data stack: Databricks, Spark, PySpark, SQL and Azure Data Factory as the daily engines.
Transforming at scale
Designing reliable pipelines, modelling data and squeezing performance out of Spark on real, large workloads.
Serving products
Apps, automations, internal tools and browser extensions that turn pipelines into things people open every day.
Open to output
Available for new work and collaborations. Get in touch →