Skills/06

Data Pipelines

Raw data in, decisions out.

The work

Scrapers, ETL jobs, monitors and alerting. I build pipelines that are boring in the best way: idempotent, observable and easy to rerun.

When the data is clean, everything downstream (dashboards, models, agents) gets easier.

What I deliver

  1. ETL from APIs, spreadsheets and the open web
  2. Monitoring and anomaly alerts on business data
  3. Data cleanup and consolidation across systems
  4. Feeds that power dashboards and agents

Tools

PythonpandasPostgresSupabaseREST APIs

Proof

17 projects.

Cold Outreach Agent (Smartlead)

A daily Claude Code session that runs Black Lily's cold email program

internal2026

Recursive Momentum Trader

Claude agents autonomously research a regime-routed stock model

experiment2026

Penn Recruit

Wrestling recruiting pipeline: crawl results, tier prospects, draft outreach

experiment2026

Local vs Frontier Model Benchmark

Pre-registered tests of open-weight models vs Claude on adviser documents

internal2026

Medical Device DHF Traceability Audit

Design-history files parsed into a SQLite trace graph with 200 findings

client2026

Daily Market Commentary Agent

One button turns live market data into a finished daily client email

client2026

WellWatch

Three-layer AI monitor for Permian produced-water chemistry and injection wells

product2026

Inventory Sheet OCR and Matching Pipeline

Handwritten bin-count sheets to a matched, reviewable inventory file

client2026

Stock Universe (Equilibrium)

Survivorship-bias-free top-1000 US equity universe with 10 years of bars

experiment2026

Job-Board Automation Target Finder

Scrapes remote job posts and has Claude pick roles an automation could absorb

internal2026

Cowl: Radio-Sight and Vision HUD

Phone HUD that decodes aircraft and RF signals and explains the camera view

experiment2026

Momentum Acceleration Ranker

Stock ranker scoring weighted returns amplified by price acceleration

experiment2026

AI Supply Chain Monitor

Dashboard scoring ~85 public companies across the 14-layer AI supply chain

product2026

PennySurge

Case-control study of what actually precedes 100% penny-stock surges

experiment2026

Business Planning Models

Parametric models that render company planning docs to PDF

internal2026

AI Datacenter Equity Tracker

Static viewer of 36 AI-datacenter supply-chain stocks plus hyperscaler capex

experiment2026

Parts Catalog Price Matching

Fuzzy-match vendor and price-book files onto a ~10k-item master parts list

client2026