Projects

Tools and systems I have built around Search Console data, crawlers, Docker appliances, monitoring, and technical SEO QA.

At scale, technical SEO stops being a checklist and becomes a data problem. I build the plumbing: crawlers, importers, workers, dashboards and alerts that keep large sites observable.

Some of these are public products, some are internal tools, and some sit between the two. The common thread is simple: less manual checking, better data, and faster decisions.

Selected projects:

GSCAnalytics

A Search Console analytics product in the portal monorepo for keeping GSC data queryable after the UI export limits get in the way. It handles historic imports, live normalisation, multi-property reporting, exports, and account-scoped access.

  • Historic and live Search Console imports
  • Normalised fact tables plus raw export/import paths
  • Multi-property views for CTR, cannibalisation, and forecasting
Google Search Console API PHP MariaDB Docker

Index Monitor

A self-hosted appliance that watches URL coverage through the Google URL Inspection API. It ingests URLs from CSV, XML sitemaps and GSC traffic, then uses a Python worker to stay inside property-level quota.

  • Docker app, worker, cron and MariaDB stack
  • Quota-aware inspection scheduling
  • Coverage-change alerts and daily rollups
  • API access for bulk URL management
URL Inspection API Python Worker Docker MariaDB

Sentinel Monitoring Appliance

A standalone monitoring appliance built from the same portal codebase. It runs uptime, SSL, content, sitemap and SEO checks, queues work for Python workers, and turns the results into incidents, digests and integration alerts.

  • Site and URL monitoring with configurable checks
  • Incident rollups, maintenance windows and alert preferences
  • Docker deployment profile with app, worker and cron services
Sentinel Monitoring Python Worker Docker

crawler_cli

A Python crawler I use as a command-line building block rather than a desktop crawl export. It runs bounded, robots-aware crawls, writes structured results, compares against earlier runs, and can compact stored crawl data once findings are ingested.

  • CLI-first crawl and compare workflows
  • PostgreSQL-backed crawl storage
  • JSON output for pipeline ingestion
Python Crawler PostgreSQL CLI

Solar Capture

A solar lead-capture and licensing product, with plugin validation, usage telemetry, lead scoring, and account/admin surfaces in the portal stack.

  • Lead capture, scoring and consent audit trail
  • License validation and feature endpoints
  • Usage telemetry and support views
PHP Licensing Lead Capture API

Screaming Frog Cloud Automation

Screaming Frog running on cloud hosts with scheduled crawls and exported data landing in a warehouse for SQL-based QA.

  • Scheduled crawls without a desktop machine
  • Warehouse loads for repeatable crawl analysis
  • Run status monitoring and failure alerts
Screaming Frog Snowflake Cron

Website Vectorisation

Vector-based content analysis for finding topic gaps, weak internal linking, duplicated intent, and URLs that should be merged or retired.

  • Semantic gap analysis across large URL sets
  • Internal linking recommendations
  • Content consolidation planning
Vector Embeddings Python Content Analysis

Hreflang Matching

Bulk matching and validation for international URL sets, especially when translated sites do not line up cleanly by path.

  • Cross-domain hreflang validation
  • Bidirectional link checks
  • Error reports a team can work through
Hreflang International SEO Python

AI Overview Monitoring

Tracking where AI Overviews appear for target terms, which pages get cited, and how those results move over time.

  • Keyword-level monitoring via DataForSEO
  • Change detection across tracked SERPs
  • Reporting that separates appearance, citation and traffic signals
DataForSEO API SERP Monitoring Python

Migration QA

Migration prep and post-launch QA for large sites where the risk is in the details: redirects, canonicals, hreflang, structured data, indexing and crawl traps.

  • Pre-migration URL inventory and redirect mapping
  • Launch checks for crawlability and indexing signals
  • Monitoring for regressions after release
Site Migration Technical SEO QA

Interested in Working Together?

If you need crawler infrastructure, Search Console tooling, migration QA, or monitoring that fits how your site actually works, get in touch.