Sketchboard: Sketch-to-Mockup iPad App

Overview

Sketchboard is an iPad app that turns multimodal input (hand-drawn sketches plus voice dictation) into rendered HTML mockups, with conversational refinement. A five-person team co-built it in six hours at the Google DeepMind x Gradient x tokens& Open Models Hackathon, where it placed 3rd out of 20+ teams.

Demo: sketching screens on the iPad and generating mockups.

What I Built

Generation loop. A multi-step Gemma 4 26B loop that streamed drafts, ran automated validation checks, critiqued and revised, and returned an approved or best-of-N output. Gemma 4 26B was chosen for near-flagship quality at small-model speed, plus native vision.

Design and integration. Designed the app interface and design system; integrated the Lambda GPU inference backend and Nango GitHub OAuth.

Stack

SwiftUI, PencilKit, Gemma 4 26B, Lambda GPU inference, Nango.

Team

Ari’El Encarnacion, Sean Hall, Justin Milner, Helen Zeng, and Nick Fitzpatrick.