AI Voice Assisted Task Creation
Field teams dictate work orders instead of typing them. The AI handles the rest.
Product UI is proprietary. Diagrams represent the design thinking, not the actual interface.
Designing the AI's behavior
The system prompt is where the real design work lives. It tells the AI how to parse messy speech into validated work orders.
"Fix the leaky faucet at unit 4B on Maple Street, assign it to John, it's pretty urgent"
Instead of static mockups, the system prompt defined the AI's behavior — parsing, disambiguation, error handling, conversation flow. Engineering used it as their production starting point.
Users see a conversational preview first, then the populated form. Research confirmed people wanted AI to infer fields but wanted final sign-off before anything was created.
The voice-first flow never blocks users. They can switch to keyboard input at any time, so the AI-first approach doesn't become a cage.
Product directors grilled the edge cases and research methodology. They had questions on every scenario; the research held up.
Engineering used the system prompt from prototyping as their production starting point
The UX team started using the working-prototype workflow for their own AI feature testing
What the system prompt actually controls
The system prompt is a design artifact. It specifies how the AI parses speech, resolves ambiguous names, handles lookup failures, and manages the conversation.
"Fix the leaky faucet at unit 4B on Maple Street, assign it to John, it's pretty urgent"
Speech-to-text transcription via API Users tap to record and describe the task in their own words. The app transcribes the speech, then passes it to the AI as raw text. That text is messy by nature: names are ambiguous, priorities are implied, and phrasing is casual.
Lookup disambiguation decision tree Assignees, properties, and categories all need to match real database records. When the AI finds an exact match, it populates the field automatically. Fuzzy matches get presented as numbered options so the user can select by voice. If nothing matches, the AI sets a sensible default and tells the user why.
Two-stage review for user trust User research confirmed people wanted the AI to infer fields like description, priority, and due date. But they also wanted final sign-off before anything was created. The two-stage review gives users a conversational confirmation first, then the populated form for final review and edits.