AI Voice Assistant

LoanX's AI Voice Assistant, powered by Google's Gemini Live service, is your intelligent mortgage advisor. This comprehensive guide covers all voice assistant features, from basic interactions to advanced mortgage calculations.

Overview

The AI Voice Assistant transforms how you work with mortgage information by providing:

• Natural Language Processing: Ask questions in plain English
• Real-Time Calculations: Instant mortgage calculations and affordability analysis
• Current Market Data: Up-to-date rates and market information
• Conversation Memory: Context-aware responses across the entire session
• Visual Results: Calculations displayed as interactive cards
• Voice and Text Input: Flexible interaction methods

Getting Started with Voice Assistant

Accessing the Voice Assistant

From Voice-First Mode:

• The voice assistant launches automatically after login
• The interface is optimized for voice interaction
• Full-screen chat experience

From Hybrid Mode:

• Tap the AI Assistant button (usually floating in bottom right)
• Opens as a modal overlay
• Can be accessed from any screen in the app

From Main Menu:

• Navigate to AI Assistant tab in the tab bar
• Full-featured voice assistant interface
• Access to conversation history

Interface Overview

The voice assistant interface includes:

Status Bar:

• Session Status: "Session Started" / "Starting Session..." / "Session Ended"
• Time Remaining: Shows session expiration countdown
• Connection Indicator: Visual connection status

Chat Area:

• Message History: Scrollable conversation history
• Message Types: Text messages, voice messages, calculation cards
• Visual Feedback: Loading indicators and status messages

Input Controls:

• Microphone Button: Tap and hold for voice input
• Keyboard Toggle: Switch between voice and text input
• Send Button: Submit text messages

Action Buttons:

• History: View conversation history
• Settings: Configure voice assistant preferences
• Close/Minimize: Dismiss or minimize the assistant

Voice Interaction

Starting a Conversation

First Time Setup:

1. Grant microphone permissions when prompted
2. Wait for "Session Started" status
3. See the welcome message with your greeting

Beginning Your Session:

• Voice: Tap and hold the microphone, speak naturally, release
• Text: Tap keyboard icon, type your message, tap send
• Wake Phrases: Simply say "Hello" or "Hi" to begin

Voice Input Methods

Tap and Hold:

1. Tap and hold the microphone button
2. Speak your question or request
3. Release when finished
4. Wait for transcription and AI response

Voice Activity Detection:

• The app automatically detects when you start and stop speaking
• Background noise filtering for clearer input
• Automatic transcription of your speech

Best Practices:

• Speak clearly at normal volume
• Wait for the AI to finish responding before speaking again
• Use natural language - no need for formal commands

Session Management

Session Duration:

• Sessions typically last 45-60 minutes
• Timer shows remaining time when session is expiring
• Warnings appear in the final 10 minutes

Session Warnings:

• Orange Warning: Session expiring soon (10+ minutes remaining)
• Red Warning: Session ending very soon (<10 minutes)
• Auto-Renewal: New sessions start automatically when possible

Reconnection:

• App automatically reconnects if connection is lost
• Conversation history is preserved
• May take 30-60 seconds to reestablish connection

Mortgage Calculation Features

Affordability Analysis

Ask questions about what borrowers can afford:

Example Queries:

• "What can someone afford with $5,000 monthly income?"
• "Calculate affordability for 80k annual salary with $500 debt"
• "How much house can I afford with 20% down payment?"

Information Provided:

• Maximum loan amount
• Recommended price range
• Down payment requirements
• Monthly payment breakdown
• Debt-to-income ratios

Affordability Cards Show:

• Maximum purchase price
• Required down payment
• Monthly payment details
• Principal, interest, taxes, insurance (PITI)
• PMI requirements if applicable

Monthly Payment Calculations

Get detailed payment breakdowns:

Sample Questions:

• "What's the monthly payment for a $350,000 loan at 7.2%?"
• "Calculate payment for $400k purchase with 15% down"
• "Show me payments for 15-year vs 30-year loan"

Payment Details Include:

• Principal and interest
• Property taxes (estimated)
• Homeowners insurance
• PMI/MIP if required
• Total monthly housing payment

Rate Information

Access current mortgage rates:

Rate Queries:

• "What are current mortgage rates?"
• "Show me rates for different loan types"
• "Compare 30-year vs 15-year rates"
• "What rates are available for my loan amount?"

Rate Information Includes:

• Current market rates by loan type
• Rate comparisons across loan programs
• Points and fee information
• Rate trends and market insights

Loan Limit Information

Find conforming and jumbo loan limits:

Limit Queries:

• "What's the loan limit for [ZIP code]?"
• "Show me conforming loan limits"
• "Is this a jumbo loan for this area?"

Limit Information Shows:

• Conforming loan limits by location
• Jumbo loan thresholds
• Government loan limits (VA, FHA, USDA)
• Multi-unit property limits

Property Tax Calculations

Get property tax estimates:

Tax Queries:

• "What are property taxes for $500,000 home in [ZIP]?"
• "Calculate annual property taxes"
• "Compare tax rates in different areas"

Tax Information Includes:

• Annual property tax estimates
• Monthly property tax portion
• Local tax rates
• Exemptions and deductions (where applicable)

Home Insurance Estimates

Calculate insurance costs:

Insurance Queries:

• "How much is homeowner's insurance?"
• "Calculate insurance for $400k home"
• "What's typical insurance cost in [location]?"

Insurance Estimates Show:

• Annual premium estimates
• Monthly insurance costs
• Coverage recommendations
• Regional cost variations

Advanced Features

Loan Comparison Tools

Compare multiple loan scenarios:

Comparison Requests:

• "Compare 30-year vs 15-year loans"
• "Show me conventional vs FHA options"
• "Compare different down payment amounts"

Comparison Results:

• Side-by-side payment comparisons
• Total interest cost over loan term
• Cash requirements comparison
• Break-even analysis

Structured Data Cards

The AI presents complex calculations as interactive cards:

Card Types:

• Rate Cards: Current rates with program details
• Affordability Cards: Maximum loan amounts and payments
• Payment Cards: Detailed payment breakdowns
• Comparison Cards: Side-by-side loan comparisons
• Limit Cards: Loan limits by location
• Tax Cards: Property tax estimates

Card Features:

• Tap to expand for more details
• Share calculations with borrowers
• Save results for later reference
• Export data to external systems

Conversation Context

The AI maintains context throughout your session:

Context Awareness:

• Remembers previous calculations
• References earlier conversation points
• Builds on previous queries
• Maintains borrower information

Follow-Up Questions:

• "What about with 10% down instead?"
• "How does that change with a 15-year term?"
• "Show me the same calculation for a different rate"

Best Practices

Effective Communication

Natural Language:

• Speak as you would to a human expert
• Use complete sentences when possible
• Be specific with numbers and locations

Example of Good Queries:

• "Calculate the monthly payment for a $350,000 loan at 7.25% for 30 years"
• "What can someone afford if they make $80,000 per year and have $600 in monthly debts?"
• "Show me current rates for a conventional loan in California"

Less Effective Queries:

• "Payment" (too vague)
• "Rates" (no context)
• "Calculate" (missing details)

Maximizing Accuracy

Provide Specific Information:

• Include loan amounts, rates, and terms
• Specify property locations (ZIP codes work best)
• Mention borrower qualifications when relevant

Clarify When Needed:

• Ask for explanations of calculations
• Request more details on specific aspects
• Verify assumptions the AI is making

Voice Quality Tips

For Best Recognition:

• Find a quiet environment
• Speak at normal conversational volume
• Pause briefly between sentences
• Avoid background noise when possible

If Recognition Issues:

• Switch to text input temporarily
• Try rephrasing your question
• Speak more slowly and clearly
• Check microphone permissions

Conversation Management

Conversation History

Accessing History:

1. Tap the History button in the voice assistant
2. Browse previous conversations
3. Tap any conversation to resume or review
4. Search through conversation history

History Features:

• Conversations are automatically saved
• Search through past interactions
• Resume interrupted conversations
• Export conversation data

Creating New Conversations

Starting Fresh:

1. Tap the New Conversation button
2. Previous context is cleared
3. Begin with a clean slate
4. Previous conversations remain saved

When to Start New:

• Switching to a different borrower/loan
• Beginning a completely different topic
• Clearing complex conversation context
• Starting a new work session

Managing Multiple Conversations

Organization:

• Conversations auto-title based on content
• Sort by most recent or alphabetically
• Delete conversations you no longer need
• Archive important conversations

Integration with Loan Data

Loan-Specific Calculations

When working with a selected loan:

Borrower Context:

• Calculations can reference borrower information
• Income and debt data from loan file
• Property details if available
• Previous calculation history

Automatic Data Usage:

• "Calculate affordability for this borrower"
• "What are the payment options for this loan amount?"
• "Show me rates for this property type"

Contact Integration

Borrower Communication:

• Generate explanations for borrower questions
• Create summaries of calculation results
• Prepare comparison scenarios for borrower review

Troubleshooting Voice Assistant

Connection Issues

Session Won't Start

Solutions:

1. Check internet connection (Wi-Fi or cellular)
2. Force close and reopen the app
3. Verify microphone permissions are granted
4. Wait 30 seconds and try again

Session Keeps Disconnecting

Possible Causes:

• Weak internet connection
• Background app limitations
• iOS battery optimization

Solutions:

1. Switch to stronger Wi-Fi network
2. Disable Low Power Mode if active
3. Keep app in foreground during use
4. Check for iOS app updates

Voice Recognition Problems

AI Not Understanding Speech

Improvements:

1. Speak more clearly and slowly
2. Use text input as alternative
3. Rephrase questions differently
4. Check microphone isn't blocked

Wrong Transcription

Solutions:

1. Review transcription before AI responds
2. Use text input for complex terms
3. Spell out unusual words or names
4. Confirm microphone permissions

Calculation Issues

Incorrect Results

Steps to Take:

1. Verify the information you provided
2. Ask the AI to show its calculations
3. Double-check assumptions being made
4. Compare with known calculation tools

Missing Information

Requests for Clarification:

• "Show me the assumptions you're using"
• "Break down this calculation step by step"
• "What information do you need from me?"

Advanced Tips

Power User Features

Batch Calculations:

• Ask for multiple scenarios at once
• Compare several loan options simultaneously
• Generate comprehensive analysis reports

Data Integration:

• Reference borrower data from loan files
• Use property information automatically
• Integrate with rate sheets and pricing

Workflow Integration:

• Save calculations to loan files
• Share results with borrowers directly
• Export data to other systems

---

Next: Navigation & Interface - Learn to navigate LoanX's interface efficiently