Phone
Web
App
WhatsApp
Vanira agentApp · English
Camera view: cracked screen · 94%cracked screen · 94%◉ Sees
Caller

“My new phone arrived cracked.”

Agent

I can see it. A replacement is on its way.

ActsReplacement approved

Refund approvedRefund agent

See the agents at work

Conversations that finish the job, not just answer questions.

Onboarding verification agent
Video refund verification agent
Web AI receptionist
Web AI receptionist
A phone receptionist
A phone receptionist
An outbound sales dialer
An outbound sales dialer

Every Vanira agent

  • Talks and listens, in 99+ languages
  • Sees camera, screen and documents
  • Acts in your tools and workflows
  • Remembers every conversation
  • Phone, web, app and WhatsApp

Our philosophy

Human interaction has always been multimodal.

When two people sort something out, words are only one part of it. They talk, point, hold things up, and act, all at the same time. Here is thirty seconds of one such conversation.

SPEECHVISIONACTIONAB0s10s20s30s
Fig. 1 — A conversation, three tracksAShe says “right here” while the camera catches the crack.BThe agent opens the claim while it is still talking.

Text-only AI keeps one of these tracks. Vanira agents work with all three.

01

Listen like a person.

People interrupt, pause, and think out loud. The agent keeps up in live voice, with natural turn-taking.

02

Look at what matters.

The camera, the screen, and the document are part of the conversation, not a separate upload step.

03

Act, then confirm.

The agent does the work inside your product while the person watches, corrects, and stays in control.

Video refund verification agent

“It arrived broken.” Sorted on one call.

The customer shows the damage on camera while they explain what happened. The agent checks it, matches the order, and approves the refund or replacement before the call ends.

  • Sees the damage live, no photo uploads or email threads
  • Checks the order and your return policy as it talks
  • Approves, replaces, or escalates, with a full record
Live · Video call · Returns
01:12
Customer holding a phone camera over a cracked speaker in its damaged boxCustomer camera

Customer

My speaker arrived with a crack down the side.

Vanira agent

Sorry about that. Could you hold it up to the camera?

Customer

Here, see the crack?

damage detected · 0.94

Vanira agent

I can see it, and the box is crushed too. Your order #4821 is covered.

replacement approved

Vanira agent

A new one ships tomorrow. I’ve sent the details on WhatsApp.

Onboarding verification agent

Verify a new customer in one conversation.

The agent talks the customer through it: show your ID, look at the camera, done. The document check, liveness, and face match happen during the call, with a full audit trail.

  • Reads the ID document on camera
  • Checks liveness and face match while it talks
  • Pass or fail in the same session, fully logged
Live · Video call · Onboarding
01:24
Phone screen during a live verification session, showing a face scan and a detected ID documentCustomer camera

Vanira agent

Hi! I’ll verify your account. Could you hold your ID card up to the camera?

Customer

Sure, here it is.

ID read · name matched

Vanira agent

Thanks. Now look at the camera and blink once.

liveness passed · face match 0.98

Vanira agent

All done, you’re verified. Your account is active.

account approved · 74 s

Under the hood

Built in India, ready for the world.

Speaks your customer's language

Vanira agents talk and listen in 99+ languages, including Hindi, Telugu, Tamil and Kannada, and switch mid-call when the customer does.

Helloनमस्तेనమస్కారం99+ languagesவணக்கம்Tamilನಮಸ್ಕಾರHindiKannadaনমস্কারTeluguHolaMarathiനമസ്കാരംBonjourBengaliمرحباSpanishનમસ્તેArabic

Fast enough to interrupt

Replies start in under 500 ms, so people can pause, cut in and talk naturally, like a normal phone call.

Your interview is booked for Tuesday at 3 PM. · Reminder sent on WhatsApp. ·
Customer stops< 500 msAgent answers
Developer SDK

Build multimodal agents in minutes.

Widget embed, React web SDK, React Native, or headless — one runtime for voice, vision, and agent-driven UI. Wire your tools, use built-in presets, and ship without a rebuild.

Widget embed

One script tag — full voice UI with presets. No npm install.

VaniraCallBox

Drop-in React voice pill with preset UI and custom tool hooks.

Headless client

Full control over call UI with PresetRenderer for agent-driven modals.

React Native SDK

iOS & Android voice + native preset modals (upload, camera, calendar).

Client tool calls

Agent triggers your UI — forms, uploads, navigation, or custom logic.

[ @vanira/sdk ]example.ts
<script
  src="https://unpkg.com/@vanira/sdk@latest/dist/vanira-sdk.js"
  data-widget-id="YOUR_WIDGET_ID"
  data-pk-key="pk_live_YOUR_KEY"
  defer
></script>
npm install @vanira/sdk

Developer stories

Built by devs. For the agentic future.

"

The sub-500ms latency is real. Building a Voice-First Operator with this SDK felt like playing with the future. The state synchronization is flawless.

Arjun K.

CTO @ AI Automation Lab

"

Finally, an SDK that gives me direct DOM manipulation. We built a voice-guided autonomous checkout in hours, not weeks. The Jarvis Engine is a game-changer.

Sarah L.

Lead Frontend Engineer

"

The Multi-Agent architecture is the cleanest I've seen. Orchestrating a specialized support workforce with shared context was surprisingly intuitive.

Michael T.

Senior AI Architect

npm install @vanira/sdk
1.2k downloads
100+ agents deployed
Interaction Research

Agentic UI Coordination.

Moving beyond command-and-response. Agentic UI blends spoken intent with live visual presets — swapping calendars, forms, cameras, DOM actions, and uploads mid-call without breaking conversation flow.

Bi-directional State Sync

Speaking coordinates changes on the interface instantly. Manual UI interactions alter the agent's conversational goals in real time.

Interruption & Context-Merge

Humans can interrupt mid-sentence by talking or clicking — new input merges into the active state graph without resetting context.

Co-pilot Confirmation Cards

Transient confirmation cards for sensitive actions let the human securely verify and guide agent operations.

8 Built-in Action Presets

Form, Calendar, Navigate, Highlight, Search, Click, Upload, Camera — drop in with one tool call. Fully customisable or bring your own preset.

Data Collection Form
Collecting User Details
Date & Time Picker
Schedule Appointment
Navigate to Route
Redirecting User
Highlight Element
Drawing Glow Overlay
Filter / Search
Auto-Typing into Search
Click Element
Simulating User Click
File Upload
Document Upload Active
Camera Capture
Live Camera Feed Active
UI FORM
vanira_form
NameArjun Sharma
Emailarjun@email.com
Phone+91 98765 43210
Collecting User Details
New Capability

Multimodal Vision AI

Live Video Streaming

Launch a real-time camera feed mid-call. Your agent sees what the user sees for live damage assessments and hardware troubleshooting.

Instant Document Uploads

Securely receive KYC identity documents, receipts, and photos instantly without dropping the voice conversation.

Session-Bound Transport

Media bytes travel over the WebRTC data channel — never from the client to external URLs. Vanira ingests in-session before any downstream routing.

Vanira VISTA
Document + liveness active
Vanira Resolve
Assessing damage...
Product Inspect
Serial & packaging check
Face Match
Pass / fail in session
Scan target
ID_PHOTO (99%)
MRZ_TEXT (98%)
The routing layer

Intelligent Model Routing

This is not a webhook checkbox. Vanira is the multimodal orchestration runtime — one live call, one secure ingest pipe, and a dashboard where every upload type routes to the right brain: frontier vision LLMs, Vanira custom-trained and industry fine-tuned models, customer YOLO endpoints, or your own APIs — with results fed back into the conversation in real time.

End-to-end pipeline

Capture

SDK upload / live vision

Camera, upload preset, or live frame loop — all over WebRTC media-bytes.

Ingest

Session-bound intake

Vanira assembles frames server-side. No client POST to third-party URLs.

Match

Reason tag routing

kyc_photo, live_detection, * — each reason maps to a media handler.

Process

Your model or ours

Vision LLM, Vanira fine-tuned models, YOLO, Roboflow, Hugging Face, or custom webhooks.

Respond

Inject + interrupt

Detections and OCR land back in the agent context. Agent speaks immediately.

Why it matters

Reason-native routing

Each preset sends a reason tag — kyc_photo, live_detection, invoice_scan. Match handlers per agent without redeploying client code.

Pluggable vision backends

Route to Vanira proprietary & fine-tuned industry models, YOLO presets, or your webhook with custom auth headers. Vanira POSTs server-side after ingest.

Conversation injection

OCR, bounding boxes, and model output inject as system or user context — with optional agent interrupt mid-sentence.

Route to any vision backend

Media handler destinations
Vision LLM
In-session multimodal reasoning
Vanira Custom Vision
Proprietary models + industry fine-tunes — agri, KYC, damage, retail
YOLO / Ultralytics
Object detection via Ultralytics predict API
Roboflow
Hosted & serverless inference
Hugging Face
Dedicated inference endpoints
Custom webhook
Your API + auth headers
Replicate · Clarifai · Azure
Preset adapters rolling out

Configure in Agent → Media. Uploads always ingress over WebRTC; routing and webhooks execute on Vanira infrastructure.

Default multimodal runtime.

One SDK for Vanira Resolve (returns) and Vanira VISTA (authentication) — web embed, mobile, and commerce plugins.

Industry Leading
Latency
Zero-Lag Optimization

Industry Leading Latency

Proprietary communication protocols engineered for human-grade conversation loops without perceptible delay.

Multimodal Orchestration

Route live camera frames to vision models, webhooks, and in-app actions — one runtime for returns, KYC, and extensions.

Voice Browser Operator

Eyes and hands on the web. Direct DOM manipulation, autonomous navigations, and real-time form execution powered by the Voice SDK.

WebRTC Transport

Stateful Media Streams. Full-duplex WebRTC connections ensuring rock-solid stability and zero-jitter voice data transmission.

[20:14:02] STT: "नमस्ते, मुझे बुक..."
[20:14:02] LLM: EXECUTE sync_calendar
[20:14:03] TTS: SYNTHESIZING response...

Dev Observability

Deep Traces & Debugging. Real-time visibility into LLM chains, STT confidence scores, and action execution logs.

Full-Stack Agency

Absolute Extensibility. Inject custom LLMs, proprietary STT models, or unique voice synthesis pipelines into your operator.

Autonomous Workflows

Self-Correcting Browser Logic. Agents capable of reasoning through multi-step processes and recovering from UI errors autonomously.

"Add this to my cart"
"Adding to cart... Done!"
Store
1
Add to Cart
Cart
Pay Now

Voice-to-UI Bridge

Autonomous form fills, navigations, and real-time state manipulation. The SDK bridges the gap between voice and browser UI for a true multi-modal experience.

Hindi
Telugu
Tamil
Kannada
Marathi
Bengali

Indic Native Models

Fine-tuned for Bharat. 11+ regional dialects with state-of-the-art phonetic accuracy for localized operator sessions.

Commerce & Identity

One SDK. Every surface.

Returns & Refunds

Live damage inspect, fraud check, and approve/deny inside the storefront session.

KYC & Onboarding

Liveness, document match, and pass/fail verdict — no app switching.

Shopify & Web Embed

Script tag or theme block — same agent on WooCommerce and custom React apps.

React Native

Mobile commerce and banking flows with native camera, forms, and navigate presets.

client.uploadMedia()

Native Multimodal Vision

Build returns and KYC agents that see live — camera, uploads, and documents inside the same WebRTC call. One SDK line to capture; Vanira routes frames and completes in-app.

media_upload.ts
import { VaniraClient } from '@vanira/sdk';

const client = new VaniraClient({
    agentId: 'ag_returns_kyc',
    callId: session.call_id,
    serverUrl: session.worker_url
});

// User uploads damage photo or ID mid-call
client.on('connected', async () => {
    await client.uploadMedia(damagePhoto, 'image', 'Inspect for refund approval');
    console.log("Agent inspects live and triggers refund or KYC pass/fail");
});

await client.start();

The Integration Ecosystem

Connected to your entire stack.

Vanira doesn't live in a silo. It integrates natively with the tools your team uses every single day.

Intelligence & Reasoning

Orchestrate multi-agent workflows with the world's most capable models.

+ Many More

Voice & Speech Synthesis

Human-grade TTS and ultra-low latency STT for natural conversations.

+ Many More

CRM & Sales Operations

Automate data entry and lead management across your entire sales stack.

+ Many More

Calendars & Scheduling

Direct-to-calendar bookings on autopilot with full availability sync.

+ Many More
Need a custom integration? Build it with our SDK
Vanira Enterprise Infrastructure Schematic
Enterprise Grade Voice Operations

Vanira Resolve & VISTA that complete in-session.

Live damage inspection and refund decisions with Resolve; identity verification with VISTA — embedded on web, mobile, and Shopify via one multimodal runtime.

Vanira Resolve — Returns & Damage Claims

Deliver instant resolution on replacement requests, product return status, and damage policy queries with real-time API integrations.

Vanira VISTA — Secure Onboarding

Visual Session Technology for Authentication — verification, biometric consent, and document confirmation inside WebRTC streams.

High-Velocity Sales & Routing

Qualify inbound leads, run appointment callbacks, and transfer high-intent clients to human agents with full historical transcripts.

Customer Support & Troubleshooting

Resolve technical diagnostics and account queries with empathetic voice responses, active listening, and instant tool actions.

Pre-certified for HIPAA, SOC-2 compliance, and local residency requirements.