* add trigger * small fixes * add missing workflow DTOs * small fixes * use activeOnWithChildren * fix active on when switching trigger type * remove add variable dropdown * feat: lang support * fix: type errors * feat: select voice agent * refactor: address feedback * refactor: address feedback * refactor: missing import * fix: types * add getAllWorkflowsFromRoutingForm to WorkflowService * fix error caused by undefined evt * fix type error * fix type error * fix tests * feat: add inbound calls * chore: formatting * chore * feat: finish inbound call * chore: formatting * fix: update bug * fix: types * code clean up * final fixes and clean up * remove console.log * remove template text form from triggers * add routing form repoditory function * refactor: Agent Configuration Sheet (#23930) * refactor: agent configuration sheet * chore: use default phone numbre * refactor: improvements * refactor: improvements * fix: types * fix: feedback * fix bug with key * chore: * fix: feedback * fix: prompt * add comments * fix: review * fix: review * refactor: class * refactor: class * fix test * allow cal ai action on form triggers * move any reusable code to scheduleAIPhoneCall * add missing await * use predefined FormSubmissionData type * add .trim() to sms message * pass contextData instead * finish base setup * add missing trigger in update-workflow.input.ts * allow cal.ai action for form triggers in handler * chore: add support for form workflows on api v2 * fixup! chore: add support for form workflows on api v2 * ai phone call on form submissions (WIP) * use existing type for Option array * pass chosen event type id * refactor: rename * Update apps/web/public/static/locales/en/common.json * Update apps/web/public/static/locales/en/common.json * add missing imports * chore: update set value * fix: remove index * fix: type error * fix: update tetss * use only repository functions in update handler * move all prisma queries from list.handler * review suggestions * fix: use logger * chore: handle workflows api v2 * chore: handle workflows api v2, split in 2 endpoints * fix workflow step creation * remove connect agent and fixes types * add type to workflow * chore: use workflow type in apiv2 WorkflowsOutputService * update worklfow type on update * chore: use workflow type in apiv2 WorkflowsOutputService * fix template body for torm trigger * some UI fixes for email subject/body * resetting email body when changing form triggers * use type field to query workflows * clean up all old active on values * remove responseId from all funciton calls * remove undefined from updateTemplate * refactor: don't use static * fix: type * refactor: split routing form and event-type workflows code * refactor: split routing form and event-type workflows code * fix template text when adding action * chore: don't rename WorkflowActivationDto to avoid ci blocking * refine update schedule to use only allowed actions * fix type error * don't allow whatsapp action with form trigger * fix type error * return early if activeOn array is empty * fix: from step type in BaseFormWorkflowStepDto * fixup! fix: from step type in BaseFormWorkflowStepDto * api v2 updates * move all prisma calls to repository (service/workflows.ts) * use FORM_TRIGGER_WORKFLOW_EVENTS for form queries * use userRepository * use FORM_TRIGGER_WORKFLOW_EVENTS in isFormTrigger * code clean up * code clean up * use repository functions in formSubmissionValidation.ts * fix: schema * refactor: * remove action check in update handler * add event type selection * event type selector improvements * adjust update.handler * set outboundEventTypeId * add back trpc import * fix agent repository functions * clean up * fix bugs caused by merge * pass eventTypeId to updateToolsFromAgentId * add migration for outboundEventTypeId * add SMS actions to allowed form action constants * add cal ai to allowed form actions * pick correct event type for web call * pass correct routed event type id * remove unsued import * fixes for offset api v2 * add missing responseId * fix failing test * fix failing test * improve error message * remove unused imports * chore: handle sms step action for form worklfow in dtos * fix typo * missing missing newStep * minor fixes * remove changes * add routedEventTypeId * fix type error * fix type error * fix typ error in executAPIPhoneCall.tsx * add back inboundEventTypeId * remove console.log * remove outdated code * small fixes * don't throw error for missing phone number * add back filtered triggerOptions * fix eventTypeId in testCall handler * fix type error * update migration * fix trigger is not defined * convert eventTypeId to string * only use outboundEventTypeId for FORM_SUBMITTED trigger * show toast when no event type selected * fix type errors * add missing translation * fix type error * remove callType * fix tests * small fixes * clean up AgentConfigurationSheet * remove EventTypeSelector file * code clean up * clean up * clean up * use resusable function for TestPhoneCallDialog and WebCallDialog * rename result * fix types for event type id * use repository runction in workflowReminder.ts * fix type error * pass eventTypeIds correctly * fix typo * Update apps/web/public/static/locales/en/common.json Co-authored-by: Udit Takkar <53316345+Udit-takkar@users.noreply.github.com> * use watch instead of getValues * change to z.record(z.unknown()) instead of any() * fix type of eventTypeId * check permissinon for outBoundEventTypeId * add isNaN check * improve function name * update tools when outbound agent event type id changes * pass missing outboundEventTypeId * update migration * fix test * remove cal-ai step from test --------- Co-authored-by: CarinaWolli <wollencarina@gmail.com> Co-authored-by: Udit Takkar <udit222001@gmail.com> Co-authored-by: Udit Takkar <53316345+Udit-takkar@users.noreply.github.com> Co-authored-by: Benny Joo <sldisek783@gmail.com> Co-authored-by: cal.com <morgan@cal.com> Co-authored-by: Morgan <33722304+ThyMinimalDev@users.noreply.github.com> Co-authored-by: Peer Richelsen <peeroke@gmail.com>
489 lines
16 KiB
TypeScript
489 lines
16 KiB
TypeScript
import Link from "next/link";
|
|
import { useState, useEffect, useRef, useCallback } from "react";
|
|
import type { UseFormReturn } from "react-hook-form";
|
|
import type { RetellWebClient } from "retell-client-js-sdk";
|
|
|
|
import { Dialog } from "@calcom/features/components/controlled-dialog";
|
|
import { useLocale } from "@calcom/lib/hooks/useLocale";
|
|
import { trpc } from "@calcom/trpc/react";
|
|
import { Alert } from "@calcom/ui/components/alert";
|
|
import { Button } from "@calcom/ui/components/button";
|
|
import { DialogContent, DialogFooter } from "@calcom/ui/components/dialog";
|
|
import { Icon } from "@calcom/ui/components/icon";
|
|
import { showToast } from "@calcom/ui/components/toast";
|
|
import { Tooltip } from "@calcom/ui/components/tooltip";
|
|
|
|
import { getEventTypeIdForCalAiTest } from "../lib/actionHelperFunctions";
|
|
import type { FormValues } from "../pages/workflow";
|
|
|
|
interface WebCallDialogProps {
|
|
open: boolean;
|
|
onOpenChange: (open: boolean) => void;
|
|
agentId: string;
|
|
teamId?: number;
|
|
isOrganization?: boolean;
|
|
form: UseFormReturn<FormValues>;
|
|
eventTypeIds?: number[];
|
|
outboundEventTypeId?: number | null;
|
|
}
|
|
|
|
interface TranscriptEntry {
|
|
speaker: "agent" | "user";
|
|
text: string;
|
|
timestamp: Date;
|
|
}
|
|
|
|
type CallStatus = "idle" | "connecting" | "active" | "ended" | "error";
|
|
|
|
export function WebCallDialog({
|
|
open,
|
|
onOpenChange,
|
|
agentId,
|
|
teamId,
|
|
isOrganization = false,
|
|
form,
|
|
eventTypeIds = [],
|
|
outboundEventTypeId,
|
|
}: WebCallDialogProps) {
|
|
const { t } = useLocale();
|
|
const [callStatus, setCallStatus] = useState<CallStatus>("idle");
|
|
const [transcript, setTranscript] = useState<TranscriptEntry[]>([]);
|
|
const [isMuted, setIsMuted] = useState(false);
|
|
const [callDuration, setCallDuration] = useState(0);
|
|
const [error, setError] = useState<string | null>(null);
|
|
|
|
const retellWebClientRef = useRef<RetellWebClient | null>(null);
|
|
const callStartTimeRef = useRef<Date | null>(null);
|
|
const durationIntervalRef = useRef<NodeJS.Timeout | null>(null);
|
|
const transcriptEndRef = useRef<HTMLDivElement>(null);
|
|
const callStatusRef = useRef<CallStatus>("idle");
|
|
|
|
const { data: hasCredits, isLoading: creditsLoading } = trpc.viewer.credits.hasAvailableCredits.useQuery(
|
|
{ teamId },
|
|
{ enabled: open }
|
|
);
|
|
|
|
const getBillingPath = () => {
|
|
if (!teamId) return "/settings/billing";
|
|
return isOrganization ? "/settings/organizations/billing" : `/settings/teams/${teamId}/billing`;
|
|
};
|
|
|
|
const createWebCallMutation = trpc.viewer.aiVoiceAgent.createWebCall.useMutation({
|
|
onSuccess: async (data) => {
|
|
try {
|
|
await startWebCall(data.accessToken);
|
|
} catch (error) {
|
|
console.error("Failed to start web call:", error);
|
|
setCallStatus("error");
|
|
setError(t("failed_to_start_web_call_try_again"));
|
|
}
|
|
},
|
|
onError: (error: { message: string }) => {
|
|
setCallStatus("error");
|
|
setError(error.message);
|
|
showToast(error.message, "error");
|
|
},
|
|
});
|
|
|
|
const startWebCall = async (accessToken: string) => {
|
|
try {
|
|
const { RetellWebClient } = await import("retell-client-js-sdk");
|
|
|
|
const retellWebClient = new RetellWebClient();
|
|
retellWebClientRef.current = retellWebClient;
|
|
|
|
retellWebClient.on("call_started", () => {
|
|
callStartTimeRef.current = new Date();
|
|
callStatusRef.current = "active";
|
|
setCallStatus("active");
|
|
startDurationTimer();
|
|
});
|
|
|
|
retellWebClient.on("call_ended", () => {
|
|
setCallStatus("ended");
|
|
stopDurationTimer();
|
|
});
|
|
|
|
retellWebClient.on("agent_start_talking", () => {
|
|
console.log("Agent started talking");
|
|
});
|
|
|
|
retellWebClient.on("agent_stop_talking", () => {
|
|
console.log("Agent stopped talking");
|
|
});
|
|
|
|
retellWebClient.on("update", (update: { transcript?: Array<{ role: string; content: string }> }) => {
|
|
console.log("📝 Received update event:", update);
|
|
|
|
if (update.transcript && Array.isArray(update.transcript)) {
|
|
console.log("📜 Transcript array received:", update.transcript);
|
|
|
|
try {
|
|
const newEntries: TranscriptEntry[] = update.transcript
|
|
.map((entry) => {
|
|
if (!entry.role || !entry.content) {
|
|
console.warn("⚠️ Invalid transcript entry:", entry);
|
|
return null;
|
|
}
|
|
const mappedEntry = {
|
|
speaker: entry.role === "agent" ? "agent" : "user",
|
|
text: entry.content,
|
|
timestamp: new Date(),
|
|
};
|
|
console.log("✅ Mapped transcript entry:", mappedEntry);
|
|
return mappedEntry;
|
|
})
|
|
.filter(Boolean) as TranscriptEntry[];
|
|
|
|
console.log("🔄 Setting transcript with entries:", newEntries.length, "entries");
|
|
console.log("📋 Current transcript state has:", transcript.length, "entries");
|
|
|
|
setTranscript(newEntries);
|
|
} catch (error) {
|
|
console.error("❌ Error processing transcript update:", error);
|
|
}
|
|
} else {
|
|
console.log(
|
|
"🚫 No transcript data in update or transcript is not an array:",
|
|
typeof update.transcript
|
|
);
|
|
}
|
|
});
|
|
|
|
retellWebClient.on("error", (error: Error | { message?: string }) => {
|
|
console.error("Web call error:", error);
|
|
setCallStatus("error");
|
|
setError(t("call_encountered_error_try_again"));
|
|
stopDurationTimer();
|
|
});
|
|
|
|
setCallStatus("connecting");
|
|
await retellWebClient.startCall({
|
|
accessToken: accessToken,
|
|
sampleRate: 24000,
|
|
emitRawAudioSamples: false,
|
|
});
|
|
} catch (error) {
|
|
console.error("Error starting web call:", error);
|
|
setCallStatus("error");
|
|
setError(t("failed_initialize_web_call_microphone_permissions"));
|
|
}
|
|
};
|
|
|
|
const startDurationTimer = useCallback(() => {
|
|
if (durationIntervalRef.current) {
|
|
clearInterval(durationIntervalRef.current);
|
|
durationIntervalRef.current = null;
|
|
}
|
|
|
|
if (!callStartTimeRef.current) {
|
|
return;
|
|
}
|
|
|
|
durationIntervalRef.current = setInterval(() => {
|
|
if (callStartTimeRef.current) {
|
|
const now = Date.now();
|
|
const startTime = callStartTimeRef.current.getTime();
|
|
const duration = Math.floor((now - startTime) / 1000);
|
|
if (duration >= 0) {
|
|
setCallDuration(duration);
|
|
}
|
|
}
|
|
}, 1000);
|
|
}, []);
|
|
|
|
const stopDurationTimer = () => {
|
|
if (durationIntervalRef.current) {
|
|
clearInterval(durationIntervalRef.current);
|
|
durationIntervalRef.current = null;
|
|
}
|
|
};
|
|
|
|
const handleStartCall = () => {
|
|
const eventTypeValidation = getEventTypeIdForCalAiTest({
|
|
trigger: form.getValues("trigger"),
|
|
outboundEventTypeId,
|
|
eventTypeIds,
|
|
activeOnEventTypeId: form.getValues("activeOn")?.[0]?.value,
|
|
t,
|
|
});
|
|
|
|
if (eventTypeValidation.error || !eventTypeValidation.eventTypeId) {
|
|
showToast(eventTypeValidation.error || t("no_event_type_selected"), "error");
|
|
return;
|
|
}
|
|
|
|
if (agentId) {
|
|
setError(null);
|
|
setTranscript([]);
|
|
setCallDuration(0);
|
|
createWebCallMutation.mutate({
|
|
agentId: agentId,
|
|
teamId: teamId,
|
|
eventTypeId: eventTypeValidation.eventTypeId,
|
|
});
|
|
}
|
|
};
|
|
|
|
const handleEndCall = async () => {
|
|
if (retellWebClientRef.current && callStatus === "active") {
|
|
try {
|
|
await retellWebClientRef.current.stopCall();
|
|
setCallStatus("ended");
|
|
stopDurationTimer();
|
|
} catch (error) {
|
|
console.error("Error ending call:", error);
|
|
}
|
|
}
|
|
};
|
|
|
|
const handleToggleMute = async () => {
|
|
if (retellWebClientRef.current && callStatus === "active") {
|
|
try {
|
|
if (isMuted) {
|
|
await retellWebClientRef.current.unmute();
|
|
} else {
|
|
await retellWebClientRef.current.mute();
|
|
}
|
|
setIsMuted(!isMuted);
|
|
} catch (error) {
|
|
console.error("Error toggling mute:", error);
|
|
}
|
|
}
|
|
};
|
|
|
|
const formatDuration = (seconds: number) => {
|
|
const mins = Math.floor(seconds / 60);
|
|
const secs = seconds % 60;
|
|
return `${mins.toString().padStart(2, "0")}:${secs.toString().padStart(2, "0")}`;
|
|
};
|
|
|
|
const getStatusIcon = () => {
|
|
switch (callStatus) {
|
|
case "connecting":
|
|
return <Icon name="loader" className="h-4 w-4 animate-spin rounded-full" />;
|
|
case "active":
|
|
return <Icon name="phone" className="text-success h-4 w-4" />;
|
|
case "ended":
|
|
return <Icon name="phone-off" className="text-muted h-4 w-4" />;
|
|
case "error":
|
|
return <Icon name="triangle-alert" className="text-error h-4 w-4" />;
|
|
default:
|
|
return <Icon name="phone" className="text-subtle h-4 w-4" />;
|
|
}
|
|
};
|
|
|
|
const getStatusText = () => {
|
|
switch (callStatus) {
|
|
case "connecting":
|
|
return t("connecting_to_agent");
|
|
case "active":
|
|
return `${t("call_active")} - ${formatDuration(callDuration)}`;
|
|
case "ended":
|
|
return `${t("call_ended")} - ${formatDuration(callDuration)}`;
|
|
case "error":
|
|
return t("call_error");
|
|
default:
|
|
return t("ready_to_start_call");
|
|
}
|
|
};
|
|
|
|
useEffect(() => {
|
|
if (transcriptEndRef.current) {
|
|
transcriptEndRef.current.scrollIntoView({ behavior: "smooth" });
|
|
}
|
|
}, [transcript]);
|
|
|
|
useEffect(() => {
|
|
return () => {
|
|
stopDurationTimer();
|
|
if (retellWebClientRef.current && callStatus === "active") {
|
|
try {
|
|
retellWebClientRef.current.stopCall();
|
|
} catch (error) {
|
|
console.error("Error stopping call during cleanup:", error);
|
|
}
|
|
}
|
|
};
|
|
}, [callStatus]);
|
|
|
|
useEffect(() => {
|
|
callStatusRef.current = callStatus;
|
|
|
|
if (callStatus === "active" && callStartTimeRef.current && !durationIntervalRef.current) {
|
|
startDurationTimer();
|
|
}
|
|
}, [callStatus, startDurationTimer]);
|
|
|
|
useEffect(() => {
|
|
return () => {
|
|
stopDurationTimer();
|
|
};
|
|
}, []);
|
|
|
|
const resetDialogState = () => {
|
|
setCallStatus("idle");
|
|
callStatusRef.current = "idle";
|
|
setTranscript([]);
|
|
setIsMuted(false);
|
|
setCallDuration(0);
|
|
setError(null);
|
|
callStartTimeRef.current = null;
|
|
stopDurationTimer();
|
|
retellWebClientRef.current = null;
|
|
};
|
|
|
|
return (
|
|
<Dialog
|
|
open={open}
|
|
onOpenChange={(open) => {
|
|
if (!open) {
|
|
if (retellWebClientRef.current) {
|
|
try {
|
|
retellWebClientRef.current.stopCall();
|
|
} catch (e) {
|
|
console.error("Error stopping call on close:", e);
|
|
}
|
|
}
|
|
resetDialogState();
|
|
}
|
|
onOpenChange(open);
|
|
}}>
|
|
<DialogContent
|
|
enableOverflow
|
|
type="creation"
|
|
title={t("web_call")}
|
|
description={t("test_your_agent_with_web_call")}>
|
|
{!creditsLoading && (
|
|
<Alert
|
|
severity="info"
|
|
CustomIcon="info"
|
|
title={t("credits_required")}
|
|
message={
|
|
hasCredits ? (
|
|
t("web_call_credits_info")
|
|
) : (
|
|
<>
|
|
{t("web_call_no_credits")}{" "}
|
|
<Link href={getBillingPath()} className="text-semantic-info underline">
|
|
{t("purchase_credits")}
|
|
</Link>
|
|
</>
|
|
)
|
|
}
|
|
/>
|
|
)}
|
|
<div className="mt-2 flex items-center justify-between rounded-lg border p-3">
|
|
<div className="flex items-center gap-2">
|
|
{getStatusIcon()}
|
|
<span className="text-sm font-medium">{getStatusText()}</span>
|
|
</div>
|
|
{callStatus === "active" && (
|
|
<div className="flex items-center gap-2">
|
|
<div className="bg-error h-2 w-2 animate-pulse rounded-full" />
|
|
<span className="text-subtle text-xs">{t("live")}</span>
|
|
</div>
|
|
)}
|
|
</div>
|
|
|
|
<div className="mt-2 rounded-lg border p-3 placeholder:min-h-[300px]">
|
|
<div className="mb-3 flex items-center justify-between">
|
|
<h4 className="text-sm font-medium">{t("transcript")}</h4>
|
|
{transcript.length > 0 && (
|
|
<Button
|
|
type="button"
|
|
color="secondary"
|
|
size="sm"
|
|
variant="icon"
|
|
onClick={() => setTranscript([])}
|
|
disabled={callStatus === "active"}>
|
|
<Icon name="trash" className="h-4 w-4" />
|
|
</Button>
|
|
)}
|
|
</div>
|
|
|
|
<div className="h-60 space-y-3 overflow-y-auto p-2">
|
|
{transcript.length === 0 ? (
|
|
<div className="flex h-40 items-center justify-center text-center">
|
|
<div>
|
|
<Icon name="message-circle" className="text-subtle mx-auto h-8 w-8" />
|
|
<p className="text-subtle mt-2 text-sm">
|
|
{callStatus === "idle"
|
|
? t("start_call_to_see_conversation")
|
|
: t("waiting_for_conversation")}
|
|
</p>
|
|
</div>
|
|
</div>
|
|
) : (
|
|
transcript.map((entry, index) => (
|
|
<div
|
|
key={index}
|
|
className={`flex gap-2 ${entry.speaker === "agent" ? "justify-start" : "justify-end"}`}>
|
|
<div
|
|
className={`max-w-[80%] rounded-lg px-3 py-2 text-sm ${
|
|
entry.speaker === "agent"
|
|
? "border-brand bg-brand/10 text-brand-emphasis border"
|
|
: "border-subtle bg-subtle text-emphasis border"
|
|
}`}>
|
|
<div className="mb-1 flex items-center gap-2">
|
|
<span className="text-xs font-medium">
|
|
{entry.speaker === "agent" ? t("ai_agent") : t("you")}
|
|
</span>
|
|
</div>
|
|
<p>{entry.text}</p>
|
|
</div>
|
|
</div>
|
|
))
|
|
)}
|
|
<div ref={transcriptEndRef} />
|
|
</div>
|
|
</div>
|
|
|
|
{error && callStatus === "error" && (
|
|
<div className="border-error bg-error/10 rounded-lg p-3">
|
|
<div className="flex items-center gap-2">
|
|
<Icon name="triangle-alert" className="text-error h-6 w-6" />
|
|
<span className="text-error text-sm">{error}</span>
|
|
</div>
|
|
</div>
|
|
)}
|
|
|
|
<DialogFooter showDivider className="mt-6">
|
|
<div className="flex gap-2">
|
|
{callStatus === "active" && (
|
|
<Button type="button" color="secondary" onClick={handleToggleMute} variant="icon">
|
|
<Icon name={isMuted ? "mic-off" : "mic"} className="h-4 w-4" />
|
|
</Button>
|
|
)}
|
|
|
|
{callStatus === "idle" ||
|
|
callStatus === "error" ||
|
|
callStatus === "ended" ||
|
|
callStatus === "connecting" ? (
|
|
<Tooltip content={!hasCredits ? t("credits_required_tooltip") : undefined}>
|
|
<Button
|
|
type="button"
|
|
onClick={handleStartCall}
|
|
loading={createWebCallMutation.isPending || callStatus === "connecting"}
|
|
disabled={!hasCredits || createWebCallMutation.isPending || callStatus === "connecting"}>
|
|
<Icon name="phone" className="mr-2 h-4 w-4" />
|
|
{callStatus === "connecting" ? t("connecting") : t("start_web_call")}
|
|
</Button>
|
|
</Tooltip>
|
|
) : (
|
|
<Button
|
|
type="button"
|
|
color="destructive"
|
|
onClick={handleEndCall}
|
|
disabled={callStatus !== "active"}>
|
|
<Icon name="phone-off" className="mr-2 h-4 w-4" />
|
|
{t("end_call")}
|
|
</Button>
|
|
)}
|
|
</div>
|
|
</DialogFooter>
|
|
</DialogContent>
|
|
</Dialog>
|
|
);
|
|
}
|