Files
calendar/packages/features/ee/workflows/components/WebCallDialog.tsx
T
9e1e50e90b feat: cal.ai form triggers #4 (#23587)
* add trigger

* small fixes

* add missing workflow DTOs

* small fixes

* use activeOnWithChildren

* fix active on when switching trigger type

* remove add variable dropdown

* feat: lang support

* fix: type errors

* feat: select voice agent

* refactor: address feedback

* refactor: address feedback

* refactor: missing import

* fix: types

* add getAllWorkflowsFromRoutingForm to WorkflowService

* fix error caused by undefined evt

* fix type error

* fix type error

* fix tests

* feat: add inbound calls

* chore: formatting

* chore

* feat: finish inbound call

* chore: formatting

* fix: update bug

* fix: types

* code clean up

* final fixes and clean up

* remove console.log

* remove template text form from triggers

* add routing form repoditory function

* refactor: Agent Configuration Sheet (#23930)

* refactor: agent configuration sheet

* chore: use default phone numbre

* refactor: improvements

* refactor: improvements

* fix: types

* fix: feedback

* fix bug with key

* chore:

* fix: feedback

* fix: prompt

* add comments

* fix: review

* fix: review

* refactor: class

* refactor: class

* fix test

* allow cal ai action on form triggers

* move any reusable code to scheduleAIPhoneCall

* add missing await

* use predefined FormSubmissionData type

* add .trim() to sms message

* pass contextData instead

* finish base setup

* add missing trigger in update-workflow.input.ts

* allow cal.ai action for form triggers in handler

* chore: add support for form workflows on api v2

* fixup! chore: add support for form workflows on api v2

* ai phone call on form submissions (WIP)

* use existing type for Option array

* pass chosen event type id

* refactor: rename

* Update apps/web/public/static/locales/en/common.json

* Update apps/web/public/static/locales/en/common.json

* add missing imports

* chore: update set value

* fix: remove index

* fix: type error

* fix: update tetss

* use only repository functions in update handler

* move all prisma queries from list.handler

* review suggestions

* fix: use logger

* chore: handle workflows api v2

* chore: handle workflows api v2, split in 2 endpoints

* fix workflow step creation

* remove connect agent and fixes types

* add type to workflow

* chore: use workflow type in apiv2 WorkflowsOutputService

* update worklfow type on update

* chore: use workflow type in apiv2 WorkflowsOutputService

* fix template body for torm trigger

* some UI fixes for email subject/body

* resetting email body when changing form triggers

* use type field to query workflows

* clean up all old active on values

* remove responseId from all funciton calls

* remove undefined from updateTemplate

* refactor: don't use static

* fix: type

* refactor: split routing form and event-type workflows code

* refactor: split routing form and event-type workflows code

* fix template  text when adding action

* chore: don't rename WorkflowActivationDto to avoid ci blocking

* refine update schedule to use only allowed actions

* fix type error

* don't allow whatsapp action with form trigger

* fix type error

* return early if activeOn array is empty

* fix: from step type in BaseFormWorkflowStepDto

* fixup! fix: from step type in BaseFormWorkflowStepDto

* api v2 updates

* move all prisma calls to repository (service/workflows.ts)

* use FORM_TRIGGER_WORKFLOW_EVENTS for form queries

* use userRepository

* use FORM_TRIGGER_WORKFLOW_EVENTS in isFormTrigger

* code clean up

* code clean up

* use repository functions in formSubmissionValidation.ts

* fix: schema

* refactor:

* remove action check in update handler

* add event type selection

* event type selector improvements

* adjust update.handler

* set outboundEventTypeId

* add back trpc  import

* fix agent repository functions

* clean up

* fix bugs caused by merge

* pass eventTypeId to updateToolsFromAgentId

* add migration for outboundEventTypeId

* add SMS actions to allowed form action constants

* add cal ai to allowed form actions

* pick correct event type for web call

* pass correct routed event type id

* remove unsued import

* fixes for offset api v2

* add missing responseId

* fix failing test

* fix failing test

* improve error message

* remove unused imports

* chore: handle sms step action for form worklfow in dtos

* fix typo

* missing missing newStep

* minor fixes

* remove changes

* add routedEventTypeId

* fix type error

* fix type error

* fix typ error in executAPIPhoneCall.tsx

* add back inboundEventTypeId

* remove console.log

* remove outdated code

* small fixes

* don't throw error for missing phone number

* add  back filtered triggerOptions

* fix eventTypeId in testCall handler

* fix type error

* update migration

* fix trigger is not defined

* convert eventTypeId to string

* only use outboundEventTypeId for FORM_SUBMITTED trigger

* show toast when no event type selected

* fix type errors

* add missing translation

* fix type error

* remove callType

* fix tests

* small fixes

* clean up AgentConfigurationSheet

* remove EventTypeSelector file

* code clean up

* clean up

* clean up

* use resusable function for TestPhoneCallDialog and WebCallDialog

* rename result

* fix types for event type id

* use repository runction in workflowReminder.ts

* fix type error

* pass eventTypeIds correctly

* fix typo

* Update apps/web/public/static/locales/en/common.json

Co-authored-by: Udit Takkar <53316345+Udit-takkar@users.noreply.github.com>

* use watch instead of getValues

* change to  z.record(z.unknown()) instead of any()

* fix type of eventTypeId

* check permissinon for outBoundEventTypeId

* add isNaN check

* improve function name

* update tools when outbound agent event type id changes

* pass missing outboundEventTypeId

* update migration

* fix test

* remove cal-ai step from test

---------

Co-authored-by: CarinaWolli <wollencarina@gmail.com>
Co-authored-by: Udit Takkar <udit222001@gmail.com>
Co-authored-by: Udit Takkar <53316345+Udit-takkar@users.noreply.github.com>
Co-authored-by: Benny Joo <sldisek783@gmail.com>
Co-authored-by: cal.com <morgan@cal.com>
Co-authored-by: Morgan <33722304+ThyMinimalDev@users.noreply.github.com>
Co-authored-by: Peer Richelsen <peeroke@gmail.com>
2025-11-11 15:24:31 +02:00

489 lines
16 KiB
TypeScript

import Link from "next/link";
import { useState, useEffect, useRef, useCallback } from "react";
import type { UseFormReturn } from "react-hook-form";
import type { RetellWebClient } from "retell-client-js-sdk";
import { Dialog } from "@calcom/features/components/controlled-dialog";
import { useLocale } from "@calcom/lib/hooks/useLocale";
import { trpc } from "@calcom/trpc/react";
import { Alert } from "@calcom/ui/components/alert";
import { Button } from "@calcom/ui/components/button";
import { DialogContent, DialogFooter } from "@calcom/ui/components/dialog";
import { Icon } from "@calcom/ui/components/icon";
import { showToast } from "@calcom/ui/components/toast";
import { Tooltip } from "@calcom/ui/components/tooltip";
import { getEventTypeIdForCalAiTest } from "../lib/actionHelperFunctions";
import type { FormValues } from "../pages/workflow";
interface WebCallDialogProps {
open: boolean;
onOpenChange: (open: boolean) => void;
agentId: string;
teamId?: number;
isOrganization?: boolean;
form: UseFormReturn<FormValues>;
eventTypeIds?: number[];
outboundEventTypeId?: number | null;
}
interface TranscriptEntry {
speaker: "agent" | "user";
text: string;
timestamp: Date;
}
type CallStatus = "idle" | "connecting" | "active" | "ended" | "error";
export function WebCallDialog({
open,
onOpenChange,
agentId,
teamId,
isOrganization = false,
form,
eventTypeIds = [],
outboundEventTypeId,
}: WebCallDialogProps) {
const { t } = useLocale();
const [callStatus, setCallStatus] = useState<CallStatus>("idle");
const [transcript, setTranscript] = useState<TranscriptEntry[]>([]);
const [isMuted, setIsMuted] = useState(false);
const [callDuration, setCallDuration] = useState(0);
const [error, setError] = useState<string | null>(null);
const retellWebClientRef = useRef<RetellWebClient | null>(null);
const callStartTimeRef = useRef<Date | null>(null);
const durationIntervalRef = useRef<NodeJS.Timeout | null>(null);
const transcriptEndRef = useRef<HTMLDivElement>(null);
const callStatusRef = useRef<CallStatus>("idle");
const { data: hasCredits, isLoading: creditsLoading } = trpc.viewer.credits.hasAvailableCredits.useQuery(
{ teamId },
{ enabled: open }
);
const getBillingPath = () => {
if (!teamId) return "/settings/billing";
return isOrganization ? "/settings/organizations/billing" : `/settings/teams/${teamId}/billing`;
};
const createWebCallMutation = trpc.viewer.aiVoiceAgent.createWebCall.useMutation({
onSuccess: async (data) => {
try {
await startWebCall(data.accessToken);
} catch (error) {
console.error("Failed to start web call:", error);
setCallStatus("error");
setError(t("failed_to_start_web_call_try_again"));
}
},
onError: (error: { message: string }) => {
setCallStatus("error");
setError(error.message);
showToast(error.message, "error");
},
});
const startWebCall = async (accessToken: string) => {
try {
const { RetellWebClient } = await import("retell-client-js-sdk");
const retellWebClient = new RetellWebClient();
retellWebClientRef.current = retellWebClient;
retellWebClient.on("call_started", () => {
callStartTimeRef.current = new Date();
callStatusRef.current = "active";
setCallStatus("active");
startDurationTimer();
});
retellWebClient.on("call_ended", () => {
setCallStatus("ended");
stopDurationTimer();
});
retellWebClient.on("agent_start_talking", () => {
console.log("Agent started talking");
});
retellWebClient.on("agent_stop_talking", () => {
console.log("Agent stopped talking");
});
retellWebClient.on("update", (update: { transcript?: Array<{ role: string; content: string }> }) => {
console.log("📝 Received update event:", update);
if (update.transcript && Array.isArray(update.transcript)) {
console.log("📜 Transcript array received:", update.transcript);
try {
const newEntries: TranscriptEntry[] = update.transcript
.map((entry) => {
if (!entry.role || !entry.content) {
console.warn("⚠️ Invalid transcript entry:", entry);
return null;
}
const mappedEntry = {
speaker: entry.role === "agent" ? "agent" : "user",
text: entry.content,
timestamp: new Date(),
};
console.log("✅ Mapped transcript entry:", mappedEntry);
return mappedEntry;
})
.filter(Boolean) as TranscriptEntry[];
console.log("🔄 Setting transcript with entries:", newEntries.length, "entries");
console.log("📋 Current transcript state has:", transcript.length, "entries");
setTranscript(newEntries);
} catch (error) {
console.error("❌ Error processing transcript update:", error);
}
} else {
console.log(
"🚫 No transcript data in update or transcript is not an array:",
typeof update.transcript
);
}
});
retellWebClient.on("error", (error: Error | { message?: string }) => {
console.error("Web call error:", error);
setCallStatus("error");
setError(t("call_encountered_error_try_again"));
stopDurationTimer();
});
setCallStatus("connecting");
await retellWebClient.startCall({
accessToken: accessToken,
sampleRate: 24000,
emitRawAudioSamples: false,
});
} catch (error) {
console.error("Error starting web call:", error);
setCallStatus("error");
setError(t("failed_initialize_web_call_microphone_permissions"));
}
};
const startDurationTimer = useCallback(() => {
if (durationIntervalRef.current) {
clearInterval(durationIntervalRef.current);
durationIntervalRef.current = null;
}
if (!callStartTimeRef.current) {
return;
}
durationIntervalRef.current = setInterval(() => {
if (callStartTimeRef.current) {
const now = Date.now();
const startTime = callStartTimeRef.current.getTime();
const duration = Math.floor((now - startTime) / 1000);
if (duration >= 0) {
setCallDuration(duration);
}
}
}, 1000);
}, []);
const stopDurationTimer = () => {
if (durationIntervalRef.current) {
clearInterval(durationIntervalRef.current);
durationIntervalRef.current = null;
}
};
const handleStartCall = () => {
const eventTypeValidation = getEventTypeIdForCalAiTest({
trigger: form.getValues("trigger"),
outboundEventTypeId,
eventTypeIds,
activeOnEventTypeId: form.getValues("activeOn")?.[0]?.value,
t,
});
if (eventTypeValidation.error || !eventTypeValidation.eventTypeId) {
showToast(eventTypeValidation.error || t("no_event_type_selected"), "error");
return;
}
if (agentId) {
setError(null);
setTranscript([]);
setCallDuration(0);
createWebCallMutation.mutate({
agentId: agentId,
teamId: teamId,
eventTypeId: eventTypeValidation.eventTypeId,
});
}
};
const handleEndCall = async () => {
if (retellWebClientRef.current && callStatus === "active") {
try {
await retellWebClientRef.current.stopCall();
setCallStatus("ended");
stopDurationTimer();
} catch (error) {
console.error("Error ending call:", error);
}
}
};
const handleToggleMute = async () => {
if (retellWebClientRef.current && callStatus === "active") {
try {
if (isMuted) {
await retellWebClientRef.current.unmute();
} else {
await retellWebClientRef.current.mute();
}
setIsMuted(!isMuted);
} catch (error) {
console.error("Error toggling mute:", error);
}
}
};
const formatDuration = (seconds: number) => {
const mins = Math.floor(seconds / 60);
const secs = seconds % 60;
return `${mins.toString().padStart(2, "0")}:${secs.toString().padStart(2, "0")}`;
};
const getStatusIcon = () => {
switch (callStatus) {
case "connecting":
return <Icon name="loader" className="h-4 w-4 animate-spin rounded-full" />;
case "active":
return <Icon name="phone" className="text-success h-4 w-4" />;
case "ended":
return <Icon name="phone-off" className="text-muted h-4 w-4" />;
case "error":
return <Icon name="triangle-alert" className="text-error h-4 w-4" />;
default:
return <Icon name="phone" className="text-subtle h-4 w-4" />;
}
};
const getStatusText = () => {
switch (callStatus) {
case "connecting":
return t("connecting_to_agent");
case "active":
return `${t("call_active")} - ${formatDuration(callDuration)}`;
case "ended":
return `${t("call_ended")} - ${formatDuration(callDuration)}`;
case "error":
return t("call_error");
default:
return t("ready_to_start_call");
}
};
useEffect(() => {
if (transcriptEndRef.current) {
transcriptEndRef.current.scrollIntoView({ behavior: "smooth" });
}
}, [transcript]);
useEffect(() => {
return () => {
stopDurationTimer();
if (retellWebClientRef.current && callStatus === "active") {
try {
retellWebClientRef.current.stopCall();
} catch (error) {
console.error("Error stopping call during cleanup:", error);
}
}
};
}, [callStatus]);
useEffect(() => {
callStatusRef.current = callStatus;
if (callStatus === "active" && callStartTimeRef.current && !durationIntervalRef.current) {
startDurationTimer();
}
}, [callStatus, startDurationTimer]);
useEffect(() => {
return () => {
stopDurationTimer();
};
}, []);
const resetDialogState = () => {
setCallStatus("idle");
callStatusRef.current = "idle";
setTranscript([]);
setIsMuted(false);
setCallDuration(0);
setError(null);
callStartTimeRef.current = null;
stopDurationTimer();
retellWebClientRef.current = null;
};
return (
<Dialog
open={open}
onOpenChange={(open) => {
if (!open) {
if (retellWebClientRef.current) {
try {
retellWebClientRef.current.stopCall();
} catch (e) {
console.error("Error stopping call on close:", e);
}
}
resetDialogState();
}
onOpenChange(open);
}}>
<DialogContent
enableOverflow
type="creation"
title={t("web_call")}
description={t("test_your_agent_with_web_call")}>
{!creditsLoading && (
<Alert
severity="info"
CustomIcon="info"
title={t("credits_required")}
message={
hasCredits ? (
t("web_call_credits_info")
) : (
<>
{t("web_call_no_credits")}{" "}
<Link href={getBillingPath()} className="text-semantic-info underline">
{t("purchase_credits")}
</Link>
</>
)
}
/>
)}
<div className="mt-2 flex items-center justify-between rounded-lg border p-3">
<div className="flex items-center gap-2">
{getStatusIcon()}
<span className="text-sm font-medium">{getStatusText()}</span>
</div>
{callStatus === "active" && (
<div className="flex items-center gap-2">
<div className="bg-error h-2 w-2 animate-pulse rounded-full" />
<span className="text-subtle text-xs">{t("live")}</span>
</div>
)}
</div>
<div className="mt-2 rounded-lg border p-3 placeholder:min-h-[300px]">
<div className="mb-3 flex items-center justify-between">
<h4 className="text-sm font-medium">{t("transcript")}</h4>
{transcript.length > 0 && (
<Button
type="button"
color="secondary"
size="sm"
variant="icon"
onClick={() => setTranscript([])}
disabled={callStatus === "active"}>
<Icon name="trash" className="h-4 w-4" />
</Button>
)}
</div>
<div className="h-60 space-y-3 overflow-y-auto p-2">
{transcript.length === 0 ? (
<div className="flex h-40 items-center justify-center text-center">
<div>
<Icon name="message-circle" className="text-subtle mx-auto h-8 w-8" />
<p className="text-subtle mt-2 text-sm">
{callStatus === "idle"
? t("start_call_to_see_conversation")
: t("waiting_for_conversation")}
</p>
</div>
</div>
) : (
transcript.map((entry, index) => (
<div
key={index}
className={`flex gap-2 ${entry.speaker === "agent" ? "justify-start" : "justify-end"}`}>
<div
className={`max-w-[80%] rounded-lg px-3 py-2 text-sm ${
entry.speaker === "agent"
? "border-brand bg-brand/10 text-brand-emphasis border"
: "border-subtle bg-subtle text-emphasis border"
}`}>
<div className="mb-1 flex items-center gap-2">
<span className="text-xs font-medium">
{entry.speaker === "agent" ? t("ai_agent") : t("you")}
</span>
</div>
<p>{entry.text}</p>
</div>
</div>
))
)}
<div ref={transcriptEndRef} />
</div>
</div>
{error && callStatus === "error" && (
<div className="border-error bg-error/10 rounded-lg p-3">
<div className="flex items-center gap-2">
<Icon name="triangle-alert" className="text-error h-6 w-6" />
<span className="text-error text-sm">{error}</span>
</div>
</div>
)}
<DialogFooter showDivider className="mt-6">
<div className="flex gap-2">
{callStatus === "active" && (
<Button type="button" color="secondary" onClick={handleToggleMute} variant="icon">
<Icon name={isMuted ? "mic-off" : "mic"} className="h-4 w-4" />
</Button>
)}
{callStatus === "idle" ||
callStatus === "error" ||
callStatus === "ended" ||
callStatus === "connecting" ? (
<Tooltip content={!hasCredits ? t("credits_required_tooltip") : undefined}>
<Button
type="button"
onClick={handleStartCall}
loading={createWebCallMutation.isPending || callStatus === "connecting"}
disabled={!hasCredits || createWebCallMutation.isPending || callStatus === "connecting"}>
<Icon name="phone" className="mr-2 h-4 w-4" />
{callStatus === "connecting" ? t("connecting") : t("start_web_call")}
</Button>
</Tooltip>
) : (
<Button
type="button"
color="destructive"
onClick={handleEndCall}
disabled={callStatus !== "active"}>
<Icon name="phone-off" className="mr-2 h-4 w-4" />
{t("end_call")}
</Button>
)}
</div>
</DialogFooter>
</DialogContent>
</Dialog>
);
}