You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Heartbeats wake the agent with an injected prompt (which sometimes overlap with what I'm typing, messing it all up) and only serves for it to say "yep, the agent is still going".
If the agent actually stops, nothing will be triggered and the orchestrator will be left waiting indefinitely.
So what's the point of heartbeats? Wouldn't it be better to have a "stall detector" built in Orca, which will warn the orchestrator when an agent it spawned is in a wait state? Or perhaps have the heartbeat be tracked by Orca itself, and not reach the agent..
EDIT: I can think of perhaps one legitimate use for it, which is to keep the KV cache warm. But still, the point remains about stalled agents.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Heartbeats wake the agent with an injected prompt (which sometimes overlap with what I'm typing, messing it all up) and only serves for it to say "yep, the agent is still going".
If the agent actually stops, nothing will be triggered and the orchestrator will be left waiting indefinitely.
So what's the point of heartbeats? Wouldn't it be better to have a "stall detector" built in Orca, which will warn the orchestrator when an agent it spawned is in a wait state? Or perhaps have the heartbeat be tracked by Orca itself, and not reach the agent..
EDIT: I can think of perhaps one legitimate use for it, which is to keep the KV cache warm. But still, the point remains about stalled agents.
All reactions