Customer Feedback
Several companies have provided early feedback on the new model. Aaron Vinh, Staff Software Engineer at Asana, stated, "We’re very impressed with Claude Haiku 5.5, particularly its speed. We ran it through our eval suite for AI Teammates, our AI agent product, covering use cases like triaging bugs, setting up projects, and searching large portfolios to surface high-risk or overdue work. Compared with the model we use today, we saw over a 30% reduction in latency for task completions and up to 2.5x faster inference per agent turn. It’s a noticeably snappier experience."
Ze’ev Klapow, Distinguished Software Engineer at HubSpot, reported that Haiku 5.5 achieved the best score they have seen on their CRM task suite, at 92.8% averaged over three runs. "One CRM audit task asks models to identify stale but ambiguous records. Across all of the models we tested, Haiku 5.5 was fastest to complete the task, and had the highest hit rate and the lowest false positive rate," Klapow said.
Daniel Campos, Distinguished Engineer at AlphaSense, noted that in a test of 400 queries, Haiku 5.5 showed a statistically significant improvement over Haiku 4.5, scoring 0.84 versus 0.76. Yashodha Bhavnani, VP of AI Products at Box, added that Haiku 5.5 scored 11 points higher than Haiku 4.5 at about half the latency in their early testing.