Pet-Cam Startup Reduces AI Costs with AWS Chips
In brief
- Furbo, a Taiwan-based startup known for its pet cameras, has found a cost-effective solution using Amazon's Inferentia2 chips.
- Previously relying on expensive GPU instances, Furbo switched to EC2 Inf2 instances, cutting costs while maintaining real-time monitoring accuracy.
- The move allowed them to scale their vision-language models across hundreds of thousands of devices without major code changes, ensuring reliable pet behavior detection for owners worldwide.
- Furbo's system now processes images through two layers of EC2 Auto Scaling groups, with the first handling API requests and the second running model inference on Inf2 instances.
- This setup ensures scalability and efficiency, proving that purpose-built AI chips can match GPUs in performance while being more budget-friendly.
- Looking ahead, this approach could set a precedent for other startups seeking to balance cost and performance in real-time AI applications.
- Furbo's success highlights how leveraging specialized hardware like Inferentia2 can unlock new possibilities for pet-tech innovation.
Terms in this brief
- Inferentia2
- A type of AI chip designed by Amazon Web Services (AWS) for machine learning inference. It's optimized to handle real-time AI tasks efficiently and cost-effectively, making it suitable for scaling applications like Furbo's pet camera system.
Read full story at AWS ML Blog →
More briefs
Chrome's AI Features Could Be Taking Up 4GB of Your Device Storage
Google Chrome might be using up a surprising amount of storage on your computer. This is because it's downloading a 4GB file called weights.bin when certain AI features are turned on. These features include scam detection, writing assistance, autofill, and suggestions, all powered by Google's Gemini Nano AI model. The file is stored locally to keep your data private but can take up space without clear notification. If you notice storage drops, check Chrome's OptGuideOnDeviceModel directory for the weights.bin file. To free up space, disable On-Device AI in Chrome settings under System. Without this feature enabled, Chrome won’t download the file again. Moving forward, clearer communication from Google about storage needs and options to use cloud-based models could help users manage their device space better.
Amazon AI Chip Sales Surge
Amazon's AI-focused Trainium chip sales are rising fast. The company said its Trainium2 chip is largely sold out. The Trainium chip line has a backlog of over $225 billion. This shows strong demand from AI customers. Amazon Web Services revenue rose 28% in Q1. Amazon will release its next-generation Trainium3 chip soon, which will improve performance by 30% to 40%.
AI Helps Veterans With Disability Claims
A Marine Corps Vietnam veteran used artificial intelligence to help with his disability claim and received a 100% rating from the Department of Veterans Affairs. The veteran used a chatbot to write a narrative for his claim and submitted it to the VA. The VA has been developing its own AI systems to help process claims. This has helped reduce the claims backlog by over 70% since the beginning of last year. The agency's goal is to process claims in 30 to 40 days. The VA has cut the number of backlogged claims to below 76,000, the lowest since 2020. The agency will continue to use technology to improve its services.
Alibaba to Combine AI and eCommerce
Alibaba plans to integrate its Qwen artificial intelligence platform and online marketplace Taobao. This will let consumers browse and purchase items via the Qwen app by talking with the AI agent. The change will give Qwen access to over 4 billion products, managed by a skills library that can handle logistics and offer recommendations based on order history. This move underlines a gap between Chinese and Western online shopping platforms. Alibaba's move into AI-fueled eCommerce will change how people shop online.
New AI Camera Worn Around the Neck
A new AI camera called Looki L1 is worn around the neck and sees, hears, and understands the user's life. It takes visual and audio input and provides personalized help and advice. This camera is always recording and processing data. The Looki L1 may change how people interact with the world and could replace some brain functions with AI-powered answers. It will be interesting to see how people use this device in the future.