Fitterfly, a leading healthtech company in India, has partnered with Google Cloud to launch its latest AI feature – Fitterfly Klik, which will enable people with diabetes and other NCDs (Non-Communicable Diseases) to track and analyze their meals effortlessly. Nutrition planning remains the most important bulwark for managing type 2 diabetes as well as for weight loss and heart disease. However, traditional meal tracking methods – be it through manual journaling or entering in a text format in an app is cumbersome and discouraging for many. Fitterfly’s latest feature, Klik, changes all this by leveraging the power of Gemini Flash 1.5 on Google Cloud’s Vertex AI platform to transform meal tracking into a quick, enjoyable, and insightful experience.
Fitterfly Klik uses state-of-the-art AI computer vision paired with the Fitterfly Nutrition Database, comprising 37,000+ Indian foods, to recognize, analyze, and break down food. Using Klik is easy. Within the Fitterfly app, users can access Klik within the meal-tracking food diary by clicking on the camera icon. A user can also access Klik through a chat with JEDi, Fitterfly’s AI Coach. A user can Klik while having a meal or upload images from the picture gallery in one go in the evening. It will instantly provide feedback on that food item, its portion size and give detailed nutritional breakdowns like calorie count, macronutrient and micronutrient distribution. So, whether it’s a bowl of pasta, biryani, or your regular thali, Klik can identify both Indian and international dishes on your plate.
Fitterfly Klik has been intuitively designed, and features like Focus Guidelines help users take the perfect photo for optimal food recognition. Klik’s advanced algorithms analyze the food’s image and its nutritional data and directly sync it to the user’s Meal Diary on the Fitterfly App. Users can also add additional items from the same plate if all dishes aren’t visible in the initial photo.
Ammar Jagirdar, Head of Fitterfly X-Labs, said, “With Gemini Flash 1.5 on Vertex AI powering the Fitterfly Food Database, Klik makes meal logging possible in a few seconds, even with multiple dishes on a plate. Multimodal models today are surpassing traditional image classification methods in accuracy, even on a complex problem like food. Klik will reduce friction and help our users take another step in building healthier lifestyles.”
Dr. Arbinder Singal, Fitterfly’s Co-founder and CEO, stated, “Indians eat more than 32 cuisines and a food cam AI was difficult to develop for both identification and serving size estimation. Paired with our industry leading food database, Klik is a step towards helping millions of people in making better choices and enabling better health outcomes. We will be making Klik available for our app users as well as via API to our insurance partners and the pharmaceutical industry.”
Bikram Singh Bedi, Vice President and Country MD at Google Cloud India added, “Combined with Fitterfly ‘s dataset and Gemini’s multimodal capabilities, both teams collaborated to identify the right model to help bring this powerful idea to life in an extremely short duration. Leveraging Gemini Flash, Fiiterfly’s Kilk is able to deliver exceptional quality, an expansive context window, and cutting-edge multimodal capabilities which will be very helpful for their users.”
The initial outcomes from the Fitterfly Klik beta phase are encouraging: users save significant time and effort logging meals, as evidenced by a 90% reduction in clicks. Validation tests confirm that Klik can precisely identify a wide range of food items and their portion sizes, ensuring that users have the most accurate nutritional information at their fingertips.
