Say Anything: Prompt Segment Anything Model

Enable natural language prompting for the Segment Anything Model (SAM) using CLIP embeddings.

Say Anything: Prompt Segment Anything Model

Say Anything: Prompt Segment Anything Model is a Chrome extension that enables natural language prompting for the Segment Anything Model (SAM) using CLIP embeddings. It is built with OpenAI's CLIP and kevinzakka's implementation of Gradient-weighted Class Activation Mapping. The extension allows users to interact with Meta's Segment Anything Model through natural language prompts. Visit the provided link to learn how to set up the backend server locally to use this extension.
Install from Chrome Web Store

Extension stats

Users: 148
-7
Rating: 5.00
(1)
Version: 1.3 (Last updated: 2023-05-04)
Creation date: 2023-04-12
Risk impact: Low risk impact
Risk likelihood:
Manifest version: 3
Size: 72.42K
URLs: Website

Other platforms

Not available on Android
Not available on Firefox
Not available on Edge
Want to check extension ranking and stats more quickly for other Chrome extensions? Install Chrome-Stats extension to view Chrome-Stats data as you browse the Chrome Web Store.

Extension summary

Use natural language prompting to interact with Meta's Segment Anything Model! While they trained and studied text prompting, they have chosen not to release it as part of their demo, so we at Brilliantly figured we would try our hand at it. This extension is not the same as the encoding they used, but rather is a layer built on top of it, built with OpenAI's CLIP and kevinzakka's implementation of Gradient-weighted Class Activation Mapping.
This is just for fun, and results are variable in their quality. Some of the failure modes are explainable (the gradient mapping is imprecise, so the hat in the screenshots is a near-miss) and others are way off.

Visit https://github.com/suvansh/say-anything-backend to learn how to set up the backend server locally in 2 minutes to use this extension.

Extension safety

Risk impact

Say Anything: Prompt Segment Anything Model requires very minimum permissions.

Risk likelihood

Say Anything: Prompt Segment Anything Model has earned a good reputation and can be trusted.

Upgrade to see risk analysis details

Similar extensions

Here are some Chrome extensions that are similar to Say Anything: Prompt Segment Anything Model: