AI Form Filler

Upload document photos, automatically recognize information, and intelligently fill out forms

# Chrome Extension Guide: Auto Form Filler Assistant ## Overview: The Auto Form Filler Assistant is a powerful Chrome browser extension designed to automatically fill out web forms by uploading photos of documents. This extension utilizes a multimodal large model to extract information from images and intelligently match and populate web form fields, significantly simplifying the form-filling process. ## Key Features: - **Upload Document Photos**: Supports drag-and-drop or file selection for uploading images. - **Information Extraction and Auto-Fill**: Automatically extracts information from images, converts it into key-value format, and fills the corresponding web form fields. - **Extracted Data CSV Download**: Key-value pairs extracted from images can be downloaded with a single click. ## How It Works: 1. **Information Extraction**: Uses a multimodal model to extract key-value pair information from uploaded images. 2. **Form Analysis**: Retrieves all form fields and their attributes (e.g., ID, name, label) from the current webpage. 3. **Smart Mapping**: Utilizes a large model to analyze semantic relationships between form fields and extracted data. 4. **Precise Filling**: Populates the corresponding form fields based on mapping results and fuzzy matching algorithms. ## Installation: Visit the Chrome Web Store, search for "AI Form Filler Assistant," and click the "Add to Chrome" button. ## Usage: 1. Click the extension icon in the Chrome toolbar to open the plugin. 2. Enter and save your model provider API key. 3. Upload a photo containing form information. 4. Click the "Process Image and Fill Form" button. 5. The plugin will automatically analyze the image, extract information, analyze form mapping relationships, and fill out the form on the current webpage. ## Notes: - You need a valid model provider API key. - Image quality affects the accuracy of information extraction; ensure the image is clear and readable. - Automatic matching of form fields is based on field names, labels, IDs, etc., and accuracy may vary depending on webpage structure. - API keys are stored locally in your browser and are not sent to any server other than the model provider's API server. - When using the Tongyi Qian API, the `qwen-vl-max` and `qwen-plus` models are used. - When using the OpenAI API, the `gpt-4o-mini` and `gpt-3.5-turbo` models are called. ## Privacy Policy: - This extension does not collect any user data. - Uploaded images are used only for large model API calls and are not stored or used for other purposes. - API keys are securely stored in the browser's local storage and are used only for large model API calls. ## Technical Implementation: - Developed using Chrome Extension APIs. - Utilizes a multimodal model for image analysis. - Employs a large model for form mapping analysis. - Pure JavaScript implementation with no additional dependencies. ## Feedback and Support: Users are welcome to submit bug reports and feature suggestions. We will continuously improve and optimize the extension's functionality. ## Conclusion: The Auto Form Filler Assistant is an efficient and intelligent Chrome extension that significantly enhances the efficiency and accuracy of form filling. Leveraging advanced multimodal large model technology, users can easily automate form filling, saving considerable time and effort.