I wanted to experiment with GPT-4 vision, reading an image and converting it to JSON for use with AI.

Here’s a concise summary of the project:

Project: OCR-AI-JSON

Goal: Create a system to extract structured data from receipt images using GPT-4 Vision and convert them to standardized JSON format using docling https://github.com/DS4SD/docling-core. With Docling, you can quickly structure and organize data within a document to maximize the efficiency of AI models in understanding and extracting valuable information.

Key Accomplishments:

Core Implementation

• Successful integration with GPT-4 Vision API
• Reliable text extraction from receipt images
• Conversion of unstructured text to structured JSON
• Implementation of both Docling and custom parsing solutions

Data Validation & Quality

• Built a comprehensive validation system for calculations
• Added metrics and analytics for receipt data
• Implemented error detection and reporting
• Established data quality guardrails

Architecture & Features

• Modular design with clear separation of concerns
• Robust error handling and logging
• Support for multiple output formats (text, markdown…