🚀
Codex Editor
  • Project Overview
    • Welcome to Codex
    • Codex Editor
      • Features
      • What was Project Accelerate?
        • Project Philosophy
        • Steering Committee
    • Vision
      • Powerful Tools and Simplicity
      • Streamlining the Translation Process
      • Unopinionated Assistance
    • Architecture
    • Frequently Asked Questions
    • Translator Requirements
    • Roadmap
    • Why VS Code?
    • Multimodality
  • Translator's Copilot
    • What is Translator's Copilot?
    • Information Management
      • Resource Indexing
      • Greek/Hebrew Insights
      • Chat with Resources
      • Project-Based Insights
    • Translation Assistance
      • Translation Drafting
        • Prioritizing Semantics over Structures
        • Reranked Translation Suggestions
      • Quality Checking
        • Token matching evaluation
        • Few-shot evaluation
        • Fine-tuned Bible QA model
        • Character and word n-gram evaluation
        • Simulated GAN evaluation
        • Linguistic Anomaly Detection (LAD)
      • Back Translation
    • Orchestration
      • Translation Memory
      • Multi-Agent Simulations
      • Drafting linguistic resources
    • Intelligent Functions Library
  • Development
    • Codex Basics
      • Projects
      • The Editor
      • Extensions
        • Rendered Views
        • Language Servers
        • Custom Notebooks
        • Global State
    • Experimental Repositories
Powered by GitBook
On this page
  1. Project Overview

Multimodality

PreviousWhy VS Code?NextWhat is Translator's Copilot?

Last updated 1 year ago

We will almost certainly need to use a custom editor component for multimodal projects.

Links/Resources

Audio

See app

(though double check license, and it’s not super functional at this point.)

We should explore how we might integrate AVTT software into VS Code as rendered components.

Image

Klappy has made a simple POC plugin generating images using scripture prompts.

I suspect there are a number of image editing plugins. We could use these to mark up images before processing with a multimodal LLM.

Cf.

Custom editor sample extension for image editing
Custom editor learnings
SIL Transcriber
Audio editing plugin
Screenshot 2023-12-20 at 8.08.17 AM.png