Prework
Proposal
Continuing on the theme of multimodal inputs, I thought it'd be really cool if the DraftValidation class could support multimodal inputs (images and PDF), just as Validate.prompt() now does. A rough sketch of how that would work, drawing inspiration from the How DraftValidation Works steps:
- A statistical summary of your data is generated using the DataScan class.
- This summary is converted to JSON format and sent to your selected LLM provider.
- NEW: You provide the
DraftValidation class with an image or PDF file describing what the data should look like. For example, the image could be a schema diagram, while the PDF could outline the project configuration elements that the data should conform to.
- The LLM uses the summary and multimodal input along with knowledge about Pointblank’s validation capabilities to generate a validation plan.
- The result is returned as executable Python code that you can use directly or modify as needed
Happy to get feedback from you @rich-iannone, and iterate. I'd love to implement this.
Prework
Proposal
Continuing on the theme of multimodal inputs, I thought it'd be really cool if the
DraftValidationclass could support multimodal inputs (images and PDF), just asValidate.prompt()now does. A rough sketch of how that would work, drawing inspiration from the How DraftValidation Works steps:DraftValidationclass with an image or PDF file describing what the data should look like. For example, the image could be a schema diagram, while the PDF could outline the project configuration elements that the data should conform to.Happy to get feedback from you @rich-iannone, and iterate. I'd love to implement this.