User Tools

Site Tools


wiki:ai:affrim_knowledge

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
wiki:ai:affrim_knowledge [2025/07/23 20:54] mcarverwiki:ai:affrim_knowledge [2026/01/14 18:14] (current) jmiller
Line 1: Line 1:
 ====== Affirm Documentation ====== ====== Affirm Documentation ======
 +Process documents and team notes regarding Synergists tool 'Affirm'
  
 +----
  
-===== Suggestions =====+===== Process Documents and How-to'===== 
 +  * [[wiki:ai:affirm_snow_process|Adding Affirm environment to SNOW]] 
 +  * [[wiki:ai:affirm_onboarding|Onboarding Affirm to Clients Model]]
  
-  * Give explanation for why each monitoring test failed – 'Toxicity test failed due to these words:' +----
-  * Functionality for running multiple initial monitoring tests at once or creating a queue. +
-  * Ability to evaluate models against the framework packs, rather than a simple checklist +
-  * Key vault within the tool to store model secrets, reference the secrets when onboarding model +
-  * Automatically pull the AI Model inventory from AWS/Azure/GCP instead of manually onboarding models +
-  * Variety in test prompts so that the same exact prompt is not used every time to yield the same exact result – shouldn’t need to manually create/add every prompt. +
-  * Need more automation in general manually onboarding models, manually designing prompts, etc. is too much+
  
-===== Issues =====+===== Misc. Notes ===== 
 +  * [[wiki:ai:old_affirm_notes|Suggestions and Criticism for Affirm (Old)]]
  
-  * 'Create Report' button didn’t always work in AI Models section 
-  * In 'AI Monitoring' -> 'Audit Logs': User and User ID are both random character strings 
-  * 'View Audit Log' in the test results: the screen would be blank 
-  * Sending the same prompt over and over would likely lead to the same results 
  
 +[[wiki:ai:home-page|AI Homepage]]
wiki/ai/affrim_knowledge.1753304044.txt.gz · Last modified: by mcarver