Proof of Effort
Proof of Effort
Typed vs Pasted
This metric shows the amount of text that was typed versus pasted in from an external source. Pastes that occur internally due to editing are not counted against this percentage. Content that was present in the document before PoE was installed, as from a template, will also be considered Pasted for the purposes of this metric. Once you press Save, the record of pasted content becomes permanent, even if you delete what you pasted. Nothing about PoE is designed to stop you from using outside sources, including Ai. It just documents whatever is less originally YOUR writing, and lets you explain the details to the reviewer.
The Waveform
The Cognitive Waveform is a visual representation of the Cognitive Engagement score, but on different timescales and more closely shows the amount of effort, high or low, that was present between all writing sessions. High effort appears noisier with fewer dips into the center line. The same person can create very different waveforms depending on how much effort was documented. Unlike the overall engagement score, it is possible for the waveform to show high and low effort patterns consecutively, which represents changes in the writer’s behavior throughout the document. This can correlate with the transcription analysis.
The Editing Profile is made up of your navigation, deletion, formatting and styling behaviors, as well as how many valid writing sessions were observed. A session is considered valid if A) at least 3 hours have passed since you last opened the document, and B) there are twenty minutes of active writing with no gaps of 5 minutes or longer. Spamming any of these behaviors does not improve your score.
This signal represents a spectrum of behavioral patterns that imply the amount of cognitive effort the writer demonstrated while typing. On one end is original composition (Green) and on the other end of the spectrum is linear fast Transcription (Amber) which means reading off another text as you type. Some behaviors, such as journaling, recalling something from a very clear memory, and stream of consciousness free writing can appear to be lower effort, which they are in that the writer was not originally composing or editing their ideas as they typed. This is why transcription signals come with confidence levels of Low, Medium and High. Authentic results are always considered High Confidence. Each document is divided into scoring sections on a sliding scale. These sections start at approximately 600 words, but as the document grows significantly longer, the sections do too. Each section gets its own Transcription analysis, which are displayed on the color bar. Many authentic sections with one or few Low Confidence Transcription sections, may indicate normal human variation. Multiple High Confidence Transcription sections may be cause for a conversation. Corresponding low Editing Profiles and Active Time may also be considered corroborating signals.
Editing Profile
Transcription Signal
This measures typing patterns for signs of cognitive engagement such as pauses, bursts, and corrections. The flow and interaction of these behaviors create a very human analog pattern, which is also represented in the Waveform. The more cognitive effort a person puts into their writing the more varied and intense these signals become, but this is NOT an excellence metric. The effort score doesn’t equal quality. PoE scores for typicality. The more average you are on all metrics the better you score. Scores from the upper 50s and higher can be considered typical levels of effort with 75 representing someone perfectly average on all levels. Scores in the low 50s and below usually appear with very short sessions, less than 300 words, because not enough activity has happened. The lower the score, the more mechanical the signal is and can mean someone deliberately testing the system or even some form of automation PoE hasn't encountered yet.
This is a summary score that combines the Editing Profile and the Cognitive Engagement scores. When pasted content is present, half of each percent of pasted content is deducted as a point from the Total Effort. EXAMPLE: A 90% Typed vs Pasted score means 10% of the content was pasted. This results in 5 points deducted from the total effort score, [10 / 2 = 5].
Cognitive Engagement
Total Effort Score
Take a deep dive into how Transcription analysis works w/ examples.
This script turns your favorite Ai chat program into an expert on PoE.