feat: add session-profiling protocol and profile-session template per…#72
feat: add session-profiling protocol and profile-session template per…#72themechbro wants to merge 2 commits intomicrosoft:mainfrom
Conversation
Add profile-session template and session-profiling reasoning protocol for analyzing completed LLM session logs to identify token inefficiencies and structural waste. Built on the structure from PR microsoft#72 by @themechbro — keeps the 5-phase methodology and adds full PromptKit conventions: Protocol (session-profiling): - 5 phases: segment log, map to components, detect inefficiencies, quantify impact, produce recommendations - 7 inefficiency types: redundant reasoning, false starts, re-derivation, protocol loops, unused context, verbose compliance, persona drift - Each recommendation tied to a specific PromptKit component file Template (profile-session): - Full frontmatter: persona (specification-analyst), protocols (anti-hallucination, self-verification, session-profiling), format (investigation-report), params, contracts - Params: session_log, assembled_prompt, focus_areas - Non-goals: not a quality audit, not a guardrail remover Manifest: additive-only changes (protocol + template entries, no reformatting of existing content). Co-authored-by: themechbro <109350438+themechbro@users.noreply.github.com> Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Add profile-session template and session-profiling reasoning protocol for analyzing completed LLM session logs to identify token inefficiencies and structural waste. Protocol (session-profiling): - 5 phases: segment log, map to components, detect inefficiencies, quantify impact, produce recommendations - 7 inefficiency types: redundant reasoning, false starts, re-derivation, protocol loops, unused context, verbose compliance, persona drift - Each recommendation tied to a specific PromptKit component file Template (profile-session): - Full frontmatter: persona (specification-analyst), protocols (anti-hallucination, self-verification, session-profiling), format (investigation-report), params, contracts - Params: session_log, assembled_prompt, focus_areas - Non-goals: not a quality audit, not a guardrail remover Manifest: additive-only changes (protocol + template entries, no reformatting of existing content). Co-authored-by: Alan-Jowett <alanjo@microsoft.com> Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
b20c0d9 to
eeabaca
Compare
|
@themechbro — I pushed a co-engineering commit to your branch that builds on your 5-phase structure. Here's what changed: What I kept from your PR
What I addedProtocol — expanded each phase with the depth PromptKit protocols need (comparable to
Template — added full PromptKit frontmatter so the assembly engine can compose it:
Manifest — reverted the whitespace reformatting and kept only the 2 additive entries (protocol + template). The reformatting was causing 12 validation failures. For referenceCompare Let me know if you have questions or want to adjust anything! |
|
@themechbro — stepping back, I want to apologize. You asked for early feedback on your draft, and instead of reviewing and letting you iterate, I force-pushed a rewrite directly to your branch. That wasn't the right call — it's your PR and your learning opportunity, and I should have respected that. If you'd prefer to revert to your original commit and work from review feedback instead, that's completely fine. You can restore your version with: git reflog # find your original commit hash
git reset --hard <your-original-hash>
git push --forceEither way — your original structure (5 phases, the inefficiency categories, the file locations) was the right foundation. The main things that need to happen for the assembly engine to work with it are:
Happy to answer questions or do a more detailed review — whichever you'd find more helpful. Again, sorry for overstepping. |
|
@Alan-Jowett - I've pulled down your co-engineering commit and applied the fixes flagged by the Copilot review. Changes included in this push:
Let me know if this is ready to drop the "Draft" status! |
This is a fresh draft for the Session Profiler Template (Issue #44), scoped strictly to the template architecture as discussed in the previous PR.
Changes in this Draft:
@Alan-Jowett - Tagging you here for early feedback as requested! Let me know if the directory placement and YAML frontmatter look perfectly aligned with the engine's expectations before I build out the markdown/JSON formatting logic.