Skip to content

Update incontext to latest #48

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
cfunk1210 wants to merge 665 commits into
base: dev/incontext
Choose a base branch
from
Open

Update incontext to latest #48

cfunk1210 wants to merge 665 commits into from

Conversation

@cfunk1210
Copy link

@cfunk1210 cfunk1210 commented Apr 24, 2024

No description provided.

dmjoy and others added 30 commits December 17, 2024 13:58
@dmjoy
Add basic support for backstory selection from distribution target
bc46184
@dmjoy
Fix issue with scalar alignment target backstory selection
d4abcf5 
Were considering KDMAs (probes) outside of the KDMAs of interest for
the target (by defaulting to a value of 0)
@dmjoy
Raise an error if we get an unexpected alignment target type
6521bf4
@dmjoy
Update CHANGELOG wrt added outlines based persona ADM
e92eac0
@jadie1
Adding phase1 train files
bfec733
@jadie1
Small fixes
f033a10
@jadie1
Merging with main
0760e21
@jadie1
Updating ST ICL files
c3b443d
@jadie1
Adding distribution alignment with relevance
ff4bc14
@jadie1
Adding relevance comp reg with distribution targets
a3e3a46
@jadie1
Cleaning up configs
5debe28
@jadie1
Updating irrelevant ICL COT reasoning
9f4fb2c
@jadie1
Update CHANGELOG.md
8991298
@jadie1
Removing sampling from relevance prediction
d6c8d95
@jadie1
Merge pull request #156 from ITM-Kitware/dev/relevance
a2e9000 
Relevance
@eveenhuis @dmjoy
Log true relevance for comp reg
f74cdba
@jadie1 @dmjoy
Adding cumulative KDE alignment with or without relevance for hybrid …
b78595c 
…kaleido ADM
@jadie1 @dmjoy
Fixing relevance keys
85589ca
@jadie1 @dmjoy
Update CHANGELOG.md
74caeea
@jadie1 @dmjoy
Fix relevance to be float rather than list
637ed15
@dmjoy
Change choice_history default arg to None
f78d005
@jadie1 @dmjoy
Adding mulit-kdma configs
b750b53
@jadie1 @dmjoy
Fixing name typo for consistency
48479fc
@eveenhuis @dmjoy
Single heuristic treatment bugfix
9630071
@dmjoy
Add initial integration test driver script
1401e4f
@dmjoy
Fix exit status of integration test driver script; misc cleanup
3a0d22b
@dmjoy
Add comp reg ICL soartech integration test
30b456c
@dmjoy
Add exemption logic to integration test diffs
6fa2b5d
@dmjoy
Add integration test for adept comp reg adm
81d26ee
@dmjoy
Add random adm to integration tests (good quick smoketest)
f439451
dmjoy and others added 30 commits October 24, 2025 10:12
@dmjoy
Add some direct regression support for search and personal safety
8b1483a
@dmjoy
Update direct regression medical system prompt
82a528c
@dmjoy
Misc tweaks / fixes wrt cleanup and driver refactor
31e8073
@dmjoy
Fix driver.apply_action_filtering setting wrt driver refactor
871e6a8
@barry-ravichandran @dmjoy
DecisionFlow: Added unstructured objective function json parsing and …
cfba663 
…json retry util functions
@dmjoy
Simple update to add per-step timing info for pipeline ADM
7705074
@barry-ravichandran @dmjoy
Add SceneSkipException for DecisionFlow implementation
09564ee
@dmjoy
Support str system prompt for baseline; add baseline sys prompt exper…
913d54c 
…iments
@dmjoy
Update alternate baseline run configs for live eval
a1a255b
@jadie1 @dmjoy
Inference engine for spectrum tuned llms
ff23403
@jadie1 @dmjoy
Updating changelog
c716a04
@jadie1 @dmjoy
Removing unused import
3597fa8
@jadie1 @dmjoy
Fixing name
150bacc
@dmjoy
Add caching to BertRelevance component
c9c0d77
@dmjoy
Quickfix for multi attribute alignment "alignment_info"
cfafbb0
@eveenhuis
Add random effects model alignment function and tests
e5dc298
@eveenhuis
Merge pull request #259 from ITM-Kitware/dev/new-align-fn
5fb3c3f 
Add random effects model alignment function and tests
@barry-ravichandran @dmjoy
DecisionFlow: Added fine-grained value prompts for Attribute and Math…
ec1678b 
…Reason stages
@barry-ravichandran @dmjoy
DecisionFlow: Refactor outlines prompts to a dedicated script
ec021d0
@barry-ravichandran @dmjoy
Fix attribute filtering stage to pass correct information to objectiv…
1f28acf 
…e function
@barry-ravichandran @dmjoy
Remove inference call from Objective Stage to match original implemen…
42641fb 
…tation
@barry-ravichandran @dmjoy
Refine fine-grained prompts for KDMA-specific examples and improve in…
b552be4 
…ference speed
@barry-ravichandran @dmjoy
Refine Express stage prompt for faster inference and reduced JSON errors
3ca8337
@barry-ravichandran @dmjoy
Add TA3 eval server info to experiment config
952b9d4
@barry-ravichandran @dmjoy
Refine math_reason prompt to match closer to the source implementation
0ae89dc
@barry-ravichandran @dmjoy
Refine math_reason prompt and add in-context KDMA examples
5d47c1a
@barry-ravichandran @dmjoy
Constrain attribute stage output for high/low pipeline
bac54d9
@barry-ravichandran @dmjoy
Update Express Stage to use positive-negative alignment info
c234732
@barry-ravichandran @dmjoy
Fix redundant system prompt definitions in experiment config
ff9e637
@eveenhuis @dmjoy
Add choice index X ADM
fcc4551
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@cfunk1210 @dmjoy @jadie1 @eveenhuis @barry-ravichandran @PaulHax @DennisMelamedKitware