-
Notifications
You must be signed in to change notification settings - Fork 5.3k
Add JIT regression test extraction skill #123795
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…ssues Co-authored-by: EgorBo <[email protected]>
|
@dotnet/jit-contrib @jakobbotsch @stephentoub The convention for these tests may not be trivial for copilot to figure out itself sometimes. With this skill (I presume it's better than leaving that in copilot-instruction.md because we don't want to pollute its general context with something it doesn't need most of the time) it can extract a repro test from a github issue with just prompt. Useful for bugs reported by Fuzzlyn, can be used by CCA or locally. We probably will rewrite the existing prompt-files to skills as well since Skills are an open standard all agentic editors/tools support, while prompt files were VSCode only. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR adds a new Copilot skill for extracting JIT regression test cases from GitHub issues into the standardized src/tests/JIT/Regression/JitBlue/Runtime_<issue_number>/ structure.
Changes:
- New skill documentation providing step-by-step guidance for creating JIT regression tests
- Code examples based on real tests (Runtime_99391, Runtime_97625, Runtime_95315)
- Instructions for when to create custom .csproj files (environment variables, unsafe code)
- Common patterns for test structure and environment variable configuration
|
Ping, cc @jakobbotsch |
|
/ba-g "Helix Queue Insights (preview)" and "Build Analysis" stuck |
Description
Adds a new Copilot skill that guides extraction of standalone JIT regression test cases from GitHub issues into
src/tests/JIT/Regression/JitBlue/Runtime_<issue_number>/.Skill contents
Runtime_*tests (license header, file-scoped namespaces,[Fact]attribute usage).csprojfile (environment variables, unsafe code, special settings)CLRTestEnvironmentVariablepatterns (DOTNET_TieredCompilation,DOTNET_TieredPGO, etc.)Runtime_99391,Runtime_97625,Runtime_95315Structure
Follows the same format as the existing
performance-benchmarkskill.Original prompt
✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.