Skip to content

Add Trustabl Agent Scanner to CI - #275

Open
joshua-trustabl wants to merge 1 commit into
pr-pm:mainfrom
joshua-trustabl:add-trustabl-action
Open

Add Trustabl Agent Scanner to CI#275
joshua-trustabl wants to merge 1 commit into
pr-pm:mainfrom
joshua-trustabl:add-trustabl-action

Conversation

@joshua-trustabl

@joshua-trustabl joshua-trustabl commented Aug 6, 2026

Copy link
Copy Markdown

User description

We came across your repo and we like how you are building a universal registry for AI coding tools, simplifying the process of discovering and installing prompts, rules, skills, and agents across different platforms. We scanned the repo, and noticed agent runtime reliability findings that might be worth reviewing.

  1. [HIGH] Subagent granted filesystem-write or web-fetch built-ins
    In .claude/agents/blog-writer.md, this subagent's frontmatter grants a filesystem-write (Write/Edit) or web-fetch (WebFetch) built-in. This could allow the subagent to modify files or access sensitive information online.

  2. [HIGH] Subagent granted the built-in Bash tool
    In .claude/agents/core-principles.md, this subagent's frontmatter grants the built-in Bash tool, letting it run arbitrary shell commands. Allowing a subagent to execute arbitrary code poses a significant security risk.

  3. [HIGH] Subagent granted filesystem-write or web-fetch built-ins
    In .claude/agents/core-principles.md, this subagent's frontmatter grants a filesystem-write (Write/Edit) or web-fetch (WebFetch) built-in. This could allow the subagent to modify files or access sensitive information online.

Recommendations are based on our understanding of agent runtime reliability, some findings may be intentional. Please let us know if this was intentional or if our findings are helpful so we can improve the accuracy of the scanner.

Best,
Trustabl.ai
Open-source AI agent reliability scanner (runs locally, GitHub Action)

Review in cubic


CodeAnt-AI Description

Add automated Trustabl security scans to pull requests and main-branch updates

What Changed

  • Every pull request and push to main now runs a Trustabl security scan
  • Scan results can be reported as GitHub security findings and pull request feedback

Impact

✅ Earlier detection of risky agent permissions
✅ Security checks on every pull request
✅ Automated monitoring of main-branch changes

💡 Usage Guide

Checking Your Pull Request

Every time you make a pull request, our system automatically looks through it. We check for security issues, mistakes in how you're setting up your infrastructure, and common code problems. We do this to make sure your changes are solid and won't cause any trouble later.

Talking to CodeAnt AI

Got a question or need a hand with something in your pull request? You can easily get in touch with CodeAnt AI right here. Just type the following in a comment on your pull request, and replace "Your question here" with whatever you want to ask:

@codeant-ai ask: Your question here

This lets you have a chat with CodeAnt AI about your pull request, making it easier to understand and improve your code.

Example

@codeant-ai ask: Can you suggest a safer alternative to storing this secret?

Preserve Org Learnings with CodeAnt

You can record team preferences so CodeAnt AI applies them in future reviews. Reply directly to the specific CodeAnt AI suggestion (in the same thread) and replace "Your feedback here" with your input:

@codeant-ai: Your feedback here

This helps CodeAnt AI learn and adapt to your team's coding style and standards.

Example

@codeant-ai: Do not flag unused imports.

Retrigger review

Ask CodeAnt AI to review the PR again, by typing:

@codeant-ai: review

Check Your Repository Health

To analyze the health of your code repository, visit our dashboard at https://app.codeant.ai. This tool helps you identify potential issues and areas for improvement in your codebase, ensuring your repository maintains high standards of code health.

@codeant-ai

codeant-ai Bot commented Aug 6, 2026

Copy link
Copy Markdown

🤖 CodeAnt AI — Review Status

Status Commit Started (UTC) Finished (UTC)
✅ Reviewed your PR 107d510 Aug 06, 2026 · 04:48 04:49

@codeant-ai

codeant-ai Bot commented Aug 6, 2026

Copy link
Copy Markdown

Thanks for using CodeAnt! 🎉

We're free for open-source projects. if you're enjoying it, help us grow by sharing.

Share on X ·
Reddit ·
LinkedIn

@my-senior-dev-pr-review

Copy link
Copy Markdown

🤖 My Senior Dev — Analysis Complete

👤 For @joshua-trustabl

📁 Expert in .github/workflows/ (1 edits) • ⚡ 1st PR this month

View your contributor analytics →


📊 1 file reviewed • 1 high risk • 2 need attention

🚨 High Risk:

  • .github/workflows/trustabl.yml — Critical permissions granted that may allow internal exploitation if compromised.

⚠️ Needs Attention:

  • .github/workflows/trustabl.yml — Potential security vulnerabilities and maintainability concerns regarding the use of external actions.

🚀 Open Interactive Review →

The full interface unlocks features not available in GitHub:

  • 💬 AI Chat — Ask questions on any file, get context-aware answers
  • 🔍 Smart Hovers — See symbol definitions and usage without leaving the diff
  • 📚 Code Archeology — Understand how files evolved over time (/archeology)
  • 🎯 Learning Insights — See how this PR compares to similar changes

💬 Chat here: @my-senior-dev explain this change — or try @chaos-monkey @security-auditor @optimizer @skeptic @junior-dev

📖 View all 12 personas & slash commands

You can interact with me by mentioning @my-senior-dev in any comment:

In PR comments or on any line of code:

  • Ask questions about the code or PR
  • Request explanations of specific changes
  • Get suggestions for improvements

Slash commands:

  • /help — Show all available commands
  • /archeology — See the history and evolution of changed files
  • /profile — Performance analysis and suggestions
  • /expertise — Find who knows this code best
  • /personas — List all available AI personas

AI Personas (mention to get their perspective):

Persona Focus
@chaos-monkey 🐵 Edge cases & failure scenarios
@skeptic 🤨 Challenge assumptions
@optimizer Performance & efficiency
@security-auditor 🔒 Security vulnerabilities
@accessibility-advocate Inclusive design
@junior-dev 🌱 Simple explanations
@tech-debt-collector 💳 Code quality & shortcuts
@ux-champion 🎨 User experience
@devops-engineer 🚀 Deployment & scaling
@documentation-nazi 📚 Documentation gaps
@legacy-whisperer 🏛️ Working with existing code
@test-driven-purist Testing & TDD

For the best experience, view this PR on myseniordev.com — includes AI chat, file annotations, and interactive reviews.

@codeant-ai codeant-ai Bot added the size:S This PR changes 10-29 lines, ignoring generated files label Aug 6, 2026

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 1 file

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name=".github/workflows/trustabl.yml">

<violation number="1" location=".github/workflows/trustabl.yml:17">
P2: The workflow grants the repository write permissions (`security-events: write`, `pull-requests: write`) to a third-party action pinned by a mutable `@v0` tag rather than a commit SHA. A tag can be force-updated or the upstream repo compromised, and any code the action then runs does so with repo write access. Pin the action to a full commit SHA (and add a comment noting the verified version) to keep the supply chain deterministic.</violation>
</file>

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: trustabl/trustabl-action@v0

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: The workflow grants the repository write permissions (security-events: write, pull-requests: write) to a third-party action pinned by a mutable @v0 tag rather than a commit SHA. A tag can be force-updated or the upstream repo compromised, and any code the action then runs does so with repo write access. Pin the action to a full commit SHA (and add a comment noting the verified version) to keep the supply chain deterministic.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At .github/workflows/trustabl.yml, line 17:

<comment>The workflow grants the repository write permissions (`security-events: write`, `pull-requests: write`) to a third-party action pinned by a mutable `@v0` tag rather than a commit SHA. A tag can be force-updated or the upstream repo compromised, and any code the action then runs does so with repo write access. Pin the action to a full commit SHA (and add a comment noting the verified version) to keep the supply chain deterministic.</comment>

<file context>
@@ -0,0 +1,17 @@
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: trustabl/trustabl-action@v0
</file context>

@github-advanced-security

Copy link
Copy Markdown

You are seeing this message because GitHub Code Scanning has recently been set up for this repository, or this pull request contains the workflow file for the Code Scanning tool.

What Enabling Code Scanning Means:

  • The 'Security' tab will display more code scanning analysis results (e.g., for the default branch).
  • Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results.
  • You will be able to see the analysis results for the pull request's branch on this overview once the scans have completed and the checks have passed.

For more information about GitHub Code Scanning, check out the documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:S This PR changes 10-29 lines, ignoring generated files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants