Skip to content

t1066: Open Tech Explorer provider agent and tech-stack-helper.sh#1544

Merged
marcusquinn merged 2 commits intomainfrom
feature/t1066
Feb 16, 2026
Merged

t1066: Open Tech Explorer provider agent and tech-stack-helper.sh#1544
marcusquinn merged 2 commits intomainfrom
feature/t1066

Conversation

@marcusquinn
Copy link
Owner

Summary

  • Add tools/research/providers/openexplorer.md subagent documenting OpenExplorer.tech as a free, open-source tech stack discovery provider
  • Create tech-stack-helper.sh with multi-provider architecture, OpenExplorer integration (search/tech/category/analyse commands), result caching, and Playwright fallback for the React SPA
  • Document provider comparison: strengths (free, open-source, metadata-rich with performance/security signals) and gaps (~72 techs vs 1,500+ in Wappalyzer, ~7k websites, no version detection, no server-side analysis)

Details

OpenExplorer.tech is a community-driven platform (React + Supabase + Chrome Extension) that detects ~72 technologies via client-side JS object inspection, DOM patterns, and metadata analysis. The Supabase API requires auth credentials, so the helper script provides:

  1. Structured search commands that return common-schema JSON (with guidance to use Playwright or the web UI)
  2. Playwright analyse command for full browser-based analysis of any URL
  3. Multi-provider architecture ready for additional providers (Wappalyzer, BuiltWith, etc.)

ShellCheck: zero violations. All commands tested and verified.

Ref #1527

…1066)

- Create tools/research/providers/openexplorer.md subagent with full API docs,
  detection method analysis, common schema mapping, and provider comparison
- Create tech-stack-helper.sh with multi-provider architecture, OpenExplorer
  integration (search/tech/category/analyse commands), caching, and Playwright
  fallback for the React SPA
- Document strengths (free, open-source, metadata-rich) and gaps (small dataset,
  ~72 techs vs 1500+ in Wappalyzer, no version detection)
@marcusquinn marcusquinn marked this pull request as ready for review February 16, 2026 21:07
@coderabbitai
Copy link
Contributor

coderabbitai bot commented Feb 16, 2026

Warning

Rate limit exceeded

@marcusquinn has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 19 minutes and 47 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

✨ Finishing touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch feature/t1066

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@gemini-code-assist
Copy link

Summary of Changes

Hello @marcusquinn, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request introduces a new tech-stack-helper.sh script designed to streamline the process of identifying website technology stacks. It integrates OpenExplorer.tech as its initial provider, offering various search and analysis commands, including a robust Playwright-driven fallback for dynamic sites. The changes also include extensive documentation for the OpenExplorer.tech provider, detailing its capabilities and limitations.

Highlights

  • New Tech Stack Helper Script: Introduced tech-stack-helper.sh to provide a unified interface for discovering website technology stacks from multiple providers, supporting caching and common schema output.
  • OpenExplorer.tech Integration: Added OpenExplorer.tech as the first integrated provider, supporting search by URL, technology name, category, and full analysis via Playwright for single-page applications.
  • Playwright Fallback Mechanism: Implemented a Playwright-based analysis method within the helper script to handle dynamic web applications and overcome API authentication limitations for OpenExplorer.tech.
  • Comprehensive Provider Documentation: Created detailed documentation for the Open Tech Explorer provider, outlining its architecture, detection methods, API, common schema mapping, and a comparison of its strengths and gaps against other tools.
Changelog
  • .agents/scripts/tech-stack-helper.sh
    • Added a new shell script for multi-provider tech stack discovery.
    • Implemented utility functions for URL normalization, caching, and category normalization.
    • Integrated OpenExplorer.tech with search, tech, category, and analyse commands.
    • Included Playwright-based analysis for OpenExplorer.tech to handle SPAs.
    • Provided list_providers and compare_providers functions.
    • Added comprehensive help documentation.
  • .agents/tools/research/providers/openexplorer.md
    • Added a new markdown document detailing the Open Tech Explorer provider.
    • Described its purpose, architecture, detection method, and API integration.
    • Explained the Playwright fallback mechanism.
    • Mapped OpenExplorer categories to a common schema.
    • Provided a detailed comparison of OpenExplorer's strengths and gaps against other providers.
    • Included troubleshooting tips and references.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@github-actions
Copy link

🔍 Code Quality Report

�[0;35m[MONITOR]�[0m Code Review Monitoring Report

�[0;34m[INFO]�[0m Latest Quality Status:
SonarCloud: 0 bugs, 0 vulnerabilities, 16 code smells

�[0;34m[INFO]�[0m Recent monitoring activity:
Mon Feb 16 21:08:08 UTC 2026: Code review monitoring started
Mon Feb 16 21:08:08 UTC 2026: SonarCloud - Bugs: 0, Vulnerabilities: 0, Code Smells: 16

📈 Current Quality Metrics

  • BUGS: 0
  • CODE SMELLS: 16
  • VULNERABILITIES: 0

Generated on: Mon Feb 16 21:08:11 UTC 2026


Generated by AI DevOps Framework Code Review Monitoring

@sonarqubecloud
Copy link

Copy link

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new tech-stack-helper.sh script for technology discovery and corresponding documentation. The script is well-structured and uses a multi-provider architecture, which is great. My review focuses on improving its robustness and maintainability. I've identified a critical issue regarding temporary file cleanup that could lead to resource leaks. I also have suggestions to improve error handling visibility and align with the repository's shell scripting style guide for variable declarations. The accompanying documentation is clear and comprehensive.


# Create a temporary Playwright script
local tmp_script
tmp_script="$(mktemp /tmp/oe-analyse-XXXXXX.mjs)"

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

critical

The temporary script file created with mktemp is not guaranteed to be cleaned up if the script fails or is interrupted after the file is created but before rm -f is called. This can lead to orphaned files in the /tmp directory. The repository style guide mandates using trap for cleaning up temporary files to ensure cleanup always occurs.

Suggested change
tmp_script="$(mktemp /tmp/oe-analyse-XXXXXX.mjs)"
tmp_script="$(mktemp /tmp/oe-analyse-XXXXXX.mjs)"
trap 'rm -f "$tmp_script"' EXIT
References
  1. Temp files must have trap cleanup (RETURN or EXIT) (Line 33) (link)

# =============================================================================

print_header() {
local msg="$1"

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The repository style guide requires declaring and assigning local variables from function arguments in separate steps for exit code safety. This pattern should be applied consistently across all functions in the script that process arguments (e.g., normalise_url, cache_key, etc.).

Suggested change
local msg="$1"
local msg
msg="$1"
References
  1. Use local var="$1" pattern in functions (declare and assign separately for exit code safety) (Line 11) (link)

Comment on lines +396 to +399
if result="$(
npx --yes playwright test --reporter=list 2>/dev/null
node "$tmp_script" "$normalised" 2>/dev/null
)"; then

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The use of 2>/dev/null on the node command suppresses all error output from the Playwright script, making it very difficult to debug failures. While the if condition will catch the failure, the underlying cause will be hidden. The repository style guide discourages blanket error suppression.

Suggested change
if result="$(
npx --yes playwright test --reporter=list 2>/dev/null
node "$tmp_script" "$normalised" 2>/dev/null
)"; then
if result="$(
npx --yes playwright test --reporter=list 2>/dev/null
node "$tmp_script" "$normalised"
)"; then
References
  1. 2>/dev/null is acceptable ONLY when redirecting to log files, not blanket suppression (Line 50) (link)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant