GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — AI assisted Script Editiing: removed dependencies, refactored OpenAI code, added anthropic Claude by haesleinhuepf · Pull Request #70 · scijava/script-editor

Conversation

@haesleinhuepf

@haesleinhuepf haesleinhuepf commented Aug 24, 2024

Copy link
Copy Markdown
Member

Hi Curtis @ctrueden ,

I was working on LLM integration in the Script Editor again. The library we used before was archived by its developer and had a lot of dependencies, that's why I removed it. I'm now accessing the LLMs directly via their REST API. Thus, we have now minimal dependencies, no additional jar files that need to be shipped via the update site.

Furthermore, I used the opportunity to refactor code, and add support for Anthropic's claude. Support for Gemini, Ollama etc seems trivial, and could be added via a follow-up PR. I also renamed "OpenAI Options" to "LLM Service Options" and also optimized the default prompt a bit.

Let me know what you think!

Best,
Robert

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
All reactions
@haesleinhuepf
removed dependencies, refactored OpenAI code, addend anthropic Claude
23a611b
@imagesc-bot

imagesc-bot commented Aug 24, 2024

Copy link
Copy Markdown

This pull request has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/ai-assisted-code-generation-in-fijis-script-editor/100877/1
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@haesleinhuepf haesleinhuepf changed the title removed dependencies, refactored OpenAI code, addend anthropic Claude removed dependencies, refactored OpenAI code, added anthropic Claude Aug 24, 2024
@haesleinhuepf haesleinhuepf changed the title removed dependencies, refactored OpenAI code, added anthropic Claude AI assisted Script Editiing: removed dependencies, refactored OpenAI code, added anthropic Claude Aug 27, 2024
@haesleinhuepf
haesleinhuepf requested a review from ctrueden August 27, 2024 10:50
@imagesc-bot

imagesc-bot commented Jun 2, 2025

Copy link
Copy Markdown

This pull request has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/globias-bioimage-analysis-seminar-series-fiji-with-python-power/113118/1
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@hinerm

hinerm commented Aug 4, 2025

Copy link
Copy Markdown
Member

@haesleinhuepf did you continue this development at all? I currently get 401's for https://api.openai.com/v1/chat/completions when I tried it.

I am currently working on a workshop for introducing novice image analysts to LLMs, and am interested in exploring Fiji integration further in the near future
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@haesleinhuepf

haesleinhuepf commented Aug 4, 2025

Copy link
Copy Markdown
Member Author

Hi @hinerm ,

I hardly use Fiji anymore.

Http 401 errors with OpenAI API sound like you have no API KEY configured or it is outdated. Feel free to open an issue if you need further assistance with this.

Best,
Robert
hinerm reacted with heart emoji
All reactions
  • ❤️ 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@hinerm hinerm mentioned this pull request Aug 27, 2025
Requirements Gathering fiji/fiji-llm#1
Open
16 of 32 tasks
@imagesc-bot

imagesc-bot commented Sep 8, 2025

Copy link
Copy Markdown

This pull request has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/bina-exchange-of-experiences-reflections-and-outcomes-from-aug-25-llm-image-analysis-workshop/116372/1
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@haesleinhuepf

haesleinhuepf commented Sep 19, 2025

Copy link
Copy Markdown
Member Author

Hi @ctrueden ,

I'm just curious: Is this something worth merging and distributing?

Thanks!

Best,
Robert
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@hinerm

hinerm commented Sep 19, 2025

Copy link
Copy Markdown
Member

@haesleinhuepf I don't want to merge this without more testing. When I tried it, I was using the same API key in napari/Omega in the same time period, so it was either a problem with the access or how we were handling key settings.

Regardless, this is a great proof of concept, but I would like to explore a robust LLM integration that is not tied to the script editor (which is why I didn't debug further).

I started gathering requirements. This is high on my personal priority list so I'm hoping to start on it in the near future.

If anyone wants to use this as a stopgap in the meantime then I can revisit and troubleshoot; I expect it is a minor issue.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ctrueden ctrueden Awaiting requested review from ctrueden

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

3 participants

@haesleinhuepf @imagesc-bot @hinerm
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.