Test Gemma 4 4B - Code Completion #2

New Issue

timmy · 2026-04-02T18:57:28Z

timmy commented

2026-04-02 18:57:28 +00:00

Test Gemma 4 4B - Code Completion

This issue tracks testing of code completion and generation capabilities using the Gemma 4 4B model via the Hermes Profile.

Profile Location

~/.hermes/profiles/gemma4/

Test Script

#!/bin/bash
# test_gemma4_4b_code.sh
# Code completion test for Gemma 4 4B model

set -e

PROFILE_PATH="$HOME/.hermes/profiles/gemma4"
MODEL_NAME="gemma-4-4b-it"

echo "Testing Gemma 4 4B Code Completion..."

# Load profile
source "$PROFILE_PATH/env"

# Test code completion
hermes run --model "$MODEL_NAME" --prompt "Write a Python function to calculate fibonacci numbers

def fibonacci(n):"

# Test code explanation
hermes run --model "$MODEL_NAME" --prompt "Explain this code:
for i in range(10):
    print(i**2)"

echo "Test completed successfully!"

Test Checklist

Profile loads correctly
Code generation is syntactically correct
Code follows best practices
Code explanation is accurate
Multiple languages supported (Python, JS, Rust)

Assignee

@adagio

## Test Gemma 4 4B - Code Completion This issue tracks testing of code completion and generation capabilities using the Gemma 4 4B model via the Hermes Profile. ### Profile Location ``` ~/.hermes/profiles/gemma4/ ``` ### Test Script ```bash #!/bin/bash # test_gemma4_4b_code.sh # Code completion test for Gemma 4 4B model set -e PROFILE_PATH="$HOME/.hermes/profiles/gemma4" MODEL_NAME="gemma-4-4b-it" echo "Testing Gemma 4 4B Code Completion..." # Load profile source "$PROFILE_PATH/env" # Test code completion hermes run --model "$MODEL_NAME" --prompt "Write a Python function to calculate fibonacci numbers def fibonacci(n):" # Test code explanation hermes run --model "$MODEL_NAME" --prompt "Explain this code: for i in range(10): print(i**2)" echo "Test completed successfully!" ``` ### Test Checklist - [ ] Profile loads correctly - [ ] Code generation is syntactically correct - [ ] Code follows best practices - [ ] Code explanation is accurate - [ ] Multiple languages supported (Python, JS, Rust) ### Assignee @adagio

adagio was assigned by timmy

2026-04-02 18:57:28 +00:00

timmy added the agent gemma4 testing labels 2026-04-02 18:57:45 +00:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: timmy/harness#2