timmy opened issue timmy/harness#2

timmy
Thu, 02 Apr 2026 18:57:28 +0000

Test Gemma 4 4B - Code Completion

This issue tracks testing of code completion and generation capabilities using the Gemma 4 4B model via the Hermes Profile.

Profile Location

~/.hermes/profiles/gemma4/

Test Script

#!/bin/bash
# test_gemma4_4b_code.sh
# Code completion test for Gemma 4 4B model

set -e

PROFILE_PATH="$HOME/.hermes/profiles/gemma4"
MODEL_NAME="gemma-4-4b-it"

echo "Testing Gemma 4 4B Code Completion..."

# Load profile
source "$PROFILE_PATH/env"

# Test code completion
hermes run --model "$MODEL_NAME" --prompt "Write a Python function to calculate fibonacci numbers

def fibonacci(n):"

# Test code explanation
hermes run --model "$MODEL_NAME" --prompt "Explain this code:
for i in range(10):
    print(i**2)"

echo "Test completed successfully!"

Test Checklist

Profile loads correctly

Code generation is syntactically correct

Code follows best practices

Code explanation is accurate

Multiple languages supported (Python, JS, Rust)

Assignee

@adagio