timmy opened issue timmy/harness#1

timmy
Thu, 02 Apr 2026 18:57:13 +0000

Test Gemma 4 2B - Basic Inference

This issue tracks testing of basic text generation capabilities using the Gemma 4 2B model via the Hermes Profile.

Profile Location

~/.hermes/profiles/gemma4/

Test Script

#!/bin/bash
# test_gemma4_2b_basic.sh
# Basic inference test for Gemma 4 2B model

set -e

PROFILE_PATH="$HOME/.hermes/profiles/gemma4"
MODEL_NAME="gemma-4-2b-it"

echo "Testing Gemma 4 2B Basic Inference..."

# Load profile
source "$PROFILE_PATH/env"

# Test basic prompt
hermes run --model "$MODEL_NAME" --prompt "Explain quantum computing in simple terms"

echo "Test completed successfully!"

Test Checklist

Profile loads correctly

Model responds to basic prompts

Output is coherent and relevant

Response time is acceptable (< 5s for short prompts)

Assignee

@allegro