Eureka Context Engineering V6 1

---
name: eureka-context-engineering-v6.1
description: Complete Eureka V6.1 Context Engineering suite with observability, structured output, and hybrid memory
version: 6.1.0
status: production
triggers:
  - eureka
  - context engineering
  - reward design
  - agent observability
  - structured output
  - hybrid memory
scope: global
---

# SKILL: Eureka Context Engineering V6.1

> **The complete suite for autonomous context optimization and agent self-improvement.**

---

## 🎯 What This Skill Provides

This skill consolidates the **Eureka V6.1 Gold Standard** for context engineering, including:

1. **Textual Gradients** - Semantic backpropagation for prompt optimization
2. **Context Pruning** - Active distillation (Sawtooth Pattern)
3. **Self-Maintenance** - Automated log hygiene
4. **Structured Output** - JSON Schema enforcement
5. **Hybrid Memory** - Vector + Graph RAG
6. **Agent Observability** - Span-based tracing + metrics
7. **Trace Analysis** - Performance insights and bottleneck detection

---

## 📦 Components

### Core Prototypes (`scripts/`)

| File | Purpose | Status |
|------|---------|--------|
| `eureka_gradients.py` | Textual gradient optimization | ✅ Active |
| `eureka_pruner.py` | Context distillation | ✅ Active |
| `valid_json.py` | Structured output validation | ✅ Active |
| `graph_memory.py` | Hybrid memory (Vector+Graph) | ✅ Active |
| `agent_tracer.py` | Observability system | ✅ Active |
| `analyze_traces.py` | Performance analysis | ✅ Active |

### Production Integration (`sync_ai.py`)

| Class | Purpose | Status |
|-------|---------|--------|
| `LogPruner` | Automated log maintenance | ✅ Integrated |
| `AgentTracer` | Production observability | ✅ Integrated |
| `EfficiencyMonitor` | Resource tracking ($TUY) | ✅ Integrated |
| `IntrospectiveLogger` | Reasoning chain logging | ✅ Integrated |

---

## 🚀 Quick Start

### 1. Run Individual Prototypes

```bash
# Test textual gradients
python scripts/eureka_gradients.py

# Test context pruning
python scripts/eureka_pruner.py

# Test structured output
python scripts/valid_json.py

# Test hybrid memory
python scripts/graph_memory.py

# Test agent tracer
python scripts/agent_tracer.py

# Analyze traces
python scripts/analyze_traces.py
```

### 2. Use Production Features

```bash
# Bootstrap with observability
python sync_ai.py --bootstrap

# Prune logs
python sync_ai.py --prune-logs

# Verify Eureka alignment
python sync_ai.py --verify-eureka
```

---

## 📚 Best Practices (V6.1 Gold Standard)

### 1. Infrastructure: Environment-as-Context
- **Raw Code Injection**: Provide source code, not descriptions
- **API Spec over Docs**: Use Swagger, Protobuf, Type definitions
- **Regional ROI**: Limit context to specific regions

### 2. Iterative Loop: Reward Reflection
- **Metric Statistics**: Generate execution stats
- **Instructional Mutation**: Let model rewrite prompts
- **Multi-Candidate Sampling**: Generate 4-8 variants

### 3. Agentic Context Engineering (ACE)
- **Selective Forgetting**: Remove unused examples
- **Two-Phase Pre-Context**: Inject success memory
- **Self-Refinement**: Allow agents to modify guides

### 4. Advanced 2026 Patterns
- **Differentiable Context**: Textual gradients
- **Bayesian Multi-Objective**: Balance 3+ objectives
- **Collective Memory**: Sync success trajectories
- **Hardware-Aware**: Leverage Rubin, BlueField-4

### 5. V6.1 Mandatory Requirements
1. **Motivational Alignment (RLMF)**: $TUY feedback loop
2. **Geospatial Grounding**: Vertex AI Maps for physical decisions
3. **Predictive Caching**: AlloyDB semantic cache
4. **Administrative Sanity**: Auto-register in `SKILL_MANIFEST.md`

---

## 🔧 Implementation Patterns

### Pattern 1: Textual Gradients

```python
from scripts.eureka_gradients import TextualGradient

gradient = TextualGradient()
optimized_prompt = gradient.backprop(
    original_prompt="Execute task X",
    error_log="Failed: timeout",
    target_metric="latency"
)
```

### Pattern 2: Context Pruning

```python
from scripts.eureka_pruner import ContextPruner

pruner = ContextPruner(max_tokens=2000)
pruned_context = pruner.distill(
    full_context=large_context,
    high_value_keywords=["CRITICAL", "ERROR"]
)
```

### Pattern 3: Structured Output

```python
from scripts.valid_json import validate_schema

schema = {
    "type": "object",
    "properties": {
        "action": {"type": "string"},
        "confidence": {"type": "number"}
    },
    "required": ["action"]
}

is_valid = validate_schema(agent_output, schema)
```

### Pattern 4: Hybrid Memory

```python
from scripts.graph_memory import HybridMemory

memory = HybridMemory()
memory.ingest_knowledge(
    concept="PromptEngineering",
    description="Art of crafting LLM inputs",
    relations=[("USES", "ChainOfThought")]
)

results = memory.query("What uses ChainOfThought?")
```

### Pattern 5: Agent Observability

```python
from scripts.agent_tracer import AgentTracer

tracer = AgentTracer("my_agent")
span = tracer.start_span("task_execution", task_id=123)
# ... execute task ...
tracer.end_span(result="success")
```

---

## 📊 Observability & Metrics

### Trace Analysis

```bash
# Generate performance report
python scripts/analyze_traces.py
```

Output includes:
- Performance metrics (avg/min/max)
- Bottleneck detection (>100ms operations)
- Optimization recommendations
- Exported summary in `logs/trace_analysis.md`

### Resource Monitoring

All operations are automatically tracked:
- CPU usage
- Process RAM (MB)
- System RAM (GB)
- Execution duration (ms)

Logs stored in:
- `logs/efficiency_metrics.csv` - Resource usage
- `logs/introspection.log` - Reasoning chains
- `logs/traces.jsonl` - Execution traces

---

## 🔗 Integration with Other Skills

### With `lateralize-projects`
```bash
# Propagate Eureka protocols to other projects
python sync_ai.py --propagate "D:\Proyectos\target_project"
```

### With `prompt-engineering`
Use Eureka patterns to optimize prompts:
- Textual gradients for error correction
- Context pruning for token efficiency
- Structured output for reliability

### With `task-delegation`
Apply observability to multi-agent systems:
- Trace each agent's execution
- Detect bottlenecks in delegation
- Optimize task distribution

---

## 🎓 Learning Resources

### Documentation
- [EUREKA_CONTEXT_ENGINEERING_BEST_PRACTICES.md](file:///D:/Proyectos/gentleman/knowledge/chuletas/EUREKA_CONTEXT_ENGINEERING_BEST_PRACTICES.md)
- [EUREKA_TEXTUAL_GRADIENTS_OPTIMIZATION.md](file:///D:/Proyectos/gentleman/knowledge/EUREKA/EUREKA_TEXTUAL_GRADIENTS_OPTIMIZATION.md)
- [EUREKA_HYPER_OPTIMIZATION_2026.md](file:///D:/Proyectos/gentleman/knowledge/chuletas/EUREKA_HYPER_OPTIMIZATION_2026.md)
- [AGENT_OBSERVABILITY_TRACING.md](file:///D:/Proyectos/gentleman/knowledge/chuletas/AGENT_OBSERVABILITY_TRACING.md)
- [KNOWLEDGE_GRAPH_AGENT_MEMORY.md](file:///D:/Proyectos/gentleman/knowledge/chuletas/KNOWLEDGE_GRAPH_AGENT_MEMORY.md)
- [STRUCTURED_OUTPUT_JSON_SCHEMA.md](file:///D:/Proyectos/gentleman/knowledge/chuletas/STRUCTURED_OUTPUT_JSON_SCHEMA.md)

### Research Papers
- Nvidia Eureka (2023): Autonomous Reward Design
- Stanford ACE (2025): Agentic Context Engineering
- GraphRAG (2024): Hybrid Memory Systems

---

## ⚡ Performance Benchmarks

| Capability | Improvement | Metric |
|------------|-------------|--------|
| Context Pruning | 70%+ | Token reduction |
| GraphRAG | 3.4x | Accuracy boost |
| Structured Output | 100% | Valid integration |
| Trace Analysis | <13ms | Bootstrap time |
| Log Pruning | 80%+ | Entropy reduction |

---

## 🛡️ Security & Compliance

- **Zero Trust**: All inputs validated via JSON Schema
- **Resource Limits**: $TUY system enforces 25GB RAM threshold
- **Administrative Sanity**: Auto-registration prevents orphaned skills
- **Audit Trail**: Full observability via traces and introspection logs

---

## 🔄 Version History

### V6.1 (2026-01-21) - Current
- ✅ Complete prototype suite (6 tools)
- ✅ Production integration (AgentTracer, LogPruner)
- ✅ Trace analysis utility
- ✅ AliciaStore integration
- ✅ Neural Link broadcasts

### V6.0 (2026-01-20)
- Initial Eureka implementation
- Best practices documentation
- RLMF integration

---

## 📞 Support

For questions or issues:
1. Check `GENTLEMAN_TO_RAPHAEL.md` for latest updates
2. Review `logs/trace_analysis.md` for performance insights
3. Run `python sync_ai.py --verify-eureka` for alignment check

---

**Status**: PRODUCTION READY ✅  
**Propagate to**: All Hive projects  
**Maintained by**: Gentleman Central Brain