INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS AND DATA SCIENCE

Small Language Models and Spec-Driven Development for High-Accuracy Agentic AI Systems

Published in issue

October 2026

Volume / Issue

Vol. 1 No. 3

Access

Open access

View PDF

The article details presented on this page reflect the published version of record. Readers may access the full-text PDF, review the citation information, and export the reference in supported citation formats.

Abstract

Agentic Artificial Intelligence (AI) systems are often designed with large language models (LLMs) that are assumed to achieve better performance on all tasks as they grow larger. This paper contradicts this belief by showing that small language models (SLMs), when combined with specification-driven development, are more accurate, consistent, and cost-effective than agent design in standard operations. We present a hybrid architecture in which a lightweight dispatcher takes in structured tasks, which are routed to specialist LoRA fine-tuned SLMs. The output generated is fed to a deterministic specification validator for verification. An LLM serves as a fallback for tasks that are out-of-distribution or too complex. This framework was evaluated on four representative agentic tasks: date extraction, JSON formatting, arithmetic reasoning, and schema-constrained tool calling. According to experimental results, the SLM-first consistently outperforms the LLM-only baseline significantly, showing accuracy improvement of 7.8% to 13.2%. Moreover, it achieves 7 times lower inference latency and almost an order of magnitude lower operational cost. Additionally, the proposed approach reports an output consistency of 99.8% as compared to the LLM baseline, which merely achieves 92%. This makes it suitable for production environments that demand predictable and reliable behavior. The findings suggest that specialized SLMs with explicit specifications and selective LLM fallback are a practical, scalable, and low-energy foundation for next-gen high-accuracy agentic AI systems.
Keywords:Cost-Efficient AISpecification- Driven DevelopmentTool CallingSmall Language Models (SLMs)Large Language Models (LLMs)Reliable AI Systems

Cite this Article

Use the following citation when referencing this publication in academic or professional work.

G. Sankaran, "Small Language Models and Spec-Driven Development for High-Accuracy Agentic AI Systems", Int. J. Intell. Syst. Data Sci., vol. 1, no. 3, Oct. 2026, doi: https://doi.org/10.67231/qqk79s36.

DOWNLOAD CITATION

Small Language Models and Spec-Driven Development for High-Accuracy Agentic AI Systems | International Journal of Intelligent Systems and Data Science