LV EN

COMPARATIVE ANALYSIS OF LLM-BASED APPROACHES FOR SQL GENERATION

Maksim Ilin

ABSTRACT

The rapid development of Large Language Models has unlocked opportunities for restructuring software development processes in general as well as in such cases as converting natural language into SQL queries. This study seeks to experimentally evaluate the effects of four LLM-based methods on the efficiency and quality of SQL generation. Evaluation is being held based on following metrics: Correctness, Completeness and Consistency. Studied LLM-based SQL generation methods include Specific LLMs tailored for SQL code generation like SQL Coder frameworks for generating SQL code (Vanna.ai, 2023; Llamaindex, 2023) and Multi agent collaborative networks for transforming language into SQL.
The research utilizes a mix of literature review case studies and simulations. It offers a comprehensive review of the advancements in LLM-driven SQL generation encompassing concepts, technologies, methodologies, strengths, limitations, and ethical considerations.
This research successfully bridges the gap between theoretical foundations and practical application of AI-augmented approaches while promoting the integration of LLM-based SQL generation, into automated software development processes.
Author: Maksim Ilin
Degree: Master
Year: 2024
Work Language: English
Supervisor: Dr. sc. ing., Dmitry Pavlyuk
Faculty: Engineering Faculty
Study programme: Computer Sciences

KEYWORDS

LARGE LANGUAGE MODELS, SQL GENERATION, NATURAL LANGUAGE PROCESSING, SOFTWARE DEVELOPMENT AUTOMATION, AGENTS