The paper presents an innovative approach to automatic generation of synthetic question-answer (QA) pair datasets using a multi-agent system based on artificial intelligence. The system integrates modern web technologies with advanced AI agents to enable an efficient retrieval, processing, and synthesis of knowledge from web sources. The implementation utilizes a FastAPI backend with the CrewAI framework for agent orchestration, MongoDB and ChromaDB for the data storage, and a react frontend for the user interface with a real-time communication via WebSocket.
|