AutoGen Studio - Getting Started
AutoGen Studio is an low-code interface built to help you rapidly prototype AI agents, enhance them with skills, compose them into workflows and interact with them to accomplish tasks. It is built on top of the AutoGen framework, which is a toolkit for building AI agents.
Code for AutoGen Studio is on GitHub at microsoft/autogen
Note: AutoGen Studio is meant to help you rapidly prototype multi-agent workflows and demonstrate an example of end user interfaces built with AutoGen. It is not meant to be a production-ready app. Developers are encouraged to use the AutoGen framework to build their own applications, implementing authentication, security and other features required for deployed applications.
Updates
-
April 17: AutoGen Studio database layer is now rewritten to use SQLModel (Pydantic + SQLAlchemy). This provides entity linking (skills, models, agents and workflows are linked via association tables) and supports multiple database backend dialects supported in SQLAlchemy (SQLite, PostgreSQL, MySQL, Oracle, Microsoft SQL Server). The backend database can be specified with a
--database-uri
argument when running the application. For example,autogenstudio ui --database-uri sqlite:///database.sqlite
for SQLite andautogenstudio ui --database-uri postgresql+psycopg://user:password@localhost/dbname
for PostgreSQL. -
March 12: Default directory for AutoGen Studio is now /home/
/.autogenstudio. You can also specify this directory using the --appdir
argument when running the application. For example,autogenstudio ui --appdir /path/to/folder
. This will store the database and other files in the specified directory e.g./path/to/folder/database.sqlite
..env
files in that directory will be used to set environment variables for the app.
Installation
There are two ways to install AutoGen Studio - from PyPi or from source. We recommend installing from PyPi unless you plan to modify the source code.
-
Install from PyPi
We recommend using a virtual environment (e.g., conda) to avoid conflicts with existing Python packages. With Python 3.10 or newer active in your virtual environment, use pip to install AutoGen Studio:
pip install autogenstudio
-
Install from Source
Note: This approach requires some familiarity with building interfaces in React.
If you prefer to install from source, ensure you have Python 3.10+ and Node.js (version above 14.15.0) installed. Here's how you get started:
-
Clone the AutoGen Studio repository and install its Python dependencies:
pip install -e .
-
Navigate to the
samples/apps/autogen-studio/frontend
directory, install dependencies, and build the UI:npm install -g gatsby-cli
npm install --global yarn
cd frontend
yarn install
yarn build
-
For Windows users, to build the frontend, you may need alternative commands to build the frontend.
gatsby clean && rmdir /s /q ..\\autogenstudio\\web\\ui 2>nul & (set \"PREFIX_PATH_VALUE=\" || ver>nul) && gatsby build --prefix-paths && xcopy /E /I /Y public ..\\autogenstudio\\web\\ui
Running the Application
Once installed, run the web UI by entering the following in your terminal:
autogenstudio ui --port 8081
This will start the application on the specified port. Open your web browser and go to http://localhost:8081/
to begin using AutoGen Studio.
AutoGen Studio also takes several parameters to customize the application:
--host <host>
argument to specify the host address. By default, it is set tolocalhost
. Y--appdir <appdir>
argument to specify the directory where the app files (e.g., database and generated user files) are stored. By default, it is set to the a.autogenstudio
directory in the user's home directory.--port <port>
argument to specify the port number. By default, it is set to8080
.--reload
argument to enable auto-reloading of the server when changes are made to the code. By default, it is set toFalse
.--database-uri
argument to specify the database URI. Example values includesqlite:///database.sqlite
for SQLite andpostgresql+psycopg://user:password@localhost/dbname
for PostgreSQL. If this is not specified, the database URI defaults to adatabase.sqlite
file in the--appdir
directory.
Now that you have AutoGen Studio installed and running, you are ready to explore its capabilities, including defining and modifying agent workflows, interacting with agents and sessions, and expanding agent skills.
Capabilities / Roadmap
Some of the capabilities supported by the app frontend include the following:
- Build / Configure agents (currently supports two agent workflows based on
UserProxyAgent
andAssistantAgent
), modify their configuration (e.g. skills, temperature, model, agent system message, model etc) and compose them into workflows. - Chat with agent workflows and specify tasks.
- View agent messages and output files in the UI from agent runs.
- Support for more complex agent workflows (e.g.
GroupChat
andSequential
workflows). - Improved user experience (e.g., streaming intermediate model output, better summarization of agent responses, etc).
Review project roadmap and issues here .
Project Structure:
- autogenstudio/ code for the backend classes and web api (FastAPI)
- frontend/ code for the webui, built with Gatsby and TailwindCSS
Contribution Guide
We welcome contributions to AutoGen Studio. We recommend the following general steps to contribute to the project:
- Review the overall AutoGen project contribution guide
- Please review the AutoGen Studio roadmap to get a sense of the current priorities for the project. Help is appreciated especially with Studio issues tagged with
help-wanted
- Please initiate a discussion on the roadmap issue or a new issue to discuss your proposed contribution.
- Please review the autogenstudio dev branch here dev branch and use as a base for your contribution. This way, your contribution will be aligned with the latest changes in the AutoGen Studio project.
- Submit a pull request with your contribution!
- If you are modifying AutoGen Studio, it has its own devcontainer. See instructions in
.devcontainer/README.md
to use it - Please use the tag
studio
for any issues, questions, and PRs related to Studio
A Note on Security
AutoGen Studio is a research prototype and is not meant to be used in a production environment. Some baseline practices are encouraged e.g., using Docker code execution environment for your agents.
However, other considerations such as rigorous tests related to jailbreaking, ensuring LLMs only have access to the right keys of data given the end user's permissions, and other security features are not implemented in AutoGen Studio.
If you are building a production application, please use the AutoGen framework and implement the necessary security features.
Acknowledgements
AutoGen Studio is Based on the AutoGen project. It was adapted from a research prototype built in October 2023 (original credits: Gagan Bansal, Adam Fourney, Victor Dibia, Piali Choudhury, Saleema Amershi, Ahmed Awadallah, Chi Wang).