AutoLOGIC README

The project's README from github.com/sethGu/AutoLOGIC. As one markdown file: README.md.

AutoLOGIC

AutoLOGIC is an agentic framework for automated tabular learning across classification, regression, and clustering. It converts a task specification into coordinated feature, model, optimization, and output-control plans, executes the plans with task-specific tools, and records plan revisions from validation and execution observations.

Agentic workflow

  1. TaskSpec defines the task, dataset, primary metric, output requirements, and execution constraints.
  2. AgenticReasoningAgent coordinates four plan channels: feature engineering, model construction, optimization, and output control.
  3. Task-specific executors generate and evaluate feature programs, candidate models, and parameter configurations.
  4. Validation scores, failures, retries, and fallbacks are returned to the agent as observations.
  5. The agent records a retain, revise, or fallback transition for the affected plan channel.
  6. The selected route produces stacking, distillation, calibration, prediction-interval, or clustering outputs according to the task.

Repository structure

Installation

python -m venv .venv
python -m pip install -r requirements.txt

Configure data paths and the LLM endpoint through environment variables:

OPENAI_API_KEY
OPENAI_BASE_URL
AUTOLOGIC_DATA_DIR
AUTOLOGIC_CSV_DATA_DIR
AUTOLOGIC_REGRESSION_DATA_DIR

Task runners

python autologic/ensemble/classification_ensemble/classification_auto_ensemble.py --help
python autologic/ensemble/multiclassification_ensemble/multiclassification_auto_ensemble.py --help
python autologic/ensemble/regression_ensemble/regression_auto_ensemble.py --help
python autologic/ensemble/cluster_ensemble/cluster_auto_ensemble_hidden_evaluator.py --help

Each runner accepts --task-spec <path.json>. The generated protocol file contains the task specification, four plans, agent configuration, and execution transitions.

python autologic/ensemble/classification_ensemble/classification_auto_ensemble.py --task-spec configs/task_spec.classification.example.json

Figure reproduction

pwsh reproduce/fig4/run_full_benchmark.ps1

Fig. 5 and Fig. 6 scripts are organized by panel under reproduce/fig5/ and reproduce/fig6/.

Source verification

python scripts/check_release.py
python scripts/build_manifest.py

AutoLOGIC (sethGu/AutoLOGIC)

tabular-data
Searching Database…

What is this?AutoLOGIC is an agentic framework for automated tabular machine learning across classification, regression, and clustering. It turns a task specification into coordinated feature, model, optimization, and output-control plans and then executes them with task-specific tools.
Is this a ready-to-use tool or a research framework I script against?It is a research framework: you describe a job as a TaskSpec config and launch the matching Python runner with --task-spec, not a point-and-click app.
How do I get a task running?Set your dataset paths and the LLM endpoint through environment variables, then run the task-specific runner with --task-spec pointing at your config file.
Do I need an LLM API to use this?Yes, the AgenticReasoningAgent relies on a configured LLM endpoint, set alongside your data paths via environment variables.
Is this production-ready or more of a research artifact?It reads as research code built to accompany a paper: it ships separate reproduce/fig4, fig5, fig6 scripts to regenerate figures and depends on legacysage/compat benchmark modules, rather than being packaged for production use.
What are the four plan channels the agent coordinates?It coordinates feature engineering, model construction, optimization, and output-control plans, each revised independently based on execution feedback.
What kinds of outputs can a task produce?Depending on the task, AutoLOGIC can produce stacking, distillation, calibration, prediction-interval, or clustering outputs.
How does the agent decide whether to change its plan?After execution, validation scores, failures, retries, and fallbacks come back as observations, and the agent records a retain, revise, or fallback transition for the affected plan channel.
Can I reproduce the paper's figures with this repo?Yes, the reproduce/fig4, fig5, and fig6 folders contain the benchmark execution, calibration, distillation, and clustering scripts used to generate those figures.
Creator
sethGu
Size
0.4 MB
Stars
209
Updated
CommitSep 12
Age
1mo
Commits · 90 Days