Skip to content

docs: add sustainability benchmarking tutorial#711

Open
zinichakraborty wants to merge 3 commits into
PrunaAI:mainfrom
zinichakraborty:docs/sustainability-benchmarking-tutorial
Open

docs: add sustainability benchmarking tutorial#711
zinichakraborty wants to merge 3 commits into
PrunaAI:mainfrom
zinichakraborty:docs/sustainability-benchmarking-tutorial

Conversation

@zinichakraborty

Copy link
Copy Markdown

Description

Adds a tutorial notebook demonstrating sustainability benchmarking with the EvaluationAgent: a stable-diffusion-v1-5 baseline is compared against deepcache and torch_compile on total_time, energy_consumed, co2_emissions, and clip_score, using a 10-sample subset of LAION256 on a T4. Includes side-by-side comparison figures and a takeaway on interpreting efficiency gains vs. quality cost (with a pointer to the CMMD tutorial for stricter quality evaluation). Also registers the notebook in docs/tutorials/index.rst.

Related Issue

Fixes #602

Type of Change

  • Documentation update

Testing

  • I added or updated tests covering my changes
  • Existing tests pass locally (uv run pytest -m "cpu and not slow")

No library code is changed, so no unit tests were added. The notebook was executed end-to-end on a Colab T4 (pruna 0.3.4) with all cells completing; outputs are stripped per the convention in the existing tutorials. Comparison figures from the run are attached below for review. ruff check passes on the notebook with the repo config.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my code, especially for agent-assisted changes
  • I updated the documentation where necessary

@review-notebook-app

Copy link
Copy Markdown

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@zinichakraborty zinichakraborty changed the title Docs/sustainability benchmarking tutorial docs: add sustainability benchmarking tutorial Jul 8, 2026
@begumcig begumcig self-requested a review July 8, 2026 09:59
@sdiazlor sdiazlor self-requested a review July 8, 2026 15:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DOC] Add a tutorial on benchmarking sustainability

1 participant