Skip to content
This repository was archived by the owner on May 21, 2024. It is now read-only.
This repository was archived by the owner on May 21, 2024. It is now read-only.

prototype python_pachyderm.run_like_a_pipeline #320

@albcui

Description

@albcui

An example usage:

--- cell --
def pl_body():
  open("/pfs/big", "r") as f:
  # do stuff with f

run_like_a_pipeline(
  datums=["big:/", "config:/cfgfile1.txt"],
  code=pl_body)
--- output ---
output is in '/data/a1b2c3'
---cell ---
matplotlib.plot("/data/a1b2c3")
--- output ---
<graph>
---

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions