daft-udf-tuning

📁 eventual-inc/daft 📅 2 days ago

总安装量

周安装量

#58342

全站排名

安装命令

npx skills add https://github.com/eventual-inc/daft --skill daft-udf-tuning

Agent 安装分布

opencode 3

gemini-cli 3

claude-code 3

github-copilot 3

codex 3

kimi-cli 3

Skill 文档

Daft UDF Tuning

Optimize User-Defined Functions for performance.

UDF Types

Type	Decorator	Use Case
Stateless	`@daft.func`	Simple transforms. Use `async` for I/O-bound tasks.
Stateful	`@daft.cls`	Expensive init (e.g., loading models). Supports `gpus=N`.
Batch	`@daft.func.batch`	Vectorized CPU/GPU ops (NumPy/PyTorch). Faster.

Quick Recipes

1. Async I/O (Web APIs)

@daft.func
async def fetch(url: str):
    async with aiohttp.ClientSession() as s:
        return await s.get(url).text()

2. GPU Batch Inference (PyTorch/Models)

@daft.cls(gpus=1)
class Classifier:
    def __init__(self):
        self.model = load_model().cuda() # Run once per worker

    @daft.method.batch(batch_size=32)
    def predict(self, images):
        return self.model(images.to_pylist())

# Run with concurrency
df.with_column("preds", Classifier(max_concurrency=4).predict(df["img"]))

Tuning Keys

max_concurrency: Total parallel UDF instances.
gpus=N: GPU request per instance.
batch_size: Rows per call. Too small = overhead; too big = OOM.
into_batches(N): Pre-slice partitions if memory is tight.

GitHub 仓库 ↗ ← 返回陌讯 Skills 聚合平台