Report non-embedding FLOPs #25

Open

Labels

opened

on Sep 15, 2025

It would be better to report both total flops and non embedding flops.

Leave out both the lm_head and the initial nn.Embedding

Metadata

Assignees

No one assigned

Labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests