Download Latest Version ane_transformers-0.1.3.tar.gz (19.2 kB)
Email in envelope

Get an email when there's a new version of Apple Neural Engine (ANE) Transformers

Home / v0.1.2
Name Modified Size InfoDownloads / Week
Parent folder
ane_transformers-0.1.2.tar.gz 2022-07-30 21.3 kB
README.md 2022-07-30 573 Bytes
v0.1.2 source code.tar.gz 2022-07-30 1.1 MB
v0.1.2 source code.zip 2022-07-30 1.1 MB
Totals: 4 Items   2.2 MB 0
  • torch.nn.LayerNorm and ane_transformers.reference.layer_norm.LayerNormANE apply scale and bias terms in opposite orders. In order to accurately restore a state_dict trained using the former into the the latter, we adjust the bias term. This change slightly improves the parity between the Hugging Face PyTorch model's outputs and ane_transformers CoreML model's outputs.
  • Introduce upper bound for torch version at 1.11.0 to ensure that coremltools-5.2.0 is well paired. The upper bound will be removed/updated when coremltools-6.0 is released (currently in beta1).
Source: README.md, updated 2022-07-30