add an op for counting tokens

[edknv]

No description provided.

[github-actions]

Benchmark comparison for a8bcda2 (main) vs e84ea628 (PR)

---------------------------------------------------------------------------------------------- benchmark: 2 tests ---------------------------------------------------------------------------------------------
Name (time in s)                                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fiqa_all_MiniLM_L6_v2 (0002_e84ea62)     97.2872 (1.0)      102.8844 (1.0)      100.1004 (1.0)      2.0047 (1.0)      100.0008 (1.0)      2.0631 (1.0)           2;0  0.0100 (1.0)           5           1
test_fiqa_all_MiniLM_L6_v2 (0001_main)        99.5801 (1.02)     104.5058 (1.02)     100.9442 (1.01)     2.0562 (1.03)     100.1272 (1.00)     2.1472 (1.04)          1;0  0.0099 (0.99)          5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean