Add GLM-4 CPU example

[JinBridger]

No description provided.

[JinBridger]

(jinqiao-llm-0612) arda@arda-arc21:~/jinqiao$ python generate.py --repo-id-or-model-path /mnt/disk1/models/glm-4-9b-chat/
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 41.15it/s]
2024-06-12 09:59:29,390 - INFO - Converting the current model to sym_int4 format......
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Traceback (most recent call last):
  File "/home/arda/jinqiao/generate.py", line 61, in <module>
    output = model.generate(input_ids,
             ^^^^^^^^^^^^^^^^^^^^^^^^^
......
  File "/home/arda/miniforge3/envs/jinqiao-llm-0612/lib/python3.11/site-packages/ipex_llm/transformers/models/chatglm4.py", line 342, in core_attn_forward
    key_layer.transpose(2, 3)) / math.sqrt(head_dim)
                                 ^^^^
NameError: name 'math' is not defined

Looks like we need import math in transformers/models/chatglm4.py ?

[Oscilloscope98]

(jinqiao-llm-0612) arda@arda-arc21:~/jinqiao$ python generate.py --repo-id-or-model-path /mnt/disk1/models/glm-4-9b-chat/
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 41.15it/s]
2024-06-12 09:59:29,390 - INFO - Converting the current model to sym_int4 format......
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Traceback (most recent call last):
  File "/home/arda/jinqiao/generate.py", line 61, in <module>
    output = model.generate(input_ids,
             ^^^^^^^^^^^^^^^^^^^^^^^^^
......
  File "/home/arda/miniforge3/envs/jinqiao-llm-0612/lib/python3.11/site-packages/ipex_llm/transformers/models/chatglm4.py", line 342, in core_attn_forward
    key_layer.transpose(2, 3)) / math.sqrt(head_dim)
                                 ^^^^
NameError: name 'math' is not defined

Looks like we need import math in transformers/models/chatglm4.py ?

It will be fixed in #11276. We may use 2.1.0b20240606 for sample output now :)