1. Add Gemma2 configuration, tokenizer and model classes
2. Add comprehensive unit tests for model and tokenizer
3. Support key features:
   • RMS normalization
   • Rotary position embeddings
   • Multi-query attention
   • Gradient checkpointing
   • KV cache for inference

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description