CodeGen

CodeGen

模型：https://huggingface.co/Salesforce/codegen-6B-mono

CarpserAI： https://huggingface.co/CarperAI/diff-codegen-6b-v2

安装 Transformers:

pip install -i https://testpypi.python.org/pypi transformers

测试安装：

python -c "from transformers import pipeline; classifier = pipeline('text-classification'); print(classifier('What a nice release'))"

代码：

测试代码：

from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("Salesforce/codegen-6B-mono")
model = AutoModelForCausalLM.from_pretrained("Salesforce/codegen-6B-mono")

text = "def hello_world():"
input_ids = tokenizer(text, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=128)
print(tokenizer.decode(generated_ids[0], skip_special_tokens=True))