CodeBERTScore: an automatic metric for code generation, based on BERTScore
-
Updated
Mar 1, 2024 - Jupyter Notebook
#
bertscore
Here are 46 public repositories matching this topic...
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
natural-language-processing deep-learning text-generation fairness-ai fairness-ml pretrained-language-model bertscore metric-bias
-
Updated
Oct 19, 2022 - Jupyter Notebook
LLM Evaluation and Observability System for Football Content
python mongodb pre-commit openai cosine-similarity evaluation-metrics comet-ml hallucination huggingface-transformers zenml bertscore
-
Updated
Jun 19, 2025 - Python
MAchine Translation Evaluation Online (MATEO)
machine-translation comet ter bleu clarin machine-translation-metrics streamlit bertscore bleurt machine-translation-evaluation chrf
-
Updated
May 8, 2026 - Python
Domain-specialized Gemma 2 27B + Gemma 4 31B for SEC filings — fine-tuned on TPU v6e-8 with PyTorch/XLA FSDPv2, plus a Vertex AI Vector Search RAG demo (69 tickers × 381 filings). Same LoRA recipe, +3.5% / +5.8% BERTScore F1.
finance lora knowledge-distillation gemma tpu peft sec-filings rag streamlit pytorch-xla vertex-ai bertscore gemma-2 gemma-4
-
Updated
Apr 26, 2026 - Python
Fine-tuning GPT-3.5 and Llama3 LLMs for enhanced persona consistency in chatbots using Google's Synthetic Persona Chat dataset
-
Updated
May 3, 2025 - Jupyter Notebook
ViAG: A Novel Framework for Fine-tuning Answer Generation models ultilizing Encoder-Decoder and Decoder-only Transformers's architecture
meteor question-answering bart llama rouge bleu-score encoder-decoder fine-tuning answer-generation t5 plms bartpho llm bertscore instruction-tuning qlora qwen decoder-only vit5
-
Updated
May 26, 2025 - Python
Agent Orchestration - LLM for Legal Metadata Extraction: A Comparative Analysis of Efficiency and Precision (paper 161 PROPOR)
-
Updated
Apr 20, 2026 - Python
Medical Question Answering System using on PubMed dataset.
-
Updated
May 29, 2025 - Jupyter Notebook
The work presented was developed during the internship, as researchers in the field of Natural Language Generation, at the Insid&s Lab laboratory in Milan-Bicocca. The work carried out deals with the creation of a framework for the correct assessment of the impact of the quality of the input datasets on the quality of the text generated by the N…
python natural-language-processing deep-learning torch artificial-intelligence lstm rdf-triples natural-language-generation nlg rouge-metric bleu-score transformer-architecture bertscore
-
Updated
Mar 30, 2026 - Jupyter Notebook
Implementation of a task-specific QLoRA supervised fine-tuning pipeline for LLaMA-2-7B-Chat, developed for an independent study on structured cover letter generation.
nlp natural-language-processing transformers text-generation pytorch rouge lora model-evaluation fine-tuning peft huggingface llm bertscore supervised-finetuning qlora llama2 parameter-efficient-fine-tuning structured-generation
-
Updated
Jun 9, 2026 - Python
An LLM-powered application that summarizes scientific research papers, extracts tables, and provides real-time evaluation using BERTScore (F1) and ROUGE. Built using Meta’s LLaMA 3–8B via Groq, with table extraction powered by pdfplumber and pandas.
-
Updated
Jul 23, 2025 - Python
AI-powered research paper summarizer built with Streamlit and Google Gemini. Supports customizable summaries, paper Q&A, ROUGE/BERTScore evaluation, and latency benchmarking.
python nlp artificial-intelligence summarization rouge research-paper gemini-api streamlit llm bertscore prompt-engineering generative-ai
-
Updated
Jun 24, 2026 - Python
Role-aware crisis tweet summarization using transformer baselines, automated reward scoring, and preference optimization.
natural-language-processing transformers text-summarization rouge disaster-response emergency-management crisis-informatics openai-api bertscore t5-small reward-modeling crisis-summarization tweet-summarization role-aware-summarization frecs-dataset
-
Updated
Jul 1, 2026 - Jupyter Notebook
[radscore] Evaluation metrics for radiology report generation — BLEU, ROUGE, BERTScore, F1-RadGraph, CheXbert F1 & GREEN in one `pip install`.
machine-learning tutorial deep-learning medical-imaging rouge radiology evaluation-metrics bleu-score multilabel-classification medical-natural-language-processing chexpert report-generation healthcare-ai bertscore radiology-report-generation vision-language-model chexbert radgraph green-metric
-
Updated
Jun 16, 2026 - Python
Model-agnostic toolkit to evaluate text-summarization models — ROUGE/BLEU/BERTScore + perplexity + LLM-as-judge, MLflow tracking, CLI + library with unit-tested metrics.
python nlp cli evaluation transformers text-summarization rouge bleu perplexity mlflow huggingface bertscore llm-evaluation llm-as-judge
-
Updated
Jul 20, 2026 - Python
Detecting and Mitigating Self Contradictory Hallucinations in LLMs using a Multi-Agent System and Stepback Prompting
-
Updated
May 30, 2024 - Jupyter Notebook
Evaluation framework for measuring LLM reasoning and translation performance across low-resource languages using glossary-guided prompting and semantic similarity metrics.
python nlp machine-learning natural-language-processing research translation artificial-intelligence llama semantic-similarity computational-linguistics evaluation-framework low-resource-languages language-model-evaluation sentence-transformers large-language-models llm bertscore prompt-engineering chain-of-thought multilingual-ai
-
Updated
Jun 19, 2026 - Python
Improve this page
Add a description, image, and links to the bertscore topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bertscore topic, visit your repo's landing page and select "manage topics."