Skip to content
View GioiaZheng's full-sized avatar
💚
💚

Block or report GioiaZheng

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
GioiaZheng/README.md

Gioia Zheng

M.Sc. Computer Science · TU Darmstadt
B.Sc. Applied Computer Science and Artificial Intelligence · Sapienza University of Rome · Expected Dec 2026

Website · Hugging Face · LinkedIn · Email · Research CV


About Me

Primary focus: Information Retrieval, RAG/LLM Evaluation, and Reproducible ML Systems. Secondary direction: exact evaluation of reinforcement-learning agents.

I study information retrieval and retrieval-augmented generation, focusing on when improvements in retrieval do—or do not—lead to more accurate and grounded answers.

My work combines controlled retrieval and generation experiments with paired evaluation, observability, failure analysis, versioned manifests, and inspectable artifacts.


Selected Work

Project Focus Current scope
rag-observatory · Live Space · Toy Dataset Trace-based analysis for RAG systems Research prototype for inspecting retrieved evidence, generated answers, execution traces, and failure labels
msmarco-genqa · Benchmark Runs Retrieval-augmented generation on MS MARCO Retrieval, reranking, generation, grounding analysis, paired statistical evaluation, and reproducible experiment reports
q-learning-exploitability · Evidence Map Exact agent evaluation and controlled failure analysis Adversarial backups and D4 evidence pooling reduced force-loss policies from 6/6 to 0/6 under matched Q-update budgets
Public research artifacts Reusable evidence for evaluation work Hugging Face datasets / Spaces, versioned reports, release archives, manifests, and trace examples connected back to the source repositories

Selected Open-Source Contributions

Only merged, publicly verifiable contributions are listed here.

Ecosystem Contribution Evidence
MTEB Fixed duplicate counting for symmetric STS pairs. embeddings-benchmark/mteb#4958
Pyserini Fixed M-BEIR instruction lookup from cache-home paths. castorini/pyserini#2655
MTEB Updated GermanGovService retrieval to the v2 dataset. embeddings-benchmark/mteb#5323
MTEB Leaderboard Added model language-scope display on leaderboard cards. embeddings-benchmark/leaderboard-frontend#31

Current Research

Research question: When does better retrieval improve grounded generation, and when do conventional evaluation metrics hide the failure?

Current study: Cross-dataset retrieval and reranking evaluation on MS MARCO, TREC-DL, SciFact, and NFCorpus, including retrieval-depth sensitivity, candidate coverage, and query-level failure analysis.

Secondary direction: Exact evaluation of reinforcement-learning agents under worst-case opponents.

Pinned Loading

  1. msmarco-genqa msmarco-genqa Public

    RAG-based question answering system on MS MARCO with retrieval, reranking, evaluation, and reproducibility checks.

    Python 32

  2. rag-observatory rag-observatory Public

    Research prototype for trace-based observability and failure analysis in retrieval-augmented generation.

    Python 17

  3. CiboCompass CiboCompass Public

    Mobile food exploration app with offline-resilient rating delivery, React Native, Go APIs, and SQLite.

    JavaScript 27

  4. handwritten-ocr-system handwritten-ocr-system Public

    Handwritten text recognition system using CNN-RNN-CTC models with CER/WER evaluation and reproducible training checks.

    Python 28

  5. q-learning-exploitability q-learning-exploitability Public

    Diagnosing and reducing exploitability in self-play tabular Q-learning using exact best responses, adversarial Bellman backups, and symmetry-aware state representations.

    Python 15

  6. ai-and-computer-games ai-and-computer-games Public

    Course notes, practicals, and PettingZoo Atari Boxing and Combat Tank reinforcement-learning agents.

    Jupyter Notebook