Dio / engineering

Show the evidence.

Dio decides when a question needs public portfolio evidence and calls retrieval as a tool. When generation is unavailable, those sources remain useful on their own.

How retrieval works

Retrieval is optional rather than a mandatory pre-generation step. The model calls the evidence tool for questions about Hans, while greetings and general conversation can be answered directly. When called, dense semantic search and BM25 keyword search retrieve candidates independently before reciprocal rank fusion selects up to six excerpts. The answer trace records whether retrieval ran, including fallback and cache reuse.

Evaluation

The repository includes a versioned evaluation runner and public test questions. Live retrieval and generation results require configured service credentials. No quality scores are claimed before those evaluations have run.

Your conversation

Chat history is stored in this browser tab’s session storage. Clear conversation removes it. Questions sent to live generation are processed by the configured provider; retrieval queries may be processed by Qdrant. Contact information is sent to Hans via LINE only when you click Send.

The deployment should enable Groq Zero Data Retention. Without it, limited reliability and abuse-monitoring logs may be retained by Groq. Only predefined public starter answers are eligible for shared answer caching.

Retrieval baseline

53/60 labeled sources found in the top six. Mode: bundled-bm25. This is a retrieval test, not an answer-quality score.

Run 2026-09-11 · Corpus b3eeb5eb817a5ed0

Retrieval only: one expected source per question. Does not measure generated-answer correctness, citation support, or production traffic. Queries are evaluated as written, without LLM translation. No shared cache is used.

Inspect questions and failures
Missed: What is Hans’s current role?

Expected: identity

Retrieved: blog-reflecting-college-journey.md, linkedin-what-is-genai, certificate-catalog, blog-building-dio-chatbot.md, project-catalog, egeroo-ai-engineer-intern

Missed: Where did Hans study?

Expected: binus-bcs

Retrieved: dynamic-model-merging-ocular, identity, blog-reflecting-college-journey.md, certificate-catalog, project-catalog

Found: What was the operating cost reduction?

Expected: impact

Retrieved: egeroo-ai-engineer-intern, impact, whisper-finetuning, blog-reflecting-college-journey.md, linkedin-what-is-genai, identity

Found: Explain the 100-request benchmark

Expected: impact

Retrieved: egeroo-ai-engineer, impact, mnist-scratch, resnet-cifar10, makemore, blog-reflecting-college-journey.md

Missed: What does Dio do?

Expected: dio

Retrieved: blog-building-dio-chatbot.md, linkedin-what-is-genai, micrograd, whisper-finetuning, loan-analysis, blog-reflecting-college-journey.md

Found: How does Monelytics evaluate forecasts?

Expected: monelytics

Retrieved: micrograd, whisper-finetuning, monelytics, impact, identity, egeroo-ai-engineer

Found: What was Makemore trained on?

Expected: makemore

Retrieved: makemore, blog-reflecting-college-journey.md, project-catalog, linkedin-what-is-genai, blog-building-dio-chatbot.md, whisper-finetuning

Found: Show the Python certificate

Expected: dicoding-python

Retrieved: dicoding-python, certificate-catalog, sasc-mentor-2024, idrxy, micrograd, mnist-scratch

Found: Show the SQL certificate

Expected: dicoding-sql

Retrieved: certificate-catalog, dicoding-sql, sasc-mentor-2024, dicoding-python, idrxy, blog-reflecting-college-journey.md

Found: Explain the ocular disease research

Expected: dynamic-model-merging-ocular

Retrieved: dynamic-model-merging-ocular, blog-reflecting-college-journey.md, whisper-finetuning, project-catalog, mnist-scratch, blog-building-dio-chatbot.md

Found: How was Micrograd implemented?

Expected: micrograd

Retrieved: micrograd, project-catalog, idrxy, resnet-cifar10, mnist-scratch, whisper-finetuning

Found: What is NeuroCraft?

Expected: neurocraft

Retrieved: linkedin-what-is-genai, neurocraft, blog-building-dio-chatbot.md, certificate-catalog, blog-reflecting-college-journey.md, project-catalog

Found: Explain MNIST from scratch

Expected: mnist-scratch

Retrieved: mnist-scratch, project-catalog, makemore, neurocraft, micrograd, blog-reflecting-college-journey.md

Found: What does Narrative Nest do?

Expected: narrative-nest

Retrieved: narrative-nest, blog-building-dio-chatbot.md, project-catalog, identity, linkedin-what-is-genai, micrograd

Found: Which languages were used for Whisper fine-tuning?

Expected: whisper-finetuning

Retrieved: whisper-finetuning, project-catalog, blog-reflecting-college-journey.md, identity, dynamic-model-merging-ocular, blog-building-dio-chatbot.md

Found: Apa pekerjaan Hans sekarang?

Expected: identity

Retrieved: identity, blog-reflecting-college-journey.md, certificate-catalog, project-catalog, dynamic-model-merging-ocular

Found: Jelaskan proyek Dio

Expected: dio

Retrieved: blog-building-dio-chatbot.md, blog-reflecting-college-journey.md, dio, identity, project-catalog

Found: Apa itu Monelytics?

Expected: monelytics

Retrieved: monelytics, identity, project-catalog

Found: Sertifikat Python Hans

Expected: dicoding-python

Retrieved: identity, certificate-catalog, blog-reflecting-college-journey.md, project-catalog, dicoding-python, micrograd

Found: Riset ocular disease Hans

Expected: dynamic-model-merging-ocular

Retrieved: dynamic-model-merging-ocular, identity, blog-reflecting-college-journey.md, certificate-catalog, project-catalog

Found: What is Hans’s full name?

Expected: identity

Retrieved: blog-building-dio-chatbot.md, blog-reflecting-college-journey.md, linkedin-what-is-genai, certificate-catalog, project-catalog, identity

Found: Where is Hans based?

Expected: identity

Retrieved: identity, certificate-catalog, blog-building-dio-chatbot.md, blog-reflecting-college-journey.md, egeroo-ai-engineer-intern, idrxy

Missed: What did Hans specialize in at BINUS?

Expected: binus-bcs

Retrieved: identity, certificate-catalog, blog-reflecting-college-journey.md, blog-building-dio-chatbot.md, sasc-mentor-2024, dynamic-model-merging-ocular

Missed: What was Hans’s GPA?

Expected: binus-bcs

Retrieved: blog-reflecting-college-journey.md, identity, sasc-scholarship-student-mentor, certificate-catalog, project-catalog, blog-building-dio-chatbot.md

Missed: Which honors did Hans graduate with?

Expected: binus-bcs

Retrieved: identity, blog-reflecting-college-journey.md, blog-building-dio-chatbot.md, dynamic-model-merging-ocular, project-catalog, whisper-finetuning

Found: When did the AI Engineer internship start?

Expected: identity

Retrieved: blog-building-dio-chatbot.md, impact, egeroo-ai-engineer-intern, egeroo-ai-engineer, identity, blog-reflecting-college-journey.md

Found: When did the full-time AI Engineer role start?

Expected: identity

Retrieved: blog-building-dio-chatbot.md, blog-reflecting-college-journey.md, egeroo-ai-engineer, identity, impact, egeroo-ai-engineer-intern

Found: What is the distinction between the latency measurements?

Expected: impact

Retrieved: impact, blog-reflecting-college-journey.md, linkedin-what-is-genai, blog-building-dio-chatbot.md, egeroo-ai-engineer, himti-techno-arcade-co-coordinator

Found: What did Hans do on Monelytics?

Expected: monelytics

Retrieved: identity, blog-building-dio-chatbot.md, project-catalog, blog-reflecting-college-journey.md, certificate-catalog, monelytics

Found: Which banks did Monelytics focus on?

Expected: monelytics

Retrieved: monelytics, project-catalog, blog-reflecting-college-journey.md, identity, whisper-finetuning, blog-building-dio-chatbot.md

Found: Which forecasting error metrics does Monelytics use?

Expected: monelytics

Retrieved: monelytics, whisper-finetuning, project-catalog, coursera-intro-genai, blog-building-dio-chatbot.md, micrograd

Found: How does Makemore use batch normalization?

Expected: makemore

Retrieved: makemore, project-catalog, neurocraft, coursera-intro-genai, micrograd, whisper-finetuning

Found: What is the Makemore character-level GPT?

Expected: makemore

Retrieved: makemore, project-catalog, blog-reflecting-college-journey.md, linkedin-what-is-genai, loan-analysis, blog-building-dio-chatbot.md

Found: How does Narrative Nest use Gradio?

Expected: narrative-nest

Retrieved: narrative-nest, project-catalog, coursera-intro-genai, micrograd, whisper-finetuning, identity

Found: Which model generates storyboard frames?

Expected: narrative-nest

Retrieved: narrative-nest, project-catalog, whisper-finetuning, loan-analysis, egeroo-ai-engineer, blog-reflecting-college-journey.md

Found: What datasets does NeuroCraft use?

Expected: neurocraft

Retrieved: neurocraft, project-catalog, coursera-intro-genai, world-cup-analysis, linkedin-what-is-genai, whisper-finetuning

Found: Explain the ResNet CIFAR-10 experiments

Expected: resnet-cifar10

Retrieved: resnet-cifar10, project-catalog, impact, mnist-scratch, makemore, certificate-catalog

Found: What was rebuilt in pure Python?

Expected: micrograd

Retrieved: micrograd, project-catalog, krakatoa, blog-reflecting-college-journey.md, neurocraft, linkedin-what-is-genai

Found: Which project uses NumPy for handwritten digits?

Expected: mnist-scratch

Retrieved: mnist-scratch, project-catalog, monelytics, dio, narrative-nest, blog-building-dio-chatbot.md

Found: Where are the Whisper models published?

Expected: whisper-finetuning

Retrieved: whisper-finetuning, project-catalog, makemore, monelytics, linkedin-what-is-genai, blog-reflecting-college-journey.md

Found: Who authored the ocular disease paper?

Expected: dynamic-model-merging-ocular

Retrieved: dynamic-model-merging-ocular, mnist-scratch, resnet-cifar10, project-catalog, makemore, identity

Found: What is class-incremental learning research about?

Expected: dynamic-model-merging-ocular

Retrieved: dynamic-model-merging-ocular, linkedin-what-is-genai, blog-building-dio-chatbot.md, blog-reflecting-college-journey.md, certificate-catalog, loan-analysis

Found: What public evidence does Dio retrieve?

Expected: dio

Retrieved: dio, blog-building-dio-chatbot.md, krakatoa, linkedin-what-is-genai, micrograd, whisper-finetuning

Found: Does Dio have a fallback?

Expected: dio

Retrieved: dio, identity, blog-reflecting-college-journey.md, blog-building-dio-chatbot.md, micrograd, whisper-finetuning

Found: Show the Dicoding data science certificate

Expected: dicoding-data-science

Retrieved: certificate-catalog, dicoding-data-science, dicoding-python, shift-sepak-bola, dicoding-sql, sasc-mentor-2024

Found: Berapa GPA Hans di BINUS?

Expected: binus-bcs

Retrieved: identity, sasc-scholarship-student-mentor, certificate-catalog, sasc-mentor-2024, binus-bcs, blog-reflecting-college-journey.md

Missed: Apa gelar Hans dari BINUS?

Expected: binus-bcs

Retrieved: identity, certificate-catalog, sasc-mentor-2024, blog-reflecting-college-journey.md, himti-techno-arcade-co-coordinator, sasc-scholarship-student-mentor

Found: Jelaskan benchmark 100 request

Expected: impact

Retrieved: egeroo-ai-engineer, impact, resnet-cifar10, mnist-scratch, makemore

Found: Berapa pengurangan operating cost?

Expected: impact

Retrieved: egeroo-ai-engineer-intern, impact, identity

Found: Apa kontribusi Hans pada Monelytics?

Expected: monelytics

Retrieved: identity, project-catalog, monelytics, blog-reflecting-college-journey.md, certificate-catalog, dynamic-model-merging-ocular

Found: Bagaimana evaluasi RMSE dan MAE Monelytics?

Expected: monelytics

Retrieved: monelytics, project-catalog, identity

Found: Apa dataset Makemore?

Expected: makemore

Retrieved: makemore, dynamic-model-merging-ocular, mnist-scratch, project-catalog, blog-reflecting-college-journey.md

Found: Bagaimana Makemore menggunakan GPT?

Expected: makemore

Retrieved: makemore, project-catalog, identity, blog-reflecting-college-journey.md

Found: Jelaskan Narrative Nest dan SDXL

Expected: narrative-nest

Retrieved: narrative-nest, project-catalog, identity

Found: Apa fungsi NeuroCraft?

Expected: neurocraft

Retrieved: neurocraft, project-catalog

Found: Jelaskan proyek ResNet CIFAR-10

Expected: resnet-cifar10

Retrieved: resnet-cifar10, project-catalog, certificate-catalog, mnist-scratch, makemore, looksharp

Found: Apa itu Micrograd?

Expected: micrograd

Retrieved: micrograd, project-catalog

Found: Bagaimana MNIST memakai NumPy?

Expected: mnist-scratch

Retrieved: mnist-scratch, project-catalog, neurocraft, monelytics

Found: Apa eksperimen Whisper French German?

Expected: whisper-finetuning

Retrieved: whisper-finetuning, project-catalog

Found: Tampilkan sertifikat SQL

Expected: dicoding-sql

Retrieved: dicoding-sql, certificate-catalog

Explore Dio’s project story ↗
🤗