Undergraduate researcher interested in vision–language models,
multimodal reasoning, and real-world AI systems.
I enjoy translating complex problems into structured, deployable AI solutions.
- Vision–Language Models (multimodal reasoning, affect-aware interaction)
- Visual Representation Learning in real-world and industrial settings
- Reasoning-oriented AI systems integrating vision, language, and decision-making
🏆 Hackathon Grand Prize hosted by SK Intellix
- Designed a multimodal VLM system integrating speech, facial expression, and text for emotion-aware interaction with elderly users
- Built a fusion pipeline using Whisper, wav2vec, and ResNet-18 to address cross-modal inconsistency in emotional signals
- Iteratively refined prompting strategies to guide the LLM toward emotionally appropriate responses under ambiguous inputs
- Developed RGB-based and X-ray-based defect detection models for industrial pipe welding inspection
- Trained ConvNeXt V2 on balanced RGB datasets and YOLOv8 on highly imbalanced X-ray datasets to learn robust visual representations
- Integrated defect detection as an upstream module for data-driven rework decision-making and scheduling automation
- https://github.com/Automated-Pipe-Welding-Rework-System
🏆 Korea University Capstone Design Competition – Honorable Mention
- Designed an LLM-based reasoning agent that evaluates company-authored OKRs using structured scoring (1–5), justification, and corrective suggestions
- Applied chain-of-thought prompting and self-consistency to improve reliability of reasoning outputs
- Integrated retrieval-augmented generation (RAG) with company-specific data and explored parameter-efficient fine-tuning (LoRA, quantization) on LLaMA-based models
- https://github.com/hayeon7898/OKR-AI-Agent
- Conducted mentored research under guidance from IonQ on adaptive hybrid quantum–classical machine learning with optimized quantum data embedding on IonQ trapped-ion hardware
- Designed hybrid optimization pipelines under limited measurement (probing) budgets, focusing on quantum state estimation and state transformation
- Validated quantum circuits through iterative execution on simulators and real quantum hardware, emphasizing gate-level optimization
- https://github.com/IQ-rhythm/IonQ-Encode
- Challenger Level Award, 2025 Quantum Challenge 🏆
hosted by Quantum Information Research Support Center - 1st Place, IonQ Remote Track, 2024 iQuHack 🏆
hosted by MIT(Massachusetts Institute of Technology)
- Implemented the core organization tab using React Native
- Designed PostgreSQL schemas and optimized queries with Supabase, including index-level performance tuning
- https://github.com/Veloci-Lab/dearday
- Built backend foundations and service skeletons, including initial JDA setup
- Implemented approximately half of the core APIs supporting appointment workflows
- https://github.com/DevKor-github/WorkingDead-BE
- Full-stack developer in a two-person team building a QR-based umbrella rental and return service
- Implemented rental logic, reward systems, and real-time state management using React Native, Nest.js (TypeScript), and MySQL
- https://github.com/hayeon7898/bbosong-front, https://github.com/hayeon7898/bbosong-back
AI / Machine Learning
Vision & Multimodal
Speech
Frontend / Backend
Database
Tools
- Email: hayeon22@korea.ac.kr