Paper is HERE!
Our official website

Introducing SuiAudit Pure1: Revolutionizing Sui Smart Contract Security with AI

I’m excited to share a major milestone for our team at SuiAudit Lab: the publication of our research paper, “Can Small Models Beat Frontier LLMs? Introducing SuiAudit Pure1: Specialized Auditing via Extreme Low-Resource Fine-Tuning,” now live on TechRxiv (DOI: 10.36227/techrxiv.177204934.48017152/v1). As a key contributor alongside Chia-Lin Chen and Fang-Yu Lien, this work represents our passion for bridging AI and blockchain security, specifically tailored for the Sui ecosystem.

The Core Innovation

SuiAudit Pure1 is a 7B-parameter AI model designed from the ground up to audit Sui Move smart contracts with unprecedented accuracy and efficiency. Unlike general-purpose large language models (LLMs) plagued by “Solidity Bias”—where they mistakenly apply Ethereum vulnerabilities to Sui’s unique object-centric architecture—Pure1 excels through a streamlined fine-tuning pipeline: Supervised Fine-Tuning (SFT) for domain mastery, followed by Direct Preference Optimization (DPO) enhanced with Chain-of-Thought reasoning.

Our secret sauce? A meticulously crafted dataset blending positive vulnerability samples (categorized A-F) with adversarial “Hard Negative” examples—safe code patterns engineered to trip up broader LLMs. This allows Pure1 to run fully offline, preserving developer privacy while delivering real-time insights via VS Code and Chrome extensions.

Standout Results and Impact

The results speak for themselves: On our rigorous Sui-specific benchmark, Pure1 achieved a 31.4% accuracy rate, outperforming industry giants like Claude Opus 4.5 (26.6%) and GPT-5.2 (17.2%). We’ve already deployed it in production, securing over $50M in assets, detecting 500+ vulnerabilities, and earning accolades like 2nd Place at the 2025 Sui Hackathon Mandarin and 3rd at the Sui Taipei Dev Hackathon.

This isn’t just a model—it’s a game-changer for Sui developers, enabling faster, safer deployments in Asia’s booming Web3 scene. By open-sourcing our core infrastructure on GitHub and sharing weights on Kaggle, we’re fostering a more secure blockchain future.

Reflections on the Journey

Publishing this paper feels like a validation of our low-resource approach: proving that specialized small models can punch above their weight against frontier LLMs. It’s a reminder that innovation thrives at the intersection of AI and blockchain. Stay tuned as we continue scaling SuiAudit—your feedback and collaborations are welcome!

If you’re building on Sui or interested in AI-driven security, check out the full paper and try our live tool at suiaudit.wal.app. Let’s make Web3 safer together.