Akshit Kumar's index.html


Hi, I'm a 5th-year Computational Linguistics and Computer Science dual degree student at IIIT Hyderabad. I work on linguistic interpretation of language models at the Language Technologies Research Centre.

Selected Projects

Investigated how multilingual transformers (XLM-RoBERTa, mBERT, IndicBERT) internally encode grammatical information from the Paninian framework across seven Indian languages. Used diagnostic probing to analyze layer-wise encoding patterns, finding syntactic dependencies peak in middle-upper layers (6-9) while lexical features emerge earlier. Paper accepted to SyntaxFest 2025.

Investigated frequency-domain adversarial attacks on Llama Guard 3's multimodal safety filters. Combined vision adversarial attacks with language model security testing.

Explored multi-hop QA using teacher-student distillation for reasoning chain transfer. Built a graph traversal RAG pipeline that achieved 15% accuracy boost by teaching smaller models logical paths.

Functional Tensor DSL Monsoon 2024

Experimented with Racket-based tensor DSL, reimagining ML ops through Lisp's compositional philosophy. Built computation graph auto-differentiation from scratch using functional paradigms.

Nanopass compiler in Racket with graph-coloring register allocation. Implemented tuple support and garbage collection using interference graphs for optimal register usage.

Built a black-box detection framework for machine-generated text. Experimented with LoRA adapter fine-tuning for detection tasks, achieving 92% F1 without full retraining.

Network File System Monsoon 2023

Network file system built from scratch in C for parallel clients. Implemented LRU caching and concurrent operations for efficient distributed storage.

ak.sh - A Simple Shell Monsoon 2023

Shell written from scratch in C with piping, I/O redirection, and networking support for fetching man pages.

Enhanced xv6 OS by replacing round-robin scheduler with a multi-level feedback queue and implementing copy-on-write with performance evaluation.

Greddiit Spring 2022

A minimal forum built using React Query. Backend powered by TypeScript, Mongoose, and MongoDB.

Mealsource Spring 2022

A mobile app to crowdsource campus meal deliveries. Winner of the hackathon organized by the Open Source Developers Group at IIIT Hyderabad (HackIIIT).