Object Detection in Counter-Strike 2

Jan 22, 2024 · 1 min read
Object detection results on Counter-Strike 2 frames
projects

Team

  • YiFan Cai (leader)
  • XiHe Yu
  • Yu Shi

Overview

This project investigates the application of real-time object detection in Counter-Strike 2 (CS2). We build a custom in-game dataset and systematically compare multiple detection frameworks to evaluate their accuracy, speed, and practicality in dynamic gaming scenarios. Beyond benchmarking, we demonstrate how detection results can be integrated into gameplay-related applications such as distance estimation and automated aiming.

Methods

We implement and compare YOLOv7, Faster R-CNN, and SSD. Key components include:

-Construction of a custom VOC-style CS2 dataset from gameplay footage

-Model training and evaluation under identical settings

-Preprocessing and data augmentation for difficult scenes

-Ensemble-style bounding box fusion using confidence weighting and clustering

Key Features

-Custom-built CS2 object detection dataset

-Comparative study of one-stage vs. two-stage detectors

-Model ensemble via weighted bounding box averaging

-Real-time in-game deployment with screen capture

-Applications including auto-aiming and target distance estimation


YiFan Cai
Authors
YiFan Cai (he/him)
Graduate student
I am a graduate student in Systems Engineering at the University of Pennsylvania, with a B.S. in Computer Science from ShanghaiTech University. I have research experience in diffusion models, computer vision, robotic manipulation, and molecular drug design. My current interests focus on world models, computer vision, and artificial intelligence.