This paper explores the ramifications of real-time autonomous vehicle performance in cluttered environments. It analyzes the gap between the predictable and the unpredictable, introduces real object tracing, explores the benefits and pitfalls of real-time moving object tracking and introduces possible solutions for uninterrupted operation of autonomous vehicles.