Proceedings of ISP RAS

When stack protection does not protect the stack?

P. Dovgalyuk (NovSU, Velikiy Novgorod, Russia)
V. Makarov (NovSU, Velikiy Novgorod, Russia)


The majority of software vulnerabilities originate from buffer overflow. Techniques to eliminate buffer overflows and limit their damage include secure programming, source code audit, binary code audit, static and dynamic code generation features. Modern compilers implement compile-time and execution time protection schemes, that include variables reordering, inserting canary value, and separate stack for return addresses. Our research is targeted to finding the breaches in the compiler protection methods. We tested MSVC, gcc, and clang and found that two of these compilers have flaws that allow exploiting buffer overwrite under certain conditions.


buffer overflow, canary protection, gcc, msvc, clang


Proceedings of the Institute for System Programming, vol. 28, issue 5, 2016, pp. 55-72.

ISSN 2220-6426 (Online), ISSN 2079-8156 (Print).

DOI: 10.15514/ISPRAS-2016-28(5)-3

Full text of the paper in pdf Back to the contents of the volume