The licensor can't claim that you agreed to the terms of the GPL, he can merely claim you committed copyright infringement by creating a derivative work of, and creating copies of, a copyrighted work, without permission.