I found out the culprits are the ubiquitous powderpost beetles on untreated bamboo wood.
The beetles appear to be boring through the dead leaf bases of the plant.

I did decapitate the plant leaving me with a head with its leaf bases still relatively fresh and intact and free of infestation.
And I submerged the whole thing with mixture of pesticide and water to give me a little less doubt.