Amyloid aggregation, which disrupts protein homeostasis, is a common pathological event occurring in human neurodegenerative diseases (NDs). Numerous evidences have shown that the structural diversity, so-called polymorphism, is decisive to the amyloid pathology and is closely associated with the onset, progression, and phenotype of ND. But how could one protein form so many stable structures? Recently, atomic structural evidence has been rapidly mounting to depict the involvement of chemical modifications in the amyloid fibril formation. In this Perspective, we aim to present a hierarchical regulation of chemical modifications including covalent post-translational modifications (PTMs) and noncovalent cofactor binding in governing the polymorphic amyloid formation, based mainly on the latest α-synuclein and Tau fibril structures. We hope to emphasize the determinant role of chemical modifications in amyloid assembly and pathology and to evoke chemical biological approaches to lead the fundamental and therapeutic research on protein amyloid state and the associated NDs.