Prevalence of Mycobacterium abscessus infections is increasing in patients with respiratory comorbidities. After initial colonisation, M. abscessus smooth colony (S) variants can undergo an irreversible genetic switch into highly inflammatory, rough colony (R) variants, often associated with a decline in pulmonary function. Here, we use an adult zebrafish model of chronic infection with R and S variants to study M. abscessus pathogenesis in the context of fully functioning host immunity. We show that infection with an R variant causes an inflammatory immune response that drives necrotic granuloma formation through host TNF signalling, mediated by the tnfa, tnfr1 and tnfr2 gene products. T cell-dependent immunity is stronger against the R variant early in infection, and regulatory T cells associate with R variant granulomas and limit bacterial growth. In comparison, an S variant proliferates to high burdens but appears to be controlled by TNF-dependent innate immunity early during infection, resulting in delayed granuloma formation. Thus, our work demonstrates the applicability of adult zebrafish to model persistent M. abscessus infection, and illustrates differences in the immunopathogenesis induced by R and S variants during granulomatous infection.