There may be immigration consequences for failing to file taxes. Also, if you owe taxes and do not file, you may be assessed penalties and interest.
International Payee Tax Compliance
Tax Withholding and Reporting for Foreign Individuals and Entities