Switch to aarch64 runner image instead of using QEMU

[pentamassiv]

Currently building for aarch64 is extremely slow. The reason is that it cross-compiles using QEMU. Once a native aarch64 runner becomes available, it should be used instead. This will simplify the Github Actions as well.
The progress of it is tracked in actions/runner-images#5631

[afifurrohman-id]

@pentamassiv Now MacOS M1 is GA: https://github.blog/changelog/2024-01-30-github-actions-introducing-the-new-m1-macos-runner-available-to-open-source

I can open PR for it if you consider using Mac instead of linux.

[pentamassiv]

Sure, if you can write an Action that can build it on macOS and see if it builds on aarch64, I would appreciate it. So far I am not aware of any issues on aarch64 since there is no architecture specific code so maybe it is not needed though