fix(iorw.py): update HDFSHandler to adapt PyArrow.fs.HadoopFileSystem API

[reoono]

What does this PR do?

Fixes #657

I fix HDFSHandler to match PyArrow.fs.HadoopFileSystem API.

As stated the reasons in #657, I removed import PyArrow.HadoopFileSystm and updated requirements/hdfs.txt.

[MSeal]

Thanks for the fix. I'm ok with dropping support for older pyarrow versions (I'll add that fact to the changelog for the next release). Sorry I was out sick for a bit and wasn't tracking the project actively for a little bit

[reoono]

My apologies for the delay in replying as well.
Thank you very much for your response despite the difficult situation.

This PR has caused flake8 to fail and I would like to fix it.
(If possible, I would also like to fix Python 3.8~3.10 failing.)