Linux+AI+Python+Gui 4in1 Environments Running on the Android . [中文版] [English]
AidLearning is a completely Linux system running on the Android with GUI, Deep-Learning and Python Visual Programming support . The AidLearning framework which have the Linux+Android+AI+Python 4in1 environments Developed and Maintained by several students from Cas University and Yale University.
- Introduce
- Dependencies
- Installation
- Support Powerfully
- Touch and Drag Style Programming
- SSH (pc connected)
- Aid_code IDE of python
- Examples inside
- References
AidLearning App builds a graphical interface Linux system (without need root) on Android phones and coexists with your Android system. The App has a built-in system of leading deep learning frameworks, including Caffe, Tensorflow, Mxnet, pytorch, keras, ncnn and opencv. You no longer need complex configuration, wall-turning downloads and Install dependency packages.
AidLearning is also a pocket AI programming tool. The built-in AICode visual IDE allows you to easily program on your mobile phone with Python (supporting Python 2 and Python 3), support touch-and-drag interface design, support real-time debugging and graphical running of codes. AidLearning has a large number of AI source code examples, which include face recognition, pose recognition and classification. You can develop the AI App on mobile phones on a zero-based basis.
In addition, AidLearning provides wifi-based mapping projection technology, which can project mobile phone code to PC for Web interactive programming and SSH remote command interaction. Easy viewing on televisions and the ability to projector for large screen display, ensures the ability to present in group settings.
Last,the new version 0.84 now support convert the py to App(android apk),with the buildin ApkBuild tools,you can published the python project to only one apk,it's very fun and business.support VSCode and Jupyter programming tools,so you can coding by any languages(python，java，c++，js，go...)
In short, AidLearning has created a touch-and-drag programming platform for rapid development and learning that combines Android + Linux + AI 3IN1 environments. It utilizes mobile phones for fragmented programming and fully optimizes use of the development advantages of the two major operating systems (Android + Linux) and the perfect terminal advantages of mobile phones. AidLearning offers a distinct advantage to its users through an effective new platform for programming learning and development.
All you need is an Android devices (phone ,tablet or arm board) that supports the CPU of Arm64(aarch64). The Android version requires more than 6.0. If you think the parameters are not clear enough, I would like to say that most of the mainstream mobile phones support it, such as Samsung, Huawei, MI, OPPO, VIVO, nubia etc. In addition, the requirement of storage space is a little big. It is suggested that there should be 6G free storage space.
To install AidLearing, Simply download an App (apk file) and install it on your mobile device. download newest version at :
Download v0.85 now!
Other version at:https://github.com/aidlearning/AidLearning-FrameWork/releases
The APP （apk） is only 10M，when you install the apk and launch,the apk will auto download the dependence of the linux and examples of codes . all is about 1G size to download .So it's recommended that you install it in a wifi environment.
Important reminder: Click the setting icon after entering the desktop, the dialog box for the camera permission will pop up, please click agree, if you want to use the built-in examples.
Download v0.85 for chinese version now!
Support AI Framework:
- [Caffe]https://github.com/BVLC/caffe
- [Tensorflow]https://github.com/tensorflow/tensorflow
- [Mxnet]https://github.com/apache/incubator-mxnet
- [Keras]https://github.com/keras-team/keras
- [ncnn]https://github.com/Tencent/ncnn
- [pytorch]https://github.com/pytorch/pytorch
- [opencv]https://github.com/opencv/opencv
Support Python2.7 and Python3.7.3:
| AidLearning | Python2.7 | Python3.7.3 |
|---|---|---|
| caffe | ✓1.0.0 | ✓ 1.0.0 |
| mxnet | ✓1.0.0 | ✓1.6.0 |
| tensorflow | ✓1.10.0 | ✓2.1.0 |
| Gluoncv | ✗ | ✓ 0.40 |
| Keras | ✓2.2.4 | ✓2.2.4 |
| Pytorch | ✗ | ✓1.4.0 |
| torchvision | ✗ | ✓0.5.0 |
| Opencv(cv2) | ✓2.4.9 | ✓3.4.6 |
| Scipy | ✓0.18.1 | ✓1.3.0 |
| Numpy | ✓1.14.5 | ✓1.16.3 |
Now you can easily customize your GUI with touch and drag using wizard！Wizard will produce the code automatic like this:
class MyApp(App):
def __init__(self, *args):
super(MyApp, self).__init__(*args)
def main(self):
container = gui.VBox(width=120, height=100)
self.lbl = gui.Label('Hello world!')
self.bt = gui.Button('Press me!')
# setting the listener for the onclick event of the button
self.bt.onclick.do(self.on_button_pressed)
# appending a widget to another, the first argument is a string key
container.append(self.lbl)
container.append(self.bt)
# returning the root widget
return container
#listener function
def on_button_pressed(self, widget):
self.lbl.set_text('Button pressed!')
self.bt.set_text('Hi!')
更多请阅读Wizard-触摸拖拽式设计你的界面
-
PC can connect to mobile by using ssh-keygen. Generate a new key pair with ssh-keygen command in your PC. the command ssh-keygen produce the file of id_rsa and id_rsa.pub in the dir: ~/.ssh/
-
Just need you do: open the url:mobilephone'sip:8910/upload(for example:http://192.168.1.6:8910/upload) on the pc to upload ssh's file(id_rsa and id_rsa.pub).
- upload finished , just restart the app on the android ,open the terminal the type this command like this to connect:
ssh u0_a311@192.168.1.6 -p8022
- We provide an AI coding develop tool named Aid_code. It can provide you a visual AI programming IDE by using Python from zero on our framework! Using the tool, you can run your python2 or python3 codes online. So ,you can coding with Aid_code IDE on your phone anywhere, anytime.
- Of course, you can use Aid_code on the web to edit your code online. For example, you can use web coding with Aid_code on PC. You just need to open the web address: IP of your mobile phone:8900/, when your PC and mobile phone are in the same LAN.
You can open it on a PC, for example:
http://192.168.1.8:8900/
assume your phone's IP is 192.168.1.8, you can check your phone's IP by commanding ifconfig (run ifconfig command under terminal)
- code IntelliSense: New code auto-prompting function, if you input the initial letters of variables, functions and keywords, the system will automatically complete , which can greatly improve efficiency.
深入了解Gui开发原理请阅读cvs-强大的图形界面开发包
You just need to open the web address: IP of your mobile phone:8080/, when your PC and mobile phone are in the same LAN.
You can open it on a PC, for example:
http://192.168.1.8:8080/
then hit the upload button to upload the pc file to your mobile,or hit the download button to download the files of mobile to the pc.
---Examples inside
- Facencnn(mobiefacenet ncnn) 15fps in mobile phone (99.83% in LFW)
- Face Landmark (106 keypoints ncnn) 15fps in mobile phone
- handpose (tensorflow ) 5fps in mobile phone
- body posenet for single person(converted from google ) 10fps in mobile phone
- body posenet for multi-person(converted from google ) 7fps in mobile phone
- Stylized picture(GAN ) 3fps in mobile phone
- Additional camera-based (camera) features: You can use this additional feature to capture camera video frames, making it easier to run python programs and view running results.
- Mobile storage access: Our platform will read the package downloaded from the mobile phone, and users can download and use more third-party package.
- VTE (libvte): Terminal emulator widget for GTK+, mainly used in gnome-terminal. Source, Open Issues, and All (including closed) issues.
- iTerm 2: OS X terminal application. Source, Issues and Documentation (which includes iTerm2 proprietary escape codes).
- Konsole: KDE terminal application. Source, in particular tests, Bugs and Wishes.
- hterm: JavaScript terminal implementation from Chromium. Source, including tests, and Google group.
- xterm: The grandfather of terminal emulators. Source.
- Connectbot: Android SSH client. Source
- Android Terminal Emulator: Android terminal app which Termux terminal handling is based on. Inactive. Source.
- Termux: Android terminal and Linux environment - app repository. Source.
- remi:Python REMote Interface library. Platform independent. In about 100 Kbytes, perfect for your diet.[Source] (https://github.com/dddomodossola/remi).
- [Caffe]https://github.com/BVLC/caffe
- [Tensorflow]https://github.com/tensorflow/tensorflow
- [Mxnet]https://github.com/apache/incubator-mxnet
- [Keras]https://github.com/keras-team/keras
- [ncnn]https://github.com/Tencent/ncnn
- [pytorch]https://github.com/pytorch/pytorch
- [opencv]https://github.com/opencv/opencv