CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing

Understand

Currently, a growing number of mature natural language processing applications make people's life more convenient.

• Such applications are built by source code - the language in software engineering.
• However, the applications for understanding source code language to ease the software engineering process are under-researched.
• Simultaneously, the transformer model, especially its combination with transfer learning, has been proven to be a powerful technique for natural language processing tasks.