I think showing app inside build check only works with GitHub Marketplace apps.
The current behavior is to comment on the pull requests. Having statuses check instead would be a far better developer experience because:
- It can prevent merging if there's a build problem
- Commenting create notifications, on big project this can cause a lot of flood