We evaluated FicFinder with 27 popular, actively-maintained Andorid apps. We used the latest version of the apps by the time we conducted our experiment. FicFinder successfully reported 51 warnings and 46 of them are true positives. We further submitted 14 bug reports to the app developers. Eight of the reports were acknowledged by the app developers and five critical ones were quickly fixed. This confirms the effectiveness and usefulness of FicFinder. Below we show the information of the 27 subject apps and detected isssues.
| App Name | Category | Rating | Downloads | True Positives | False Positives | Issue ID |
|---|---|---|---|---|---|---|
| IrssiNotifier | Communication | 4.8/5.0 | 5K - 10K | 0 | 0 | - |
| 1Sheeld | Tools | 4.7/5.0 | 10K - 50K | 2 | 0 | 4 |
| ConnectBot | Tools | 4.6/5.0 | 1M - 5M | 0 | 2 | - |
| AnkiDroid | Education | 4.5/5.0 | 1M - 5M | 0 | 0 | - |
| AntennaPod | Media & Video | 4.5/5.0 | 100K - 500K | 2 | 0 | 1883 |
| Conversations | Communication | 4.5/5.0 | 5K - 10K | 3 | 1 | 1813, 1818 |
| VLC | Media & Video | 4.4/5.0 | 10M - 50M | 0 | 0 | - |
| c:geo | Entertainment | 4.4/5.0 | 1M - 5M | 1 | 0 | 5695 |
| Kore | Media & Video | 4.4/5.0 | 1M - 5M | 0 | 0 | - |
| AnySoftKeyboard | Tools | 4.4/5.0 | 1M - 5M | 2 | 1 | 639 |
| Transdroid | Tools | 4.4/5.0 | 100K - 500K | 5 | 1 | 295 |
| K-9 Mail | Communication | 4.3/5.0 | 5M - 10M | 1 | 0 | 1237 |
| CSipSimple | Communication | 4.3/5.0 | 1M - 5M | 0 | 0 | - |
| Telegram | Communication | 4.2/5.0 | 50M - 100M | 1 | 0 | - |
| WordPress | Social | 4.2/5.0 | 5M - 10M | 0 | 0 | - |
| Open VPN for Android | Communication | 4.2/5.0 | 1M - 5M | 0 | 0 | - |
| Brave Android Browser | Personalization | 4.2/5.0 | 500K - 1M | 5 | 0 | 754, 759 |
| PactrackDroid | Communication | 4.2/5.0 | 10K - 50K | 2 | 0 | 12 |
| QKSMS | Communication | 4.1/5.0 | 100K - 500K | 1 | 0 | 474 |
| Open GPS Tracker | Travel & Local | 4.1/5.0 | 100K - 500K | 3 | 0 | 446 |
| BankDroid | Finance | 4.1/5.0 | 100K - 500K | 0 | 0 | - |
| Evercam | Tools | 4.1/5.0 | 10K - 50K | 0 | 0 | - |
| Bitcoin Wallet | Finance | 4.0/5.0 | 1M - 5M | 0 | 0 | - |
| ChatSecure | Communication | 4.0/5.0 | 500K - 1M | 0 | 0 | - |
| iNatruralist | Education | 4.0/5.0 | 500K - 1M | 0 | 0 | - |
| ownCloud | Education | 3.7/5.0 | 100K - 500K | 0 | 0 | - |
| PocketHub | - | - | - | 18 | 0 | 997 |
| Total | - | - | - | 46 | 5 | - |
For more discussions about the detected issues, please refer to our research paper.