|
|
| Line 1: |
Line 1: |
| | + | |
| | =NPS-OSINT= | | =NPS-OSINT= |
| | <strong>Open source intelligence to actionable intelligence platform.</strong><br> | | <strong>Open source intelligence to actionable intelligence platform.</strong><br> |
| Line 28: |
Line 29: |
| | | | |
| | NPS-OSINT It's not how many criminals you catch, its how much crime you prevent.<br> | | NPS-OSINT It's not how many criminals you catch, its how much crime you prevent.<br> |
| − | ==Basic Layout==
| |
| − | The NPS-OSINT web page is divided into three main sections:
| |
| − | * Top bar
| |
| − | * Side menu
| |
| − | * Main content
| |
| − | ===Top Bar===
| |
| − | User control, login/logout functions
| |
| − | [[File:NPSOSINT3.png|400px|thumb|center|NPS-OSINT Top Bar]]<br>
| |
| − | ===Side Menu===
| |
| − | List and selection of system functionality are made through the side menu.
| |
| − | [[File:NPSOSINT1.png|400px|thumb|center|NPS-OSINT Side menu]]<br>
| |
| − | ===Main Content===
| |
| − | Displays selected content to the user. To get help for a specific page one can follow the '''Wiki'' link to the relevant page help page.<br>
| |
| − | For table views one can search for specific content in the table records via the '''Search''' Box.<br>
| |
| − | For table views one can also download table contents in one of the following formats:
| |
| − | * '''Copy''' - Copy to clipboard
| |
| − | * '''CSV''' - CSV formated file
| |
| − | * '''Excel''' - In excel formated file
| |
| − | * '''PDF''' - In pdf file format
| |
| − | * '''Print''' - Print the table.
| |
| − | Clicking on a table heading will '''sort''' the table contents accordingly.
| |
| − | [[File:NPSOSINT2.png|400px|thumb|center|NPS-OSINT Main content]]<br>
| |
| − | ==Feeds==
| |
| − | A bot -- short for robot and also called an internet bot -- is a computer program that operates as an agent for a user or other program or to simulate human activity. Bots are normally used to automate certain tasks, meaning they can run without specific instructions from humans to capture and monitor platforms.
| |
| − | ===BOTS===
| |
| − | Setup and control the different account BOTS allocated to the account.
| |
| − | ==Classifier==
| |
| − | The workhorse of the system, here one can set up keywords and artificial intelligence scanners to monitor and notify posts captured by the different bots.<br>
| |
| − | The system creates '''events''' based on '''campaigns'''.<br>
| |
| − | * '''Campaign''' - A name for the grouping of events.
| |
| − | * '''Events''' - Every time a campaign is triggered (either keyword or AI trigger) an event is created.
| |
| − | ===AI Campaign===
| |
| − | [[File:NPSOSINT9.png|400px|thumb|center|NPS-OSINT AI Notifications/Rules control page]]<br>
| |
| − | Select or edit a new/existing artificial intelligence campaign classifier.<br>
| |
| − | * '''Campaign''' - Give the campaign a descriptive name, this name will be shown for each event the system creates based on this campaign.
| |
| − | * '''AI Classifier''' - Select what AI classifier will be used for this campaign.
| |
| − | * '''AI Threshold''' - Select the threshold level above this value an event will be created.
| |
| − | * '''Area Selector''' - Select if the campaign will run for all groups or only a selection based on Area groupings see [[#Area|Area]]
| |
| − | * '''Event notification''' - Send a notification on a Telegram group if a new event is created by the system.
| |
| − | * '''NPS-Analyst''' - See [https://wiki.nptracker.co.za/index.php?title=TheNeedle The Needle]
| |
| − | * '''Delete''' - Select this checkbox then click '''Update''' to delete the selected campaign.
| |
| − | To add a '''new campaign'''
| |
| − | * Enter values for '''Campaign, AL Classifier, AI Threshold, Area selector, Event notification''' then click '''Add new campaign'''.
| |
| − | '''NOTE''' to add a new Telegram group to select from, first, add the accounts Telegram BOT (Will be supplied for each NPS-OSINT account) to an existing Telegram group and then sent a text message to that group, the BOT will then add this group to the list.
| |
| − | ===AI Classifiers===
| |
| − | [[File:NPSOSINT10.png|400px|thumb|center|NPS-OSINT AI Learn]]<br>
| |
| − | The artificial intelligence classifiers can be learned for different types of post classifications.<br>
| |
| − | * To '''View/Edit''' the messages used to train the AI classifier select the '''View/Edit''' for the specific Classifier.
| |
| − | [[File:NPSOSINT11.png|400px|thumb|center|NPS-OSINT AI classifier learn]]<br>
| |
| − | * '''Download''' - Download the existing learned dataset (You can then add/delete messages zip it again into the same file and upload to learn the AI with your updated messages.
| |
| − | * '''Generate new file''' - Generate AI classifier dataset based on the keywords you select.
| |
| − | * '''Browse & Upload''' - Upload and relearn the existing AI classifier.
| |
| − | ===Area selector===
| |
| − | [[File:NPSOSINT12.png|400px|thumb|center|NPS-OSINT Area selector]]<br>
| |
| − | Select or edit a new/existing area/group selector for use in AI and keyword Campaigns.<br>
| |
| − | * '''Description''' - Give the area selector a descriptive name.
| |
| − | * '''Group(s)''' - Select or edit the groups compromising the area selector.
| |
| − | * '''Delete''' - Select this checkbox then click '''Update''' to delete the selected area.
| |
| − | To add a '''area selector'''
| |
| − | * Enter values for '''Description, Group(s)''' then click '''Add new area'''.
| |
| − |
| |
| − | ===Events===
| |
| − | See [https://wiki.nptracker.co.za/index.php?title=TheNeedle The Needle]
| |
| − | ===Keyword Campaign===
| |
| − | [[File:NPSOSINT14.png|400px|thumb|center|NPS-OSINT Keyword Notifications/Rules control page]]<br>
| |
| − | Select or edit a new/existing keyword campaign classifier.
| |
| − |
| |
| − | * '''Campaign''' - Give the campaign a descriptive name, this name will be shown for each event the system creates based on this campaign.
| |
| − | * '''Keyword(s)''' - Semicolon separated list of keywords, if any of the keywords are found in the monitored post then an event is created for the campaign.
| |
| − | * '''Area Selector''' - Select if the campaign will run for all groups or only a selection based on Area groupings see Area
| |
| − | * '''Event notification''' - Send a notification on a Telegram group if a new event is created by the system.
| |
| − | * '''NPS-Analyst''' - See [https://wiki.nptracker.co.za/index.php?title=TheNeedle The Needle]
| |
| − | * '''Delete''' - Select this checkbox then click Update to delete the selected campaign.
| |
| − | To add a '''new campaign'''
| |
| − | *Enter values for '''Campaign, Keyword(s), Area selector, Event notification''' then click '''Add new campaign'''.
| |
| − | '''NOTE''' to add a new Telegram group to select from, first, add the accounts Telegram BOT (Will be supplied for each NPS-OSINT account) to an existing Telegram group and then sent a text message to that group, the BOT will then add this group to the list.
| |
| − | To edit a keyword list click on '''Edit'''.
| |
| − | [[File:NPSOSINT13.png|400px|thumb|center|NPS-OSINT Edit keywords]]<br>
| |
| − |
| |
| − | ==Content management for platforms==
| |
| − | Content for each platform (News feeds, Telegram, Twitter etc) is grouped and displayed as:
| |
| − | * '''Groups''' - List of groups seen and monitored on the platform
| |
| − | * '''Users''' - List of users seen and monitored on the platform
| |
| − | * '''Group''' - Platform specific info related to the group/users.
| |
| − | * '''User''' - Platform specific info related to the user/groups.
| |
| − | * '''Messages''' - List messages/posts posted on the monitored platform.
| |
| − | ===Groups===
| |
| − | [[File:NPSOSINT3.png|400px|thumb|center|NPS-OSINT Groups table view]]<br>
| |
| − | Group data captured and logged on each platform from "groups" are stored in the '''Groups''' table.<br>
| |
| − | From the Groups table view one can select:
| |
| − | * Each group entry can be selected ('''Name''' Column) and more info on the group will be displayed (see [[#Group]])<br>
| |
| − | * One can also select the group viewer ('''Group chat viewer''' Column) to view the last messages received on the group (see [[#GroupViewer]])<br>
| |
| − | Last 500 groups* (see [[#Limit|increase limit]]) posted and captured on the platform.
| |
| − | ===Group===
| |
| − | [[File:NPSOSINT7.png|400px|thumb|center|NPS-OSINT Group info]]<br>
| |
| − | Information on the user is displayed in the tabs:
| |
| − | * '''Info''' - Platform identifiable info of the user (Metadata)
| |
| − | * '''Messages''' - Last 500 messages* (see [[#Limit|increase limit]]) posted and captured for the user on the platform (see [[#Messages]]
| |
| − | * '''Users''' - Last 500 users* (see [[#Limit|increase limit]]) the user-posted content to (see [[#Users]])
| |
| − | * '''Additional''' - TBG
| |
| − | ===Users===
| |
| − | [[File:NPSOSINT5.png|400px|thumb|center|NPS-OSINT Users table view]]<br>
| |
| − | User data captured and logged on each platform from "users" are stored in the '''Users''' table.<br>
| |
| − | From the Users table view one can select:
| |
| − | * Each user can be selected ('''Name''' Column) and more info on the user will be displayed (see [[#User]])<br>
| |
| − | * One can select the group the user posted to ('''Group''' Column) and more info on the group will be displayed (see [[#Group]])<br>
| |
| − | Last 500 users* (see [[#Limit|increase limit]]) posted and captured on the platform.
| |
| − | ===User===
| |
| − | [[File:NPSOSINT6.png|400px|thumb|center|NPS-OSINT User info]]<br>
| |
| − | Information on the user is displayed in the tabs:
| |
| − | * '''Info''' - Platform identifiable info of the user (Metadata)
| |
| − | * '''Messages''' - Last 500 messages* (see [[#Limit|increase limit]]) posted and captured for the user on the platform (see [[#Messages]]
| |
| − | * '''Groups''' - Last 500 groups* (see [[#Limit|increase limit]]) the user-posted content to (see [[#Groups]])
| |
| − | * '''Additional''' - TBG
| |
| − | ===Messages===
| |
| − | [[File:NPSOSINT8.png|400px|thumb|center|NPS-OSINT Messages]]<br>
| |
| − | Posts captured and logged on each platform from "users" are stored in the '''Messages''' table.<br>
| |
| − | ==Limit==
| |
| − | '''NOTE''': Only the last updated 500 groups/users are displayed if one needs to show more one can append '''&limit=1000''' to the URL, in this example the table will show 1000 records.
| |
