Skip to content

OSINT Platform - Provides image analysis, digital footprints, video transcription and more. Retrieval Augmented Generation (RAG) capable platform

Notifications You must be signed in to change notification settings

walimorris/opensquare

Repository files navigation

MIT License LinkedIn


Logo

Opensquare

Opensource social media intelligence and OSINT
Explore the docs »

View Demo · Report Bug · Request Feature

Table of Contents
  1. About The Project
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Contributing
  6. Contact
  7. Acknowledgments

About The Project

There were 150 million new social media users between April 2022 and April 2023 - that's a 3.2% increase year-over-year from the current 4.8 billion social media users worldwide, representing 59.9% of the global population and 92.7% of all internet users. Businesses use social media to gain insights about various topics: user sentiment around products, strong products and weak products, events, all things that cater to their customer. For intelligence analysts and social science researchers, who are their customers? Policymakers, the everyday citizen, everyone in society. This project's user, its customer, is the intelligence and social sciences analysts and researchers. As technology continues up the curve of innovation, and society continues to increasingly use social media as the public square, researchers can use this available data for good, to draw insights, to slow down or stop harmful incidents, to help society, to develop plans based on public consensus, better inform policymakers of what their constituents need and want (and better plan solutions that increase the satisfaction of their customer). As it becomes harder for governments to understand and execute solutions that better serve their constituents, the idea of adaptive governance, a focus on decentralized decision-making structures, becomes unavoidable. Not only can insights gained from social media assist policymakers, it can assist adaptive governance entities and groups to better serve their populations. This product is for the intelligence analyst, the social scientist, the data scientist and those interested in improving the quality of our human existence through deep public analysis and data-driven solutions.

(back to top)

Built With

  • Springboot
  • MongoDB
  • React
  • AWS

(back to top)

Features

Watch Retrieval Augmented Generation (RAG) Demo

Watch the video

Along with other features, OpenSquare provides Digit Footprint targeting tools, some using well-known OSINT methods such as Backlinks, NSLookup, and Whois. Having a general suite of tools in a single place can increase user productivity. Easily navigate between dashboard workspaces and use output from one tool as input for another.

Experiment Generating Reports with GenAI

Experiment with generating reports and documents with GenAI. Use the information and images you've collected to generate reports that result in decision advantage. Ask our AI system to generate images for you based on the information context and summarize key details. Increase productivity and drastically reduce the speed to delivering key insights to decision makers using click-and-point and draggable interfaces.

Video Transcription with OpenAI's Whisper

Opensquare utilizes Whisper: a general-purpose speech recognition model. It is trained on a large dataset of diverse audio and is also a multitasking model that can perform multilingual speech recognition, speech translation, and language identification.

Using Opensquare's available API's, you can query and transcribe YouTube videos. Transcripts will report time and text properties. This API is used to build features on Opensquare , but will also be available to the public as an easy to use API.

opensquare/api/youtube/en/transcribe?videoId=l9AzO1FMgM8

produces:

[ { "time": "0.0", "text": "Java, a high-level multi-paradigm programming language famous for its ability to compile" }, { "time": "5.2", "text": "to platform independent bytecode." }, { "time": "7.44", "text": "It was designed by James Gosling in 1990 at Sun Microsystems." }, { "time": "11.700000000000001", "text": "One of its first demonstrations was the Star 7 PDA, which gave birth to the Java mascot" },... ]

Getting Started

To get a local copy up and running follow these simple example steps.

Prerequisites

  • Linux

  • Java 17

    java --version
  • Maven 3.9 or above

    mvn --version

Installation

  1. Clone the repo

    git git clone https://[email protected]/intelligence-opensent/opensentop.git
  2. Install dependencies (including NPM) default profile

    mvn clean install
  3. Run webpack in development mode

    npm run watch
    
  4. There are some configuration files you'll need - feel free to ping me for those.

(back to top)

Usage

This project uses Eirik Sletteberg's Frontend-Maven-Plugin which allows our team to use a single plugin for both frontend and backend builds in a single repo. This plugin is capable of various configurations, but the configuration used in this project is minimum only using Webpack and few configurations to install Node and NPM. The meat of this usage is from the creation of the project's bundle which is integrated using a <script> in root of React application (typical React fashion) exposed in the index.html file in the Springboot resources folder.

<body>
<div id='root'>
</div>
<script src="built/bundle.js"></script>
</body>

Webpack will create a build bundle that contains the source for the React application entry in app.js under the js package of this project.

entry: path.resolve(__dirname, "/src/main/js/app.js"),
    devtool: 'inline-source-map',
    cache: true,
    mode: 'development',
    output: {
        path: __dirname,
        filename: 'src/main/resources/static/built/bundle.js'
    },

(back to top)

Kafka Usage - Local

If you're running kafka you should review the Docs. First ensure zoo-keeper server is running before running the kafka server. Sometimes zookeeper configs /config folder is not setup properly. If you need to, ensure clientPort=2181 is set in the zookeeper.properties and to ensure non-conflicting ports make sure admin.serverPort=8083 is set in the same file. We also want to ensure that bootstrap.servers=9092 is configured in producer.properties: this is a list of brokers used for bootstrapping knowledge about the rest of the cluster format which is important for this project's springboot configuration below:

@Bean
    public ConsumerFactory<String, OpenSentTaskStatus> consumerFactory() {
        Map<String, Object> configurationProperties = new HashMap<>();
        configurationProperties.put(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092");
        configurationProperties.put(ConsumerConfig.GROUP_ID_CONFIG, "group_id");
        configurationProperties.put(JsonDeserializer.TRUSTED_PACKAGES, "*");
        configurationProperties.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
        configurationProperties.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, JsonDeserializer.class);
        configurationProperties.put(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "earliest");
        return new DefaultKafkaConsumerFactory<>(configurationProperties);
    }
@Bean
    public ProducerFactory<String, OpenSentTaskStatus> producerFactory() {
        Map<String, Object> props = new HashMap<>();
        props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092");
        props.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, StringSerializer.class);
        props.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, JsonSerializer.class);
        return new DefaultKafkaProducerFactory<>(props);
    }

Roadmap

  • YouTube Service & View
  • X (formerly Twitter) Service & View
  • Vkontakte Service & View

See the open issues for a full list of proposed features (and known issues).

(back to top)

(back to top)

Contacts

Wali Morris - @LinkedIn - [email protected]

Project Link: GitHub

(back to top)

Acknowledgments

(back to top)

About

OSINT Platform - Provides image analysis, digital footprints, video transcription and more. Retrieval Augmented Generation (RAG) capable platform

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published