Storage Configuration Update V3.0.1

---

Overview

This update introduces the ability to configure file storage for the application. By default, the application is configured to use Amazon S3 for storage, but you can also configure it to use the local file system.

Default Configuration: Amazon S3

The application is set up to use Amazon S3 by default. To enable S3 storage, you must provide the following environment variables:

• AWS_ACCESS_KEY_ID: Your AWS access key ID.
• AWS_SECRET_ACCESS_KEY: Your AWS secret access key.
• AWS_STORAGE_BUCKET_NAME: The name of your S3 bucket.
• AWS_S3_REGION_NAME: The AWS region where your bucket is located (e.g., 'us-east-1').

These keys should be added to your environment configuration.

Example .env Configuration for S3:

AWS_ACCESS_KEY_ID=your-access-key-id
AWS_SECRET_ACCESS_KEY=your-secret-access-key
AWS_STORAGE_BUCKET_NAME=your-bucket-name
AWS_S3_REGION_NAME=your-region-name

Optional Configuration: Local File System Storage

If you prefer to use the local file system for storage, you can set the STORAGE environment variable to file. In this case, files will be stored locally in the media directory within your project.

Example .env Configuration for Local File System:

STORAGE=file

When using the local file system, no additional environment variables are required.

Summary of Configuration Options:

• S3 Storage (Default): Requires the following environment variables: AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_STORAGE_BUCKET_NAME, AWS_S3_REGION_NAME.
• Local File System Storage: Set STORAGE=file in your .env file to use the local file system.

This flexible configuration allows you to choose the storage solution that best suits your needs.

---

This format is ready to be added directly to your GitHub repository's release notes or documentation.

V3.0

Farmstack Release Notes - Version 3.0

Release Date: 2nd Aug 2024

---

New Features

Content Management

• File Support:
  • Farmstack now supports the management of various file types including PDF, DOCX, TXT, HTML, CSV, and API data.
  • Users can upload, view, and manage these files directly within the application.
• Storage Integration:
  • Seamless integration with S3 for efficient file storage and retrieval.

Use Cases Steward and Co-Steward Network Management

• Steward Network Management:
  • Introduction of a network management system for data stewards.
  • Data stewards can manage datasets, assign roles, and ensure data quality and integrity.
• Co-Steward Collaboration:
  • Allows co-stewards to collaborate on dataset management.
  • Co-stewards can request access, provide input, and assist in maintaining datasets.

State-Wise Content Provider

• Localized Content:
  • State-wise content provider feature to manage and deliver localized content efficiently.

Telegram Bots

• Bot Integration:
  • New features for Telegram bots allowing interaction with Farmstack.
  • Users can chat with the bots to retrieve information from the uploaded content and manage datasets.

AI RAG Retrieval

• Relevance-Based Information Retrieval:
  • Integration with advanced AI RAG (Recurrent Attention Generator) retrieval systems.
  • Enhanced search capabilities to provide more accurate and relevant results from large datasets.
  • Utilizes Qdrant vector database for efficient similarity search and retrieval.

Technology Stack

• Backend: Python, Django
• Data Handling: Pandas
• Storage: S3, PostgreSQL
• Vector Database: Qdrant DB
• Client Library: Qdrant Client

Improvements

• Performance Enhancements:
  • Optimized database queries and file handling processes to improve overall application performance.
• User Interface:
  • Improved user interface for a more intuitive and user-friendly experience.
• Bug Fixes:
  • Resolved various bugs reported in the previous version, enhancing the stability and reliability of the platform.

---

We appreciate your feedback and are committed to continuously improving Farmstack. For any issues, suggestions, or further assistance, please contact our support team at [email protected].

Thank you for using Farmstack!

Farmstack Release Notes - Version V2.1

Dataset Management

• Comprehensive Dataset Handling:
  • Users can now easily upload, manage, and manipulate datasets directly within the application.
  • Supported formats include CSV, Excel, and JSON.
• Dataset Joining:
  • New feature allows users to join multiple datasets to create custom, desired datasets.
  • Supports inner join, outer join, left join, and right join operations.
• Advanced Filtering and Sorting:
  • Enhanced capabilities for filtering and sorting datasets based on various criteria.

Content Management

• File Support:
  • Farmstack now supports the management of various file types including PDF, DOCX, TXT, HTML, and CSV.
  • Users can upload, view, and manage these files directly within the application.
• Local File System Integration:
  • Files are stored and managed using the local file system for improved performance and accessibility.

Tailor-Made Dashboards

• Custom Dashboards:
  • Users can create customized dashboards tailored to each dataset.
  • Dashboards include various visualization tools to better understand and analyze data.
  • Real-time updates and interactive elements for a dynamic data presentation experience.

Data Sharing and Access Control

• Dataset Sharing:
  • Users can share entire datasets or specific columns with other users.
  • Share data securely with role-based permissions.
• Request for Approval:
  • Users can request approval for file downloads and API access.
  • Administrators can review and approve requests to ensure secure data sharing and access.

Technology Stack

• Backend: Python, Django
• Data Handling: Pandas
• Storage: Local File System, PostgreSQL

Improvements

• Performance Enhancements:
  • Optimized data processing and file handling to enhance application performance.
• User Interface:
  • Improved user interface for a more intuitive and user-friendly experience.
• Bug Fixes:
  • Resolved various bugs reported in the previous version, enhancing the stability and reliability of the platform.

# Vistaar Release Notes - Version 2.2

Farmstack Release Notes - Version 2.2

Release Date: [Release Date]

---

New Features

Content Management

• YouTube Support:
  • Farmstack now supports YouTube content management.
  • Users can add YouTube videos, playlists, or channels to Farmstack.
  • Users can manage and select specific YouTube videos for uploading to the platform for RAG (Relevance-Based Information Retrieval).

Improved Conversation Retrieval Chain

• Enhanced Retrieval:
  • Improved conversation retrieval chain for more accurate and relevant information extraction from uploaded content.

Chat Window

• Interactive Chat:
  • New chat window feature added in Farmstack.
  • Users can chat with uploaded content, providing an interactive way to query and retrieve information.

State-Wise Content Provider

• Localized Content:
  • State-wise content provider feature to manage and deliver localized content efficiently.

Telegram Bots

• Bot Integration:
  • New features for Telegram bots allowing interaction with Farmstack.
  • Users can chat with the bots to retrieve information from the uploaded content and manage datasets.

Technology Stack

• Backend: Python, Django
• Data Handling: Pandas, Langchain
• Storage: Local File System, PostgreSQL
• Vector Database: pgVector

Improvements

• Performance Enhancements:
  • Optimized data processing and video handling to enhance application performance.
• User Interface:
  • Improved user interface for a more intuitive and user-friendly experience.
• Bug Fixes:
  • Resolved various bugs reported in the previous version, enhancing the stability and reliability of the platform.

---

We appreciate your feedback and are committed to continuously improving Farmstack. For any issues, suggestions, or further assistance, please contact our support team at [email protected].

Thank you for using Farmstack!

---

V2.3

Dataset Management

• Comprehensive Dataset Handling:
  • Users can now easily upload, manage, and manipulate datasets directly within the application.
  • Supported formats include CSV, Excel, and JSON.
• Dataset Joining:
  • New feature allows users to join multiple datasets to create custom, desired datasets.
  • Supports inner join, outer join, left join, and right join operations.
• Advanced Filtering and Sorting:
  • Enhanced capabilities for filtering and sorting datasets based on various criteria.

Content Management

• File Support:
  • Farmstack now supports the management of various file types including PDF, DOCX, TXT, HTML, and CSV.
  • Users can upload, view, and manage these files directly within the application.
• Local File System Integration:
  • Files are stored and managed using the local file system for improved performance and accessibility.

Tailor-Made Dashboards

• Custom Dashboards:
  • Users can create customized dashboards tailored to each dataset.
  • Dashboards include various visualization tools to better understand and analyze data.
  • Real-time updates and interactive elements for a dynamic data presentation experience.

Data Sharing and Access Control

• Dataset Sharing:
  • Users can share entire datasets or specific columns with other users.
  • Share data securely with role-based permissions.
• Request for Approval:
  • Users can request approval for file downloads and API access.
  • Administrators can review and approve requests to ensure secure data sharing and access.

Password authentication bypased

• Users can request login using mail id directly.

Technology Stack

• Backend: Python, Django
• Data Handling: Pandas
• Storage: Local File System, PostgreSQL

Improvements

• Performance Enhancements:
  • Optimized data processing and file handling to enhance application performance.
• User Interface:
  • Improved user interface for a more intuitive and user-friendly experience.
• Bug Fixes:
  • Resolved various bugs reported in the previous version, enhancing the stability and reliability of the platform.

Farmstack Release Notes - Version 2.0

Farmstack Release Notes - Version 2.0

Release Date: [Release Date]

---

New Features

Dataset Management

• Comprehensive Dataset Handling:
  • Users can now easily upload, manage, and manipulate datasets directly within the application.
  • Supported formats include CSV, Excel, and JSON.
• Dataset Joining:
  • New feature allows users to join multiple datasets to create custom, desired datasets.
  • Supports inner join, outer join, left join, and right join operations.
• Advanced Filtering and Sorting:
  • Enhanced capabilities for filtering and sorting datasets based on various criteria.

Use Cases Steward and Co-Steward Network Management

• Steward Network Management:
  • Introduction of a network management system for data stewards.
  • Data stewards can manage datasets, assign roles, and ensure data quality and integrity.
• Co-Steward Collaboration:
  • Allows co-stewards to collaborate on dataset management.
  • Co-stewards can request access, provide input, and assist in maintaining datasets.

Technology Stack

• Backend: Python, Django
• Data Handling: Pandas
• Storage: Local File System, PostgreSQL

Improvements

• Performance Enhancements:
  • Optimized data processing and file handling to enhance application performance.
• User Interface:
  • Improved user interface for a more intuitive and user-friendly experience.
• Bug Fixes:
  • Resolved various bugs reported in the previous version, enhancing the stability and reliability of the platform.

---

We appreciate your feedback and are committed to continuously improving Farmstack. For any issues, suggestions, or further assistance, please contact our support team at [Support Email/Contact Information].

Thank you for using Farmstack!

---

Note: Please replace placeholders like [Release Date] and [Support Email/Contact Information] with the actual information before publishing the release notes.

v2.0-alpha

Participant Self Registration.
Import data from multiple data sources.
Data Categorization.

Backend support for the old UI Snapshot

Backend support for the old UI Snapshot