NO ISSUE, just question FILE DOWNLOAD ?

[MyRaspberry]

play with a ESP32-S3 N16R8
and setup FFAT 10MB partition.
and write dir and file (append 1 line / min )
/data/readings.csv

does THIS tool help me to DOWNLOAD that file via Browser?

the example FSBrowser i use, not even print that file (content)
my status : at GIT

THX for sharing your work

[cotestatnt]

Hi @MyRaspberry

Yes, it can.
Some time ago I've written a sketch to visualize a csv, edit and download
I just have to remember where I saved it....

However, it has little to do with the library in question, it's just HTML and Javascript coding.

[MyRaspberry]

i just worry about the file size can grow over the memory of the chip,
what also limits the html it can produce dynamically,
so how JS could serve big files?

[cotestatnt]

It depends on the size of your csv file.
Aniway, this library could serve web pages even from a SD memory card if a lot of space is needed.

Naturally, the larger the size of the csv file, the longer it will take to load the page that displays its content.

This is the result with my ESP32-S3 (only 1.3Mbyte for LittleFS filesystem) using my smartphone as Access Point.
Test with a file of approximately 110kb (1000 records)

and this instead with a file of approximately 1000kb (8000 records)

If you only need to download, the problem does not arise because it is not necessary to upload the contents of the file to the web page as in this case.
It will be sufficient to populate a list with the files to download (if there are more than one) and a button to start the download.

[MyRaspberry]

thanks,

anyhow i started coding the file thing a ? better ? way,
making daily files like "data/readings_2024-01-08.csv"
will see tomorrow if it works.

and then experiment with your lib

thanks for your time

[cotestatnt]

making daily files like "data/readings_2024-01-08.csv"

This is a great idea.
The download page at this point will only have to create a list based on the contents of the filesystem and allow you to download the files.

If you need, I have some working sketches that do similar things (not with csv, but basically it's the same behaviour)

[MyRaspberry]

-1- that first part seems to work:
find {"type":"file","name":"data/readings_2024-01-09.csv", "size": 21267 B } ( ! size after 8 hours already )

//update 2024.01.10:
[
{"type":"file","name":"data/readings.csv", "size": 2067 B },
{"type":"file","name":"data/readings_2024-01-08.csv", "size": 19537 B},
{"type":"file","name":"data/readings_2024-01-09.csv", "size": 61945 B },  <<< 62KB /d
{"type":"file","name":"data/readings_2024-01-10.csv", "size": 15032 B }
]

,rec,datetimes,A0,A1,A2,
,1785,2024-01-09 00:00:49,0.00,20.05,1.03,
,1789,2024-01-09 00:01:49,0.00,18.95,0.71,
,1793,2024-01-09 00:02:49,0.00,19.10,0.61,
...

tomorrow i know how big it will be.

-2- i can also now print the content using the server.streamFile
String contentType = getContentType(path);
File file = FILESYSTEM.open(path, "r");
server.streamFile(file, contentType);
file.close();

inside my added function to the FSBrowser code :
void handleFilePrint() { // on /print?file=/data/readings.csv

-3- BUT THAT IS NOT A DOWNLOAD ? HOW ?
i also failed to find something in your
esp-fs-webserver-master\src\esp-fs-webserver.cpp

It will be sufficient to populate a list with the files to download (if there are more than one) and a button to start the download.

sounds like you know how, but i have no idea what you refer to.

-4- i am lost,
while years ago i play

• esp2866 and SPIFFS
• and the /data/ dir in Arduino code and a
• Arduino IDE TOOLS menu entry UPLOAD

and after using Circuit Python just come back to Arduino IDE

now i see that is ?DISCONTINUED?

and having a ESP32-S3 N16R8 module i look into using FFAT
where i miss the way to handle any files there regarding UPLOAD & DOWNLOAD..
so finding FSBrowser i hoped that might be the way, but that is very incomplete.

also i miss to see anything ? regarding other tools
is there something from the Espressif tools?

or ? i have one of that boards with 2 USB C ports,
is there a code ?for Arduino IDE?
to use one port of that board as a USB STICK with file access to FFAT?
HA, that would be great

[MyRaspberry]

thanks anyhow,
i got the basics working.. see GIT

[cotestatnt]

Hi @MyRaspberry

I'm happy you already solved it.
In any case, if you want to take a look, I added an example taking inspiration from your needs

https://github.com/cotestatnt/esp-fs-webserver/tree/master/examples/csvLogger

[MyRaspberry]

yes, thanks, i love it, looks great and is very professional,

i see you use littleFS and the /data/ dir in the arduino project,
means what? did you use a upload tool?
because as i see that you create that log file in the ESP

• but after 'online edit' ... you can download it to your computer ( via that index.html download button )
• and possibly store it again in the arduino /data/ dir? for a new setup ?

i assume that i can not use it for my little FFAT exploring project?
but i could try it on that esp32-S3 N16R8? BUT NOT IDE 2.2.1 ? or need ESP32?
anyhow about your web page / css / js / i could learn a lot.
thanks again!

can you open that? my page snap

[cotestatnt]

Of course you can use it!
The library is compatible with any type of Espressif microcontroller including the ESP8266.

If you prefer to use FFat, simply include the "FFat.h" file and replace LittleFS with FFat wherever you see it in the sketch.

As for uploading the data folder, it is managed directly by the library using the included /setup page, Update & FS tab.

Once you have uploaded your sources, you can edit them directly using the included /edit page
Soon I will add a new version of /edit that allows you to download files, but in the meantime you can simply copy and paste to transfer any changes to your PC

Regarding your working HTML code, you can simply put it on a specific page: if you don't want write from beginning, open dev tools of your browser, move to the "source" tab and copy the content.
If the name page is index.htm or index.html it will be used as default page

#####Edit:#####
In order to use FFat some small chages are needed in the sources because FFat treats the / character in folder paths a little differently.
In the file assets/js/index.js edit the function as this listFiles() in order to remove the last '/' from url when a folder is passed to the function

// Fetch the list of files and fill the filelist
function listFiles() {
  var url = '/list?dir=' + dataFolder;
  if (url.charAt(url.length - 1) === '/')
    url = url.slice(0, -1); // Remove the last character
    
  fetch(url)    // Do the request
  .then(response => response.json())    // Parse the response
  .then(obj => {                        // DO something with response
    fileList.innerHTML = '';
    obj.forEach(function(entry, i) {
      addEntry(entry.name);
    });
    // Load first file
    loadCsv(dataFolder + obj[0].name);    
  });
}

[cotestatnt]

The print screen is from the twin library that uses the ESPAsyncWebServer library for the webserver instead of the one included in the core, but the result does not change (I develop them more or less in parallel)

From some tests I've done it seems to be faster and more responsive.

[MyRaspberry]

as expected nothing is easy....
first ( not yet reading above and with my possibly wrong thinking ) i try a extra working environment

• on a laptop ( win 10 )
• Arduino IDE 1.8.19
• installed lib esp-fs-webserver 1.2.8
• add download copy example from MASTER esp-fs-webserver-master\examples\csvLogger
• board ESP32 : NODE ESP-32S V1.1
• partition [default]
• press the RIGHT BUTTON for UPLOAD this sketch
  ( for first time i used erase all flash [enabled], who knows what i play last year ?CircuitPython? )

try set laptop wifi to
ESP_AP
password 123456789
from laptop
get:

Oops.

The site at http://www.msftconnecttest.com/redirect has experienced a network protocol violation that cannot be repaired.

The page you are trying to view cannot be shown because an error in the data transmission was detected.

Please contact the website owners to inform them of this problem.

try again to powerup via charger
try login via mobile
sign in to ESP_AP
the webpage at https://192.168.4.1/setup could not be loaded because
net::ERR_CONNECTION_REFUSED

[cotestatnt]

I'm sorry @MyRaspberry, but a pull request I've merged some times ago has introduced this bug due to a wrong reply when ESP is acting as captive portal ( "https:://" instead http://).

Once an ESP32 has succesfull connected to a SSID it store the credentials, so I've never realized before about this bug.

With last commit and releases I've fixed it.
I've added also some more features like manual WiFi configuration (fixed IP, gatway, subnet)