Storage Module Limitation

[espruino-discuss]

Posted at 2019-05-16 by Unreality

Hi I'm trying to put a website on ESP8266 4MB Flash, but then when i try to save files into Storage module, I found that I can't write any file size larger than 12k

require("Storage").write("test","a",0,12500);

will return

Uncaught Error: Unable to find or create file
 at line 1 col 44

Isn't there a ~4MB Flash storage for me to store stuffs?

p.s. here's how I initialize my ESP12

python3 esptool.py --port /dev/cu.usbserial-1410 --baud 115200
write_flash --flash_freq 80m --flash_mode qio --flash_size 4MB
0x0000 "boot_v1.6.bin" 0x1000 espruino_esp8266_user1.bin
0x3FC000 esp_init_data_default.bin 0x3FE000 blank.bin

[espruino-discuss]

Posted at 2019-05-16 by Wilberforce

The esp32 implements the fs filesystem using flash - that has 1mb of flash set aside - use that to store you files. If you look at the docs you should be able to find out how to initialise the space, or search the forums.

---

Posted at 2019-05-16 by @MaBecker

Storage is always in the memory mapped segment and is 48 pages in size.

Use flash to access area between 3-4MB

Check this page for further details http://www.espruino.com/EspruinoESP8266

---

Posted at 2019-05-16 by @MaBecker

maybe a limit in storage implementation?

No limit, works without error on my side

>process.env
={
  VERSION: "2v03.4",
  GIT_COMMIT: "018e5296",
  BOARD: "ESP8266_4MB",
  FLASH: 0, RAM: 81920,
  SERIAL: "84f3eb23-aef8",
  CONSOLE: "Serial1",
  MODULES: "Flash,Storage,hea" ... "r,crypto,neopixel",
  EXPTR: 1073643636 }
> 
>require("Storage").write("test","a",0,12500);
=true
> 

---

Posted at 2019-05-17 by Unreality

is it possible to put esp32's fs filesystem on esp12 (4MB)? if yes, how? thanks.

---

Posted at 2019-05-17 by Unreality

thanks, after looking at your process.env, I found that I used BOARD "ESP8266" 's bin instead of BOARD "ESP8266_4MB" 's bin, that's why I failed to utilize the storage.

many thanks for your help

---

Posted at 2019-05-17 by Unreality

i.e. any Espruino esp8266_4MB firmware build supports SPIFFS Filesystem? how to do so? thanks 🙏

---

Posted at 2019-05-17 by @MaBecker

No, you can implement it. Main issue is always the limited heap size .

So try to find a SPIFFS implementation that is using small buffers and than start to implement it.

---

Posted at 2019-05-17 by @MaBecker

Hmm, why you want to overload the ESP12 with filesystem or spiffs.

Storage on ESP12 4MB board offers 48 x 4096 byte = 196.128 byte memory mapped.

So what else do you need?

---

Posted at 2019-05-17 by Unreality

I would like to store make a tool to copy all files of a mini website onto ESP12 and make it to serve the site

48 pages aren't quite enough to store it.

I made my own File Structure (without researching the right way to do so) using Storage Module, so that it can map the full folder structure & file content, i.e. mapping "/img/longFileName.js" with its content inside Storage module.

---

Attachments:

• requireNumberFS.js

---

Posted at 2019-05-17 by Unreality

And here's the py script that copies the website source folder onto ESP12

---

Attachments:

• fileMover.py

---

Posted at 2019-05-17 by Unreality

Now I'm writing the web server script on ESP12 to read files from my own File Structure.

Currently 48 pages size is the hard limit for the site total size.

I'm still new to these stuffs, appreciate if you can let me know if there's smarter way to do so

---

Posted at 2019-05-18 by @allObjects

@unreality, looked at your requireNumberFS.js in post #10... and it looks to me that you write a module out there into the storage. Is there a specific reason for that? ...because there are other options, and if you put a module no matter what, minification helps w/ memory and execution speed.

---

Posted at 2019-05-18 by Unreality

I thought storing a module/script into Storage will utilize flash memory and save ram space?