How `wwsh file import` work ?

[BlackS52]

Hello everybody,

i'm a bit confused. I try to add to my image a script to bring up my second network but i can't see the script final image.

wwsh file import /etc/init.d/ww_worknet_up.sh --name=ww_worknet_up.sh -D /etc/init.d/ww_worknet_up.sh
wwsh file sync 

and even I rebuild vnfs i have the same. No ww_worknet_up.sh in the final image.

Where I'm wrong ?
I'm still trying to resolve this problem a few days

[jmstover]

Be sure to set the file onto a Node object: wwsh provision set --fileadd=ww_worknet_up.sh [node list]

…

-J

On Fri, Jun 27, 2025 at 11:47 AM Black.S ***@***.***> wrote: *BlackS52* created an issue (warewulf/warewulf3#326) <#326> Hello everybody, i'm a bit confused. I try to add to my image a script to bring up my second network but i can't see the script final image. wwsh file import /etc/init.d/ww_worknet_up.sh --name=ww_worknet_up.sh -D /etc/init.d/ww_worknet_up.sh wwsh file sync and even I rebuild vnfs i have the same. No ww_worknet_up.sh in the final image. Where I'm wrong ? I'm still trying to resolve this problem a few days — Reply to this email directly, view it on GitHub <#326>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAHHHIW2FKMFSKG4NBCUFPD3FVYR5AVCNFSM6AAAAACAJO4RZGVHI2DSMVQWIX3LMV43ASLTON2WKOZTGE4DGNBVHEZTCNQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[BlackS52]

yes yes, I made this too

wwsh -vvv provision set --fileadd=ww_worknet_up.sh mynode2
and after
wwsh file sync
wwvnfs --name myvnfs1 --chroot /my_path_to_unpacked_root_fs/

It doesn't help.
Don't know why so

In my expectation the file should be added to the vnfs image

[jmstover]

Would need to see the web logs from the master when a file is requested, and if there happens to be any output from wwgetfiles, or wwfilesync .... Hell, can't remember the exact command; I think wwgetfiles.... when ran from a node. You can also try removing the file: /tmp/.wwgetfiles.timestamp ...... or something like that, to make it pull *every* file it thinks it has set on it again, instead of just updated files. Also... I *think* the option you may need to use is:

…

--- wwsh file import /etc/init.d/ww_worknet_up.sh --name=ww_worknet_up.sh -D /etc/init.d --- I think the -D option is supposed to be the *PATH* ... not the final file location. Just the path where the file will reside. I think. *BUT* ... when a node is provisioned, it should get the file provisioned. You shouldn't need to mess around with the timestamp file, etc... :/

-J

On Fri, Jun 27, 2025 at 12:15 PM Black.S ***@***.***> wrote: *BlackS52* left a comment (warewulf/warewulf3#326) <#326 (comment)> yes yes, I made this too wwsh -vvv provision set --fileadd=ww_worknet_up.sh mynode2 and after wwsh file sync wwvnfs --name myvnfs1 --chroot /my_path_to_unpacked_root_fs/ It doesn't help. Don't know why so In my expectation the file should be added to the vnfs image — Reply to this email directly, view it on GitHub <#326 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAHHHISQKBTYZ2ISGVJL5333FV33NAVCNFSM6AAAAACAJO4RZGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJTHA2DANZZHE> . You are receiving this because you commented.Message ID: ***@***.***>

[jmstover]

Ignore what I said about the path (-D option).... I looked up what wwgetfiles does, and it reads the 'path' from the master.... then does a: basename $path So yeah, we want it to be the full: /etc/init.d/ww_worknet_up.sh ---- so that basename call returns /etc/init.d

…

-J On Fri, Jun 27, 2025 at 12:28 PM Jason Stover ***@***.***> wrote:

Would need to see the web logs from the master when a file is requested, and if there happens to be any output from wwgetfiles, or wwfilesync .... Hell, can't remember the exact command; I think wwgetfiles.... when ran from a node. You can also try removing the file: /tmp/.wwgetfiles.timestamp ...... or something like that, to make it pull *every* file it thinks it has set on it again, instead of just updated files. Also... I *think* the option you may need to use is: --- wwsh file import /etc/init.d/ww_worknet_up.sh --name=ww_worknet_up.sh -D /etc/init.d --- I think the -D option is supposed to be the *PATH* ... not the final file location. Just the path where the file will reside. I think. *BUT* ... when a node is provisioned, it should get the file provisioned. You shouldn't need to mess around with the timestamp file, etc... :/ -J On Fri, Jun 27, 2025 at 12:15 PM Black.S ***@***.***> wrote: > *BlackS52* left a comment (warewulf/warewulf3#326) > <#326 (comment)> > > yes yes, I made this too > > wwsh -vvv provision set --fileadd=ww_worknet_up.sh mynode2 > and after > wwsh file sync > wwvnfs --name myvnfs1 --chroot /my_path_to_unpacked_root_fs/ > > It doesn't help. > Don't know why so > > In my expectation the file should be added to the vnfs image > > — > Reply to this email directly, view it on GitHub > <#326 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAHHHISQKBTYZ2ISGVJL5333FV33NAVCNFSM6AAAAACAJO4RZGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJTHA2DANZZHE> > . > You are receiving this because you commented.Message ID: > ***@***.***> >

[jmstover]

*sigh* ...... dirname $path The brain doesn't alway put out what I want it to.

…

-J On Fri, Jun 27, 2025 at 12:34 PM Jason Stover ***@***.***> wrote:

Ignore what I said about the path (-D option).... I looked up what wwgetfiles does, and it reads the 'path' from the master.... then does a: basename $path So yeah, we want it to be the full: /etc/init.d/ww_worknet_up.sh ---- so that basename call returns /etc/init.d -J On Fri, Jun 27, 2025 at 12:28 PM Jason Stover ***@***.***> wrote: > Would need to see the web logs from the master when a file is requested, > and if there happens to be any output from wwgetfiles, or wwfilesync .... > Hell, can't remember the exact command; I think wwgetfiles.... when ran > from a node. > > You can also try removing the file: /tmp/.wwgetfiles.timestamp ...... or > something like that, to make it pull *every* file it thinks it has set on > it again, instead of just updated files. > > Also... I *think* the option you may need to use is: > > --- > > wwsh file import /etc/init.d/ww_worknet_up.sh --name=ww_worknet_up.sh -D /etc/init.d > --- > > I think the -D option is supposed to be the *PATH* ... not the final file location. Just the path where the file will reside. I think. > > > *BUT* ... when a node is provisioned, it should get the file provisioned. > You shouldn't need to mess around with the timestamp file, etc... :/ > > -J > > On Fri, Jun 27, 2025 at 12:15 PM Black.S ***@***.***> > wrote: > >> *BlackS52* left a comment (warewulf/warewulf3#326) >> <#326 (comment)> >> >> yes yes, I made this too >> >> wwsh -vvv provision set --fileadd=ww_worknet_up.sh mynode2 >> and after >> wwsh file sync >> wwvnfs --name myvnfs1 --chroot /my_path_to_unpacked_root_fs/ >> >> It doesn't help. >> Don't know why so >> >> In my expectation the file should be added to the vnfs image >> >> — >> Reply to this email directly, view it on GitHub >> <#326 (comment)>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/AAHHHISQKBTYZ2ISGVJL5333FV33NAVCNFSM6AAAAACAJO4RZGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJTHA2DANZZHE> >> . >> You are receiving this because you commented.Message ID: >> ***@***.***> >> >

[BlackS52]

Don't worry. I've got it.

hm, interesting

I thought that the file should be added to the image in a master side.

But, do you think that this file should be downloaded after booting the node ?
I mean on the node side ?

It looks like you are right because right now I can see on my booted node that the file was created but now it have 0 byte

node# ls -la  /etc/ww_worknet_up.sh
-rwxr-xr-x 1 root root 0 Dec 24 23:47 /etc/ww_worknet_up.sh

[jmstover]

Yes, the files are added into the provisioned node image, not the VNFS image/structure. Files are pulled down during the node provisioning. I believe on the node, you'll find a file: /var/log/warewulf/80-filles --- which should have the logs from the wwgetfiles execution during provisioning.

…

-J

On Fri, Jun 27, 2025 at 12:38 PM Black.S ***@***.***> wrote: BlackS52 left a comment (warewulf/warewulf3#326) Don't worry. I've got it. hm, interesting I thought that the file should be added to the image in a master side. But, do you think that this file should be downloaded after booting the node ? I mean on the node side ? It looks like you are right because right now I can see on my booted node that the file was created but now it have 0 byte node# ls -la /etc/ww_worknet_up.sh -rwxr-xr-x 1 root root 0 Dec 24 23:47 /etc/ww_worknet_up.sh — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: ***@***.***>

[jmstover]

Oh..... also, any time you modify the file on your master, you must run: wwsh file sync ww_worknet_up.sh Files are not constantly sync'd .... so, anytime there's a modification you will need to re-sync it.

…

-J

On Fri, Jun 27, 2025 at 12:42 PM Jason Stover ***@***.***> wrote: Yes, the files are added into the provisioned node image, not the VNFS image/structure. Files are pulled down during the node provisioning. I believe on the node, you'll find a file: /var/log/warewulf/80-filles --- which should have the logs from the wwgetfiles execution during provisioning. -J On Fri, Jun 27, 2025 at 12:38 PM Black.S ***@***.***> wrote: > > BlackS52 left a comment (warewulf/warewulf3#326) > > Don't worry. I've got it. > > hm, interesting > > I thought that the file should be added to the image in a master side. > > But, do you think that this file should be downloaded after booting the node ? > I mean on the node side ? > > It looks like you are right because right now I can see on my booted node that the file was created but now it have 0 byte > > node# ls -la /etc/ww_worknet_up.sh > -rwxr-xr-x 1 root root 0 Dec 24 23:47 /etc/ww_worknet_up.sh > > — > Reply to this email directly, view it on GitHub, or unsubscribe. > You are receiving this because you commented.Message ID: ***@***.***>

[BlackS52]

I've added set -x to /warewulf/transports/http/wwgetfiles to debug

Maybe an issue connected with some httpd configs.

`++ '[' '!' -d //etc ']'
++ wget -q -O //etc/group.ww1751045947 'http://100.5.2.11/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=4'
++ '[' f = l ']'
++ '[' f = d ']'
++ '[' f = b -o f = c ']'
++ '[' f = p ']'
++ '[' f = s ']'
++ chmod 0644 //etc/group.ww1751045947
++ mv //etc/group.ww1751045947 //etc/group
++ chown 0 //etc/group
++ chgrp 0 //etc/group
++ echo 1751045947
++ read id name uid gid mode timestamp path
+++ dirname /etc/ww_worknet_up.sh
++ basedir=/etc
++ case "$mode" in
++ ftype=f
++ '[' '!' -d //etc ']'
++ wget -q -O //etc/ww_worknet_up.sh.ww1751045947 'http://100.5.2.11/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18'
++ '[' f = l ']'
++ '[' f = d ']'
++ '[' f = b -o f = c ']'
++ '[' f = p ']'
++ '[' f = s ']'
++ chmod 0755 //etc/ww_worknet_up.sh.ww1751045947
++ mv //etc/ww_worknet_up.sh.ww1751045947 //etc/ww_worknet_up.sh
++ chown 0 //etc/ww_worknet_up.sh
++ chgrp 0 //etc/ww_worknet_up.sh
++ echo 1751045947
++ read id name uid gid mode timestamp path
++ rm -f /tmp/tmp.SXmBobAM0E
++ rm -f /tmp/.wwgetfile.lock
++ exit 0

But the file have 0 size. Strange

[jmstover]

++ read id name uid gid mode timestamp path +++ dirname /etc/ww_worknet_up.sh So, the file is set as: /etc/ww_worknet_up.sh --- *not* /etc/init.d/ww_worknet_up.sh It's pulling _something_ from your provisioner, even if it's what it thinks it's getting is an empty file.

…

++ wget -q -O //etc/ww_worknet_up.sh.ww1751045947 'http://100.5.2.11/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18'

-J

On Fri, Jun 27, 2025 at 12:45 PM Black.S ***@***.***> wrote: *BlackS52* left a comment (warewulf/warewulf3#326) <#326 (comment)> I've added set -x to /warewulf/transports/http/wwgetfiles to debug Maybe an issue connected with some httpd configs. `++ '[' '!' -d //etc ']' ++ wget -q -O //etc/group.ww1751045947 'http://100.5.2.11/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=4' ++ '[' f = l ']' ++ '[' f = d ']' ++ '[' f = b -o f = c ']' ++ '[' f = p ']' ++ '[' f = s ']' ++ chmod 0644 //etc/group.ww1751045947 ++ mv //etc/group.ww1751045947 //etc/group ++ chown 0 //etc/group ++ chgrp 0 //etc/group ++ echo 1751045947 ++ read id name uid gid mode timestamp path +++ dirname /etc/ww_worknet_up.sh ++ basedir=/etc ++ case "$mode" in ++ ftype=f ++ '[' '!' -d //etc ']' ++ wget -q -O //etc/ww_worknet_up.sh.ww1751045947 'http://100.5.2.11/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18' ++ '[' f = l ']' ++ '[' f = d ']' ++ '[' f = b -o f = c ']' ++ '[' f = p ']' ++ '[' f = s ']' ++ chmod 0755 //etc/ww_worknet_up.sh.ww1751045947 ++ mv //etc/ww_worknet_up.sh.ww1751045947 //etc/ww_worknet_up.sh ++ chown 0 //etc/ww_worknet_up.sh ++ chgrp 0 //etc/ww_worknet_up.sh ++ echo 1751045947 ++ read id name uid gid mode timestamp path ++ rm -f /tmp/tmp.SXmBobAM0E ++ rm -f /tmp/.wwgetfile.lock ++ exit 0 But the file have 0 size. Starnge — Reply to this email directly, view it on GitHub <#326 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAHHHIQATY7DDVHRZIIPAYT3FV7J5AVCNFSM6AAAAACAJO4RZGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJTHEYDOOJUGQ> . You are receiving this because you commented.Message ID: ***@***.***>

[BlackS52]

The same

Master side

wwsh file print ww_worknet_up.sh
#### ww_worknet_up.sh #########################################################
ww_worknet_up.sh: ID               = 18
ww_worknet_up.sh: NAME             = ww_worknet_up.sh
ww_worknet_up.sh: PATH             = /etc/init.d/ww_worknet_up.sh
ww_worknet_up.sh: ORIGIN           = /etc/rc.d/init.d/ww_worknet_up.sh
ww_worknet_up.sh: FORMAT           = bash
ww_worknet_up.sh: CHECKSUM         = e1a678038ff09452679d61e1747c68ef
ww_worknet_up.sh: INTERPRETER      = bash
ww_worknet_up.sh: SIZE             = 999
ww_worknet_up.sh: MODE             = 0755
ww_worknet_up.sh: UID              = 0
ww_worknet_up.sh: GID              = 0

md5sum /etc/init.d/ww_worknet_up.sh
e1a678038ff09452679d61e1747c68ef  /etc/init.d/ww_worknet_up.sh

wwsh provision print node2
#### node2.cluster #####################################################
node2.cluster: MASTER           = UNDEF
node2.cluster: VALIDATE         = FALSE
node2.cluster: FILES            = dynamic_hosts,group,passwd,ww_worknet_up.sh
node2.cluster: PRESHELL         = FALSE
node2.cluster: POSTSHELL        = FALSE
node2.cluster: POSTNETDOWN      = FALSE
node2.cluster: POSTREBOOT       = FALSE
node2.cluster: CONSOLE          = UNDEF
node2.cluster: SELINUX          = DISABLED
node2.cluster: BOOTLOCAL        = FALSE

The node

++ read id name uid gid mode timestamp path
+++ dirname /etc/init.d/ww_worknet_up.sh
++ basedir=/etc/init.d
++ case "$mode" in
++ ftype=f
++ '[' '!' -d //etc/init.d ']'
++ wget -q -O //etc/init.d/ww_worknet_up.sh.ww1751046850 'http://{IP}/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18'
++ '[' f = l ']'
++ '[' f = d ']'
++ '[' f = b -o f = c ']'
++ '[' f = p ']'
++ '[' f = s ']'
++ chmod 0755 //etc/init.d/ww_worknet_up.sh.ww1751046850
++ mv //etc/init.d/ww_worknet_up.sh.ww1751046850 //etc/init.d/ww_worknet_up.sh
++ chown 0 //etc/init.d/ww_worknet_up.sh
++ chgrp 0 //etc/init.d/ww_worknet_up.sh
++ echo 1751046850
++ read id name uid gid mode timestamp path
++ rm -f /tmp/tmp.gWCCHonWpe
++ rm -f /tmp/.wwgetfile.lock
++ exit 0
root@node2:~# ls -la //etc/init.d/ww_worknet_up.sh
-rwxr-xr-x 1 root root 0 Dec 25 00:11 //etc/init.d/ww_worknet_up.sh

[jmstover]

From the node, explicitly try grabbing the file: wget -O /tmp/testfile http://{IP}/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18 ls -l /tmp/testfile Where '{IP}' is the IP of your provisioner, and `hwaddr=` is the MAC address of the node. Also, in your base VNFS, ensure that you have nothing at /etc/init.d/ww_woknet_up.sh

…

-J

On Fri, Jun 27, 2025 at 1:01 PM Black.S ***@***.***> wrote: *BlackS52* left a comment (warewulf/warewulf3#326) <#326 (comment)> The same Master side wwsh file print ww_worknet_up.sh #### ww_worknet_up.sh ######################################################### ww_worknet_up.sh: ID = 18 ww_worknet_up.sh: NAME = ww_worknet_up.sh ww_worknet_up.sh: PATH = /etc/init.d/ww_worknet_up.sh ww_worknet_up.sh: ORIGIN = /etc/rc.d/init.d/ww_worknet_up.sh ww_worknet_up.sh: FORMAT = bash ww_worknet_up.sh: CHECKSUM = e1a678038ff09452679d61e1747c68ef ww_worknet_up.sh: INTERPRETER = bash ww_worknet_up.sh: SIZE = 999 ww_worknet_up.sh: MODE = 0755 ww_worknet_up.sh: UID = 0 ww_worknet_up.sh: GID = 0 md5sum /etc/init.d/ww_worknet_up.sh e1a678038ff09452679d61e1747c68ef /etc/init.d/ww_worknet_up.sh wwsh provision print node2 #### node2.cluster ##################################################### node2.cluster: MASTER = UNDEF node2.cluster: VALIDATE = FALSE node2.cluster: FILES = dynamic_hosts,group,passwd,ww_worknet_up.sh node2.cluster: PRESHELL = FALSE node2.cluster: POSTSHELL = FALSE node2.cluster: POSTNETDOWN = FALSE node2.cluster: POSTREBOOT = FALSE node2.cluster: CONSOLE = UNDEF node2.cluster: SELINUX = DISABLED node2.cluster: BOOTLOCAL = FALSE The node ++ read id name uid gid mode timestamp path +++ dirname /etc/init.d/ww_worknet_up.sh ++ basedir=/etc/init.d ++ case "$mode" in ++ ftype=f ++ '[' '!' -d //etc/init.d ']' ++ wget -q -O //etc/init.d/ww_worknet_up.sh.ww1751046850 'http://{IP}/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18' ++ '[' f = l ']' ++ '[' f = d ']' ++ '[' f = b -o f = c ']' ++ '[' f = p ']' ++ '[' f = s ']' ++ chmod 0755 //etc/init.d/ww_worknet_up.sh.ww1751046850 ++ mv //etc/init.d/ww_worknet_up.sh.ww1751046850 //etc/init.d/ww_worknet_up.sh ++ chown 0 //etc/init.d/ww_worknet_up.sh ++ chgrp 0 //etc/init.d/ww_worknet_up.sh ++ echo 1751046850 ++ read id name uid gid mode timestamp path ++ rm -f /tmp/tmp.gWCCHonWpe ++ rm -f /tmp/.wwgetfile.lock ++ exit 0 ***@***.***:~# ls -la //etc/init.d/ww_worknet_up.sh -rwxr-xr-x 1 root root 0 Dec 25 00:11 //etc/init.d/ww_worknet_up.sh — Reply to this email directly, view it on GitHub <#326 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAHHHIRSP4R3W4S4DJVTYTT3FWBIDAVCNFSM6AAAAACAJO4RZGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJTHE2TENJVGA> . You are receiving this because you commented.Message ID: ***@***.***>

[BlackS52]

Yeah, your are right.
I'm a bit optimize your way.

The problem on httpd server on the master side

Made this on the master side

wget -v -O /tmp/1.sh 'http://IP/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18'
--2025-06-27 11:07:30--  http://IP/WW/file?hwaddr=xx:xx:xx:xx:xx:xx&fileid=18
Connecting to MY_IP:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 0 [application/x-perl]
Saving to: ‘/tmp/1.sh’

/tmp/1.sh                                             [ <=>                                                                                        ]       0  --.-KB/s    in 0s

2025-06-27 11:07:30 (0.00 B/s) - ‘/tmp/1.sh’ saved [0/0]

ls -la /tmp/1.sh
-rw-r--r--. 1 root root 0 Jun 27 11:07 /tmp/1.sh

Will try to resolve the issue with httpd

Thanks a lot

[BlackS52]

Just to close the loop and maybe it will be helpful for others who have the same situation.
Solution: I've just removed my file from wwsh file and add it back and now all works well