integration and feed of data with dAISy hat

[gregbartels]

Hi there,

I would like to suggest if is possible integrate the dAISy hat receiver with your program, I want to share here the link of the product, the hat use the serial port, and include the frequencies in the receiver to be used. Not sure if you can integrate this soon or if there is a way to integrate easily. I´m using a script to upload AIS data to APRS but if we can integrate this with the AIS catcher will be great!
https://shop.wegmatt.com/products/daisy-hat-ais-receiver

thank you!

[jvde-github]

Hi! Actually the recent NMEA decoder included in the program should help with that and almost get us to process the data from the DaisyHat. I think you can print the messages from the dAISy with a comment like:

cat /dev/serial0

That means that in theory you could use the following AIS-catcher command:

AIS-catcher -r txt /dev/serial0 -m 5 -o 5

And add all the UDP HTTP channels you want to add as extra parameters instead of the -o 5. This is theory, as I implemented this functionality only recently and have not tested it with dAISy. I have one though and will test it out.

How does your script process the data out of the dAISy and do you provide any additional commands to set things like baud rate?

[gregbartels]

Hi Jasper! Thanks for the response, I have one, if you want I can try to test this in the next weeks with the dAISy hat. I'm using this script https://github.com/hsiboy/ais_json <https://github.com/hsiboy/ais_json> + Ais dispatcher. This is my setup! you can see my station on APRS.FI from Central Pacific of Costa Rica. Thanks in advance! Greg! El sáb, 26 nov 2022 a las 13:30, Jasper ***@***.***>) escribió:

…

Hi! Actually the recent NMEA decoder included in the program should help with that and almost get us to process the data from the DaisyHat. I think you can print the messages from the dAISy with a comment like: cat /dev/serial0 That means that in theory you could use the following AIS-catcher command: AIS-catcher -r txt /dev/serial0 -m 5 -o 5 And add all the UDP HTTP channels you want to add as extra parameters instead of the -o 5. This is theory, as I implemented this functionality only recently and have not tested it with dAISy. I have one though and will test it out. How does your script process the data out of the dAISy and do you provide any additional commands to set things like baud rate? — Reply to this email directly, view it on GitHub <#42 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASWRPICSRGUHEXNBUJALNNLWKJQNTANCNFSM6AAAAAASMAR224> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- Gregory Badilla Bartels

[jvde-github]

Hi Greg, okay, so I was thinking of having AIS-catcher directly reading from the serial port of the dAISy. I will try that tomorrow. Let's call that option 1 :-)

Understand that you use AISdispatcher to read from the dAISy and send that per UDP messages to your script (option 2). Let's assume this UDP address is127.0.0.1 port 5000 (as per your script). You can get this into AIS-catcher as follows:

netcat -l -u 127.0.0.1 5000 | AIS-catcher -r txt . -o 5

And then again replace -o 5 with whatever you want, e.g. use -H to get it to APRS.fi.

Keep me posted, I will let you know how my experiment with the dAISy goes.

Thanks!

[jvde-github]

UPDATED after some changes to the program

I have tested reading directly from the dAISY and the following did work for me (with the latest development version of AIS-catcher). First set the baud rate:

stty -F /dev/serial0 38400

And then you can use AIS-catcher as feeder as follows (in this case sending the data to UDP):

AIS-catcher -r txt /dev/serial0 -n -v 60 -u 192.168.1.235 10110

Seems to be working smoothly with two small fixes required some day (terminating the program with CTRL-C does not work smoothly and option to select -m 5 in the config file).

The corresponding config file:

{"config":"aiscatcher","version":1,"input":"rawfile","verbose":true,"file":{"file":"/dev/serial0","format":"txt"}}

You can add all APRS and UDP channels to the above like normal.
I did have the problem that the serial port disappeared at some point and reading from /dev/serial0 could only be done as root and kept terminating. I don't regularly run the dAISy so interested in your experience.

Keep me posted.
Thanks, Jasper

[gregbartels]

Hi Jasper, Thank you for the confirmation, I will work to have setup this and test with the AIS-catcher. Thanks for the information shared!!! Regards from Costa Rica! El dom, 27 nov 2022 a las 5:05, Jasper ***@***.***>) escribió:

…

I have tested reading directly from the dAISY and the following did work for me (with the latest development version of AIS-catcher). First set the baud rate: stty -F /dev/serial0 38400 And then you can use AIS-catcher as feeder as follows (in this case sending the data to UDP): AIS-catcher -r txt /dev/serial0 -m 5 -o 5 -v 60 -u 192.168.1.235 10110 Seems to be working smoothly with two small fixes required some day (terminating the program with CTRL-C does not work smoothly and option to select -m 5 in the config file). Keep me posted. Thanks, Jasper — Reply to this email directly, view it on GitHub <#42 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASWRPIA7MTUBSEMEJEB3EZ3WKM56DANCNFSM6AAAAAASMAR224> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- Gregory Badilla Bartels

[gregbartels]

Hi Jasper, Happy New Year 2023! I follow the steps you provide me but I'm still unable to see the AIS-Catcher uploading the data. I'm getting this error: [image: image.png] if i run this command AIS-catcher -r txt /dev/serial0 -m 5 -o 5 -v 60 -u 127.0.0.1 5000 pointing to the port 5000 ( which is my script uploading the info) I can see the tool working [image: image.png] but is not reflecting the data in the map of APRS. [image: image.png] I will appreciate your help, I apologize to bother you, I'm still learning about how to configure this, I followed up the steps you shared with me but I'm still unable to see it the data. Thanks in advance! Greg TI2GBB El lun, 28 nov 2022 a las 17:51, Gregory Badilla ***@***.***>) escribió:

…

Hi Jasper, Thank you for the confirmation, I will work to have setup this and test with the AIS-catcher. Thanks for the information shared!!! Regards from Costa Rica! El dom, 27 nov 2022 a las 5:05, Jasper ***@***.***>) escribió: > I have tested reading directly from the dAISY and the following did work > for me (with the latest development version of AIS-catcher). First set the > baud rate: > > stty -F /dev/serial0 38400 > > And then you can use AIS-catcher as feeder as follows (in this case > sending the data to UDP): > > AIS-catcher -r txt /dev/serial0 -m 5 -o 5 -v 60 -u 192.168.1.235 10110 > > Seems to be working smoothly with two small fixes required some day > (terminating the program with CTRL-C does not work smoothly and option to > select -m 5 in the config file). > > Keep me posted. > Thanks, Jasper > > — > Reply to this email directly, view it on GitHub > <#42 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ASWRPIA7MTUBSEMEJEB3EZ3WKM56DANCNFSM6AAAAAASMAR224> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> > -- Gregory Badilla Bartels

-- Gregory Badilla Bartels

[jvde-github]

Hi Greg, I cannot see the pictures with the error message. Can you try to reshare?

[gregbartels]

No problem!

Let me paste here the information:

Happy New Year 2023! I follow the steps you provide me but I'm still unable to see the AIS-Catcher uploading the data. I'm getting this error:

if i run this command AIS-catcher -r txt /dev/serial0 -m 5 -o 5 -v 60 -u 127.0.0.1 5000 pointing to the port 5000 ( which is my script uploading the info) I can see the tool working

but is not reflecting the data in the map of APRS.

_I will appreciate your help, I apologize to bother you, I'm still learning about how to configure this, I followed up the steps you shared with me but I'm still unable to see it the data.

Thanks in advance!

Greg
TI2GBB_

[jvde-github]

Hi greg,

The first step seems to be working, which is to get the NMEA lines from your device in AIS-catcher:

AIS-catcher -r txt /dev/serial0 -m 5 -o 5 -v 60 

You send this to a UDP address and then pick it up again with another instance with your netcat call. Which is totally fine. But of course you can send to APRS directly from the first instance by using the H switch.

The problem is in your use of the -H option which needs more information to be able to send it to APRS. The README of the program has an example. Essentially the -H needs to be followed by the following:

AIS-catcher -H http://aprs.fi/jsonais/post/secret-key ID callsign PROTOCOL aprs INTERVAL 30

The secret-key is the key you received from APRS to send your AIS data to and callsign your station name. I think I followed these instructions to get to that: https://aprs.fi/page/ais_feeding

So to read 1) from your device, 2) send to APRS and 3) send to UDP port 5000, you can use one long statement:

AIS-catcher -r txt /dev/serial0 -m 5 -o 5 -v 60  -H http://aprs.fi/jsonais/post/secret-key ID callsign PROTOCOL aprs INTERVAL 30 -u 127.0.0.1 5000

I think that is the issue I see (i.e no parameters after -H) with your statement but please let me know if I misunderstood.

Instead of the map I am using this site to check whether there is any data received. You might also see an error message in the AIS-catcher output with the response from the APRS site. But instead of -o 5 you could consider to use -q to suppress all the NMEA lines so that is more visible.

Thanks for asking, your question has actually resulted in developing this functionality so much appreciated.

Jasper

[gregbartels]

Thanks for the extensive explanation Jasper!

I tried the first command and I got this:

I tried the second option ( using AIS Dispatcher) and I got the same:

the AIS receiver is called YS1RM

If I can simplify this using all the ais-catcher software instead of AIS dispatcher it will be great, my idea is experiment and use all the resources you have developed on the project.

Again, thanks a lot for the explanations, I will create a guide to use dAISy hat with Ais-catcher as soon as we get this work a expected.

Greg

[jvde-github]

Thank you Greg. The issue is that your AIS-catcher build does not support APRS submission as it was not build with the CURL library included.
If you type:

AIS-catcher -L

You need to see something like:

Other support: CURL ZLIB RTLSDR-BIASTEE RTLSDR-TUNERBW 

which includes CURL and ZLIB.
I think you have to rebuild AIS-cacther from scratch but before that install the necessary libraries:

sudo apt install libcurl4-openssl-dev zlib1g-dev

If you in that process run cmake, you should see something like:

-- Checking for module 'libcurl'
--   Found libcurl, version 7.74.0
-- CURL: found - /usr/include/aarch64-linux-gnu, /usr/lib/aarch64-linux-gnu/libcurl.so
-- Checking for module 'zlib'
--   Found zlib, version 1.2.11
-- ZLIB: found - /usr/include, /usr/lib/aarch64-linux-gnu/libz.so

which tells you that the system could find CURL and ZLIB which are needed for APRS submissions.

Regards, Jasper

[gregbartels]

Ok, I found this on the Pi:

It's curious because Curl is already installed:

[jvde-github]

Hi Greg,

curious that the build of the program could not find the curl library then.

What do you get with the commands:

pkg-config --libs libcurl

and

pkg-config --cflags libcurl

And if you build the latest version of the program what do you see in the cmake step on curl?
You should see something like:

-- Checking for module 'libcurl'
--   Found libcurl, version 7.74.0
-- CURL: found - /usr/include/aarch64-linux-gnu, /usr/lib/aarch64-linux-gnu/libcurl.so
-- Checking for module 'zlib'
--   Found zlib, version 1.2.11
-- ZLIB: found - /usr/include, /usr/lib/aarch64-linux-gnu/libz.so

[gregbartels]

Jasper if I ran the first command I got this:

for the second command

My only doubt is this section ( I apologize, I'm still learning to use linux)

_And if you build the latest version of the program what do you see in the cmake step on curl?
You should see something like:

-- Checking for module 'libcurl'
-- Found libcurl, version 7.74.0
-- CURL: found - /usr/include/aarch64-linux-gnu, /usr/lib/aarch64-linux-gnu/libcurl.so
-- Checking for module 'zlib'
-- Found zlib, version 1.2.11
-- ZLIB: found - /usr/include, /usr/lib/aarch64-linux-gnu/libz.so_

Should I use cmake libcurl in the terminal console to get this output or how is the sintax? Thank you! sorry again for the dummies question.

If I need to start from scratch, I just need to run remove command to delete the AIS-catcher file and that's all, right?

[jvde-github]

No worries.

By the way the first outcome looks promising.

Apologies. You need to follow the steps below the table in the instruction: https://github.com/jvde-github/AIS-catcher#ubuntu-raspberry-pi-macos-msvc

git clone https://github.com/jvde-github/AIS-catcher.git
cd AIS-catcher
mkdir build
cd build
cmake ..
make
sudo make install

So you need to enter these command is this order (in some directory where you want the program and if you already have an AIS-catcher directory you might have to delete it first).
You see that one of the commands is cmake .. that should as part of the output show the lines above.

Feel free to post the output of these steps here (or just send me an email)

[gregbartels]

Good day Jasper!

I did the installation again, I follow the steps to setup the port for the dAISy hat, and I run the next command to feed directly to APRS.FI

it's been 24 hours now and finally we have the results!!!

THANK YOU SO MUCH! You don't know how much I appreciate your help on this, I'm very happy for the results! ( I'm considering record a youtube video in spanish/english to explain how to do it this with dAISy hat!)

At think at this point I can continue experiment the next features of the AIS-Catcher. I wonder to know how often the data in APRS.FI is send, every time the boats move or how frequently is the report of positions sent?

Thanks a lot! I'm working to have setup the second AIS-Catcher now. The idea is coverage all central america with AIS receiver.

Can I create a routine to start the AIS catcher feed after reboot/ cut of electricity ? Just to avoid manual intervention everytime we need to reboot the Pi due updates or stop electricity fluid to the pi.

Thanks again and regards from Costa Rica!
Greg

[jvde-github]

Hi Greg, great news! Happy to hear.

The command line argument contained INTERVAL 30 which essentially tells the program to collect messages for 30 seconds and then send to APRS. For my station I have set it to 60 but you can shorter as well at the expense of more internet traffic. From the APRS page it seems that 60s is quite common.

There is script that someone developed that will install AIS-catcher as a service that automatically starts: https://github.com/abcd567a/install-aiscatcher

And there is a lot of discussion here on that same script: https://discussions.flightaware.com/t/howto-run-ads-b-receiver-ais-receiver-on-same-rpi/85040

If you are comfortable that is an avenue you could try.

[g7ruh]

Hi Greg,
thanks for starting this discussion, most interesting and helped me learn some things.

I now have my AIS-catcher test system feeding aprs.fi

Thanks to Jasper for creating a simple way to feed aprs.fi too, of course.

73 Roger G7RUH

[gregbartels]

Hey you're welcome! I'm very happy with the Ais Catcher and the different features of this code! @jvde-github provides the best feedback and support! I hope we can continue expanding the usage of this amazing project!

[g7ruh]

Greg,
I, too am very happy with Jasper (and team) and how stuff just gets fixed.

Team Jasper: keep up the good work. I can see AIS-catcher being a one-stop AIS solution, and as Greg says, keep expanding it. I showed it to a visitor yesterday and he was most impresed.

73 de Roger G7RUH

[jvde-github]

The latest edge version has now an experimental feature to read directly from the dAISy HAT and other serial devices using the switch -e:

AIS-catcher -e 38400 /dev/serial0

[R1ch1e-Lee]

I had to add user aiscat to the dialout group to get this to read from the serial port using abcd567a install script

sudo adduser aiscat dialout

log off then back on and it worked

[jerryaquav]

My old laptop running an even older EasyAIS with a forwarding program I shan't name has died. I would like to run a new Pi4 & dAISy hat set up but can't find any clear instructions. AIS Catcher has a great reputation but I need to find an idiots guide to get it running quickly. The plan is to send data in to the previous sites I was feeding. Can anyone help?

[jerryaquav]

Hi Jasper Many thanks for the coaching. I think I now have it running. It is a lovely interface & once I got used to changing the back end wasn't as daunting as I thought it would be. I will definitely be recommending it to the AIS community.

R1ch1e-Lee many thanks for the the additional input to get me going. The whole setup takes up a lot less space that the old laptop and receiver, cables all over the place & power for all.

[jvde-github]

Great, happy to hear! Spread the word :-)

[jerryaquav]

another addition for your list of stations running AIS-catcher https://www.marinetraffic.com/en/ais/details/stations/10083/_:6fee18c796a96183f56c876a2b26bac6

[jvde-github]

I have added it to the Github page list: https://github.com/jvde-github/AIS-catcher/blob/main/README.md#some-stations-with-ais-catcher

Jasper

[jvde-github]

If you want a dashboard on aiscatcher.org. Happy to set up, please send me an email.

[gregbartels]

Hello @jvde-github Re activating this discussion group.

I had to reimage the raspberry pi this morning, when I tried to run the commands to run the Ais Catcher and feed APRS.FI I got this message:

I´m not getting to make this work, Do you know what I´m possible missing here? Thanks for your assistance!

[jvde-github]

Yes, the txt in the second line is too much but not needed anymore. We now see what the issue is, the dAISy breaks the connection for some reason. Let me do some research. Is it the same Pi as you used before? Only the Operating System was updates?

If you immediately restart after the stop, does it then run again?

Can you share which Raspberry version you are using?

[gregbartels]

Understood!

is the same Raspberry PI I have used before, only the operating system was updated.

-Correct, If I restarted after the stop, it will run again until the next stop.

Model : Raspberry Pi 3 Model B Plus Rev 1.3

[jvde-github]

Thank you. I don't think it is an AIS catcher issue but perhaps we can reconnect to the dAISy automatically if it fails. Let me explore and see if I can reproduce.
Thanks Greg

[jvde-github]

Question. if you have a new OS you need to go enter

sudo rasp-config

And follow the below from the dAISy hat manual. Have you done this step and can it resolve the interruption?

[gregbartels]

I applied the steps yesterday... I see a times when the command stopped, however it's been active for almost 9 hours now.