Download
(9 Kb)
Download
Updated: 05/05/22 04:36 PM
Addon for:
HarvestMap.
Compatibility:
High Isle (8.0.0)
Ascending Tide (7.3.5)
Blackwood (7.0.5)
Flames of Ambition (6.3.5)
Updated:05/05/22 04:36 PM
Created:04/13/21 06:32 AM
Monthly downloads:11,343
Total downloads:428,270
Favorites:369
MD5:
HarvestMap-Data  Popular! (More than 5000 hits)
Version: 3.15.3
by: Shinni [More]
This addon allows you to download pin locations for the HarvestMap addon so you do not have to discover everything yourself.

After installing or updating the addon, execute the following script in "Elder Scrolls Online/live/AddOns/HarvestMapData":
  • MacOS: right-click on DownloadNewData.command, then choose 'Open'.
  • Linux: run DownloadNewData.sh
  • Windows: option 1: double-click on DownloadNewData.bat, or option 2: right-click on DownloadNewData.ps1 and select 'Run with PowerShell'.
Executing either script will upload the locations you discovered to our server, where your locations are merged with those discovered by all other players. The server will then send the combined data back to you.

Updating this addon will delete the downloaded data. So you must run the script again when you update this addon.


MacOS script was provided by Mojo66 (www.esoui.com/forums/member.php?u=40561)
3.15.3
Added linux script
Hopefully fixed the error in the mac script (i dont have a mac so i can't verify it)

3.15.2
I added the merge script again and setup a new server. Merging your data should work again.

3.15.1
The HarvestMap-Data addon no longer comes with a script to upload/download data. Instead, the data is directly included in the addon.

My internet provider switched to DualStack-Lite. As a result I do not have a public ipv4 anymore and can no longer host the server for exchanging HarvestMap data.
The data included in the addon is from 2021-06-15 and includes pin locations for Blackwood.
As there is no longer the option to upload your data, the provided data will become outdated soon. Specifically, there will be no data for future DLC zones.

3.15.0
Archived Files (3)
File Name
Version
Size
Uploader
Date
3.15.2
9kB
Shinni
06/20/21 06:56 AM
3.15.1
791kB
Shinni
06/18/21 06:04 AM
3.15
9kB
Shinni
04/13/21 06:32 AM


Post A Reply Comment Options
Unread 01/04/22, 06:04 AM  
viper81

Forum posts: 0
File comments: 6
Uploads: 0
Mac Users

The author said to do the following for this file to work. Next, I want to add how to give yourself permission under Monteray OS. If you don't do the below steps you will receive an error stating you don't have permission.

DownloadNewData.command

  1. To fix the problem, edit line 34 of the file DownloadNewData.command
Change it from
name=Harvest${i}_SavedVars
to
name=Harvest${zone}_SavedVars

Now after you change that file give yourself the proper permissions to that file
  1. Open Terminal
  2. Type chmod u+x
  3. Space
  4. Drag your "DownloadNewData.command" file to the terminal
  5. Hit enter
  6. Now your "DownloadNewData.command" file has proper permissions
  7. Run the DownloadNewData.command file like normal

It should look something like below.


Thanks again author for dedicating your time to this addon!
Report comment to moderator  
Reply With Quote
Unread 12/17/21, 09:52 PM  
thealqemist

Forum posts: 0
File comments: 1
Uploads: 0
I can't see any of the data I used to be able to see. No idea what happened. It messed up in the last patch update I believe. I'm on Windows 10 if it matters
Report comment to moderator  
Reply With Quote
Unread 12/13/21, 06:13 PM  
Techwolf
 
Techwolf's Avatar

Forum posts: 7
File comments: 86
Uploads: 0
Try running the download/update scripts, just keep getting "unable to reach server" errors.

Like to get data for the new zones sence the last addon update.
Last edited by Techwolf : 12/13/21 at 06:13 PM.
Report comment to moderator  
Reply With Quote
Unread 10/31/21, 04:05 AM  
Icipher

Forum posts: 0
File comments: 2
Uploads: 0
I should have searched the forums before creating a general *UNIX script

In my script I'm using realpath to get the absolute path for the live folder: basedir=$(realpath ../..)
Most of the distros should have it

Originally Posted by myxlmynx
Hi. I have extended the download script for OSX so that it works for Linux as well.
Obviously, since there is no native Linux ESO client, it assumes you're running the Windows version via Wine/Proton.
The script is mostly the same as before and thus it should still also work with OSX (but I can't test that). The bugfix with the zone variable is included.
Save this as HarvestMapData/DownloadNewData.sh, change "basedir_linux" to your ESO "live" directory, make it executable and run it.

Code:
#!/bin/bash
# HarvestMapData/DownloadNewData.sh
# - Original script for OS X by (C) 2018 @mojo66 <[email protected]>
# - Modified for Linux use by @myxlmynx <[email protected]>
#   Linux users: change "basedir_linux" to your ESO "live" directory
#------------------------------------------------------------------------------

# use absolute paths. this makes the script work regardless of the dir it resides in
basedir_osx=~/Documents/Elder\ Scrolls\ Online/live
basedir_linux="/PATH/TO/YOUR/STEAMLIBRARY/steamapps/compatdata/306130/pfx/drive_c/users/steamuser/Documents/Elder Scrolls Online/live"


case "$(uname -s)" in
  Darwin*) machine='Mac'     ;;
  Linux*)  machine='Linux'   ;;
  *)       machine='Other'   ;;
esac

if [ "$machine" == 'Mac' ]; then
  basedir="$basedir_osx"
elif [ "$machine" == 'Linux' ]; then
  basedir="$basedir_linux"
fi
savedvardir="${basedir}/SavedVariables"
addondir="${basedir}/AddOns/HarvestMapData"
emptyfile="${addondir}/Main/emptyTable.lua"


# exit if ESO is running
if [ "$machine" == "Mac" ]; then
  pgrep -x -q eso
elif [ "$machine" == "Linux" ]; then
  pgrep -x eso64.exe >/dev/null 2>&1
fi
if [[ ! $? -eq 1 ]]; then echo "Quit ESO before running this script to avoid data corruption.";exit 1;fi


# check if everything exists
if [[ ! -e "${addondir}" ]]; then echo "ERROR: ${addondir} does not exist, re-install this AddOn and try again...";exit 1;fi

# iterate over the different zones
for zone in AD EP DC DLC NF; do
        fn=HarvestMap${zone}.lua
        echo "Working on ${fn}..."

        svfn1=${savedvardir}/${fn}
        svfn2=${svfn1}~

        # if saved var file exists, create backup...
        if [[ -e ${svfn1} ]]; then
                mv -f "${svfn1}" "${svfn2}"
        # ...else, use empty table to create a placeholder
        else
                name=Harvest${zone}_SavedVars
                echo -n "$name" | cat - "${emptyfile}" > "${svfn2}"
        fi
        # download data
        curl -# -d @"${svfn2}" -o "${addondir}/Modules/HarvestMap${zone}/${fn}" "http://harvestmap.binaryvector.net:8081"
done
Report comment to moderator  
Reply With Quote
Unread 08/28/21, 03:13 AM  
myxlmynx

Forum posts: 0
File comments: 1
Uploads: 0
Hi. I have extended the download script for OSX so that it works for Linux as well.
Obviously, since there is no native Linux ESO client, it assumes you're running the Windows version via Wine/Proton.
The script is mostly the same as before and thus it should still also work with OSX (but I can't test that). The bugfix with the zone variable is included.
Save this as HarvestMapData/DownloadNewData.sh, change "basedir_linux" to your ESO "live" directory, make it executable and run it.

Code:
#!/bin/bash
# HarvestMapData/DownloadNewData.sh
# - Original script for OS X by (C) 2018 @mojo66 <[email protected]>
# - Modified for Linux use by @myxlmynx <[email protected]>
#   Linux users: change "basedir_linux" to your ESO "live" directory
#------------------------------------------------------------------------------

# use absolute paths. this makes the script work regardless of the dir it resides in
basedir_osx=~/Documents/Elder\ Scrolls\ Online/live
basedir_linux="/PATH/TO/YOUR/STEAMLIBRARY/steamapps/compatdata/306130/pfx/drive_c/users/steamuser/Documents/Elder Scrolls Online/live"


case "$(uname -s)" in
  Darwin*) machine='Mac'     ;;
  Linux*)  machine='Linux'   ;;
  *)       machine='Other'   ;;
esac

if [ "$machine" == 'Mac' ]; then
  basedir="$basedir_osx"
elif [ "$machine" == 'Linux' ]; then
  basedir="$basedir_linux"
fi
savedvardir="${basedir}/SavedVariables"
addondir="${basedir}/AddOns/HarvestMapData"
emptyfile="${addondir}/Main/emptyTable.lua"


# exit if ESO is running
if [ "$machine" == "Mac" ]; then
  pgrep -x -q eso
elif [ "$machine" == "Linux" ]; then
  pgrep -x eso64.exe >/dev/null 2>&1
fi
if [[ ! $? -eq 1 ]]; then echo "Quit ESO before running this script to avoid data corruption.";exit 1;fi


# check if everything exists
if [[ ! -e "${addondir}" ]]; then echo "ERROR: ${addondir} does not exist, re-install this AddOn and try again...";exit 1;fi

# iterate over the different zones
for zone in AD EP DC DLC NF; do
        fn=HarvestMap${zone}.lua
        echo "Working on ${fn}..."

        svfn1=${savedvardir}/${fn}
        svfn2=${svfn1}~

        # if saved var file exists, create backup...
        if [[ -e ${svfn1} ]]; then
                mv -f "${svfn1}" "${svfn2}"
        # ...else, use empty table to create a placeholder
        else
                name=Harvest${zone}_SavedVars
                echo -n "$name" | cat - "${emptyfile}" > "${svfn2}"
        fi
        # download data
        curl -# -d @"${svfn2}" -o "${addondir}/Modules/HarvestMap${zone}/${fn}" "http://harvestmap.binaryvector.net:8081"
done
Report comment to moderator  
Reply With Quote
Unread 07/12/21, 03:54 AM  
Sordrak
 
Sordrak's Avatar
AddOn Author - Click to view AddOns

Forum posts: 52
File comments: 358
Uploads: 4
Originally Posted by Shinni
@Sordrak
I'm not sure I understand your question. The downloaded files are not SavedVariables.

edit: Ah, you didn't use any of the provided scripts so the files are in the wrong folder. The script is not compiled or anything so you can just look at the source code if you don't want to execute unknown code.
Anyway, the downloaded files are to be saved in the AddOns/HarvestMapData/Modules/HarvestMapAD, EP, etc folders.
ESO has a bug when it comes to escaping certain byte sequences in strings when writing to SavedVariables (https://www.esoui.com/forums/showthread.php?t=9567). That's why the files are loaded from the addon folder instead.
Ah lol, that was most likely my issue. Just skimmed over the code. Makes sense now i guess. I'll try that later

Edit:
It was a different procedure in the past? I remember uploading files in a web application and replacing files manually?
That's probably why I didn't read the code completely and just messed up my saved vars

Edit #2:
Oh and thanks for the quick answer.
Last edited by Sordrak : 07/12/21 at 04:01 AM.
Report comment to moderator  
Reply With Quote
Unread 07/11/21, 04:08 PM  
Shinni
AddOn Author - Click to view AddOns

Forum posts: 167
File comments: 550
Uploads: 22
@Sordrak
I'm not sure I understand your question. The downloaded files are not SavedVariables.

edit: Ah, you didn't use any of the provided scripts so the files are in the wrong folder. The script is not compiled or anything so you can just look at the source code if you don't want to execute unknown code.
Anyway, the downloaded files are to be saved in the AddOns/HarvestMapData/Modules/HarvestMapAD, EP, etc folders.
ESO has a bug when it comes to escaping certain byte sequences in strings when writing to SavedVariables (https://www.esoui.com/forums/showthread.php?t=9567). That's why the files are loaded from the addon folder instead.
Last edited by Shinni : 07/11/21 at 04:18 PM.
Report comment to moderator  
Reply With Quote
Unread 07/11/21, 08:29 AM  
Sordrak
 
Sordrak's Avatar
AddOn Author - Click to view AddOns

Forum posts: 52
File comments: 358
Uploads: 4
Failed to update Nodes

Hossa

Something seems to be broken here on my side and some feedback would be very nice.
I prefer to do things myself instead of just invoking some random (Powershell) scripts. So that's what I did.
I've sent all five savedVariables files to your endpoint http://harvestmap.binaryvector.net:8081/ and received a response.

Basically your response looks something like the following:
Code:
Harvest:Info("Loading downloaded file HarvestAD")
HarvestAD_Data={
[382]={
["reapersmarch/rawlkha_base"]={
[1]="<random binary values>"...
I've simply replaced the old files with the new files and restarted the game (respectively i did this while being logged out).
No nodes appear afterwards. Everything is gone.
After an additional reloadui i took a look at the new savedVariables.
The result is:
Code:
HarvestAD_SavedVars =
{
    ["dataVersion"] = 17,
}
So basically an empty file. Did i mess something up here or is your binary handling somehow corrupt and was not able to import a single node?

Some feedback would be great (and yes, i have backups^^)

EDIT:
I guess I figured out what the issue is. When downloading the files i already though, this looks strange.
The first line in the downloaded file looks like:
Code:
Harvest:Info("Loading downloaded file HarvestAD")
So you try to execute code when loading the savedVariables.
Aren't they loaded before any addons? If so, this would likely cause an exception as Harvest is nil at that point in time. So loading the savedVariables would fail -> no new data, no old data.
Removing this line from all five files seems to do the trick for me. At least I have some data back again now.

EDIT #2:
Well, the data got loaded, but... it does not seem to be saved again in a savedVariables file.
What did I miss? o_O
Last edited by Sordrak : 07/11/21 at 09:04 AM.
Report comment to moderator  
Reply With Quote
Unread 07/06/21, 02:24 AM  
Mysak0CZ

Forum posts: 0
File comments: 1
Uploads: 0
Mac/Linux download script error

The DownloadNewData.command is currently broken, to fix it, edit line 34
from
name=Harvest${i}_SavedVars
to
name=Harvest${zone}_SavedVars

I verified this on linux using bash, but should be the exact same for Mac
Report comment to moderator  
Reply With Quote
Unread 07/05/21, 09:30 AM  
Shinni
AddOn Author - Click to view AddOns

Forum posts: 167
File comments: 550
Uploads: 22
@Orejana: Thanks. This is odd. The script did download the data and HarvestMap is able to display pins, yet the downloaded locations are not displayed. It looks like eso does not load the downloaded data for some reason.

We can try the following, which might help track what's causing the issue:
1) Install the addon/library "LibDebugLogger", if you haven't already.
https://www.esoui.com/downloads/info...bugLogger.html
2) Run the script in HarvestMapData again to get the most recent files from our server.
3) Log into the game with a character. Make sure LibDebugLogger, HarvestMap and HarvestMapAD, EP, etc are enabled.
At this point, LibDebugLogger will save a lot of information in the background about the currently enabled addons. This information which might help us track the problem.
4) Logout of the game again. The information tracked by LibDebugLogger will be saved in the file
Documents/Elder Scrolls Online/live/SavedVariables/LibDebugLogger.lua
Please send me that file. You can submit the file here: https://www.dropbox.com/request/yvD5HwVUjuLOLxdghPGc
Report comment to moderator  
Reply With Quote
Unread 07/05/21, 08:13 AM  
Orejana
AddOn Author - Click to view AddOns

Forum posts: 2
File comments: 50
Uploads: 2
I have the files you describe, yes.
It does show pins once I harvest stuff, but not before. They stay in place until I run the script again - then they are gone again.

Originally Posted by Shinni
According to that log, the script downloaded the data just fine.
The scripts should have saved the downloaded files in Addons/HarvestMapData/Modules/HarvestmapAD/HarvestMapAD.lua (likewise HarvestMapDC, EP, DLC, NF). Filesize is quite small, 140-380kb.

If the the pins are not displayed on the map, does it display a pin after you harvest something? (Just so I know whether HarvestMap doesn't display anything or if it's only the downloaded locations.)
Last edited by Orejana : 07/05/21 at 08:15 AM.
Report comment to moderator  
Reply With Quote
Unread 07/01/21, 03:27 AM  
Mr_Groober

Forum posts: 0
File comments: 4
Uploads: 0
Re: Error?

Originally Posted by Mr_Groober
Couple of things:
- when I harvest a node a map marker and a pin appear (and they are visible for my alts)
- I'm not sure what should I do with that link http://harvestmap.binaryvector.net:8081/ - my browser says "This site can’t be reached"

Any help would be appreciated.
Thank you
Fixed itself so neverminded I suppose
Report comment to moderator  
Reply With Quote
Unread 06/29/21, 05:37 PM  
Mr_Groober

Forum posts: 0
File comments: 4
Uploads: 0
Error?

Creating backup copy of your data
The system cannot find the file specified.
The system cannot find the file specified.
The system cannot find the file specified.
The system cannot find the file specified.
The system cannot find the file specified.
Connecting to database...
Modules/HarvestMapAD/HarvestMapAD.lua
Open file: HarvestMapAD
Uploading file: HarvestMapAD
Error while merging file: HarvestMapAD
Error while downloading data: The system cannot locate the resource specified.

Modules/HarvestMapEP/HarvestMapEP.lua
Open file: HarvestMapEP
Uploading file: HarvestMapEP
Error while merging file: HarvestMapEP
Error while downloading data: The system cannot locate the resource specified.

...and the same for all other zones....
Couple of things:
- when I harvest a node a map marker and a pin appear (and they are visible for my alts)
- I'm not sure what should I do with that link http://harvestmap.binaryvector.net:8081/ - my browser says "This site can’t be reached"

Any help would be appreciated.
Thank you
Last edited by Mr_Groober : 06/29/21 at 10:31 PM.
Report comment to moderator  
Reply With Quote
Unread 06/29/21, 02:12 PM  
Shinni
AddOn Author - Click to view AddOns

Forum posts: 167
File comments: 550
Uploads: 22
Warning: Spoiler
According to that log, the script downloaded the data just fine.
The scripts should have saved the downloaded files in Addons/HarvestMapData/Modules/HarvestmapAD/HarvestMapAD.lua (likewise HarvestMapDC, EP, DLC, NF). Filesize is quite small, 140-380kb.

If the the pins are not displayed on the map, does it display a pin after you harvest something? (Just so I know whether HarvestMap doesn't display anything or if it's only the downloaded locations.)
Report comment to moderator  
Reply With Quote
Unread 06/29/21, 01:43 PM  
mishanthropy

Forum posts: 0
File comments: 1
Uploads: 0
Question No nodes showing on map?

Originally Posted by Orejana
Originally Posted by Shinni

@hotrockin
The script connects to harvestmap.binaryvector.net on port 8081.
If you can access http://harvestmap.binaryvector.net:8081/ with your browser then the script should work as well.
(The link above will just say "The uploaded file does not contain a data table" because accessing the page via browser doesn't upload anything.)
My saved data is gone as well and I cannot merge with the server's data.

The link above works for me, I get the text message you described.


I have tried to install both addons from the ESOUI website directly instead of via Minion. I have tried to download new data in both addons, but it doesn't work. Any more ideas?
Cheers!

Edit: I noticed the script is running a looot faster than it used to, taking about 3s atm...


Code:
You are about to upload and merge your HarvestMap savefiles with the global database.
Drücken Sie eine beliebige Taste . . .
.
Creating backup copy of your data
Das System kann die angegebene Datei nicht finden.
Das System kann die angegebene Datei nicht finden.
Das System kann die angegebene Datei nicht finden.
Das System kann die angegebene Datei nicht finden.
Das System kann die angegebene Datei nicht finden.
Connecting to database...
Modules/HarvestMapAD/HarvestMapAD.lua
Open file: HarvestMapAD
Uploading file: HarvestMapAD
Finished uploading the file.
Receiving answer...
Saved new data for file: HarvestMapAD

Modules/HarvestMapEP/HarvestMapEP.lua
Open file: HarvestMapEP
Uploading file: HarvestMapEP
Finished uploading the file.
Receiving answer...
Saved new data for file: HarvestMapEP

Modules/HarvestMapDC/HarvestMapDC.lua
Open file: HarvestMapDC
Uploading file: HarvestMapDC
Finished uploading the file.
Receiving answer...
Saved new data for file: HarvestMapDC

Modules/HarvestMapDLC/HarvestMapDLC.lua
Open file: HarvestMapDLC
Uploading file: HarvestMapDLC
Finished uploading the file.
Receiving answer...
Saved new data for file: HarvestMapDLC

Modules/HarvestMapNF/HarvestMapNF.lua
Open file: HarvestMapNF
Uploading file: HarvestMapNF
Finished uploading the file.
Receiving answer...
Saved new data for file: HarvestMapNF

Press any key to close this window.
Drücken Sie eine beliebige Taste . . .
I'm having the same problem. I downloaded the addon from Minion at first, but then uninstalled and downloaded from here. Reinstalled, ran the scripts, but there are no nodes on any of my maps. Is there a step I'm missing here?

The link also gives me the correct text (something about tables), and I've also noticed the script runs really fast - much faster I would expect.
Report comment to moderator  
Reply With Quote
Post A Reply



Category Jump: