# Error in Repository Creation

## Recommended Posts

We have problem in Creating offline repository.

the command that we used is :

MirrorTool.exe --repositoryServer AUTOSELECT --useMetadataInVersion3 --intermediateRepositoryDirectory C:\repository\Intermediary --outputRepositoryDirectory C:\nginxrepository\html\New --languageFilterForRepository en_US

Many Files is missing as it seems that is not available in ESET Repository Servers.

Example:

We are using Console V7.1 in a isolated network and it seems that new console just use MetaDataV3.

No opinion ?

##### Share on other sites

Any reason why you used the --useMetadataInVersion3 parameter? If you remove it, does it work?

##### Share on other sites

• Most Valued Members

Hi Marcos,

I'm getting a similar issue here.  With or without it, it still doesn't 'work' as in it throws a list of files it can't download, in my case:

Error: Downloading file : hxxp://repository.eset.com/v1/com/eset/apps/business/ees/windows/v7/7.2.2055.0/ees_nt32.msi failed with : GetFile: Failed to process HTTP request (error code: 20014, url: 'hxxp://repository.eset.com/v1/com/eset/apps/business/ees/windows/v7/7.2.2055.0/ees_nt32.msi')

Error occured.

The command I used:

 ./MirrorTool --intermediateRepositoryDirectory /tmp/repo \
--mirrorType regular --repositoryServer AUTOSELECT \
--outputRepositoryDirectory /mirror/repo \
--excludeProducts ep4 ep5 \
--languageFilterForRepository en_US --useMetadataInVersion3

I've also used it without the --useMetadataInVersion3.

The thing is, ESMC seems to be looking for metadata3 files.

192.168.3.10 - - [25/Nov/2019:16:33:44 +0800] "GET /repo/com/eset/apps/business/era/server/windows/metadata3 HTTP/1.1" 404 12
192.168.3.10 - - [25/Nov/2019:16:33:45 +0800] "GET /repo/com/eset/tools/installers/bootstrapper_era/metadata3 HTTP/1.1" 404 12
192.168.3.10 - - [25/Nov/2019:16:33:45 +0800] "GET /repo/third_party/apps/safetica/agent/windows/metadata3 HTTP/1.1" 404 12


Which points me that metadata3 parameter needs to be used; but even with that, the metadata3 files aren't even created in the actual repo dir or even in the temporary repository dir (that mentioned, I'm guessing the MirrorTool grabs the files from the repository (excluding the filtered out files)  to the temporary dir and then goes through the final temp repo dirs and generates the metadata files; but it fails that as it exits with a "Error found".

As a minor question of feasibility; but, could there be some sort of REST api to the repository such that we can whip up our own scripts, or even dare I ask if the MirrorTool source can be open sourced?   (Just feasibility-questions..)

Thanks

Edmund

##### Share on other sites

19 hours ago, Marcos said:

Any reason why you used the --useMetadataInVersion3 parameter? If you remove it, does it work?

As we check Console V7.1 need metadata3 in offline repository so we use that parameters.

We upgrade the ESMC from 7.0 to 7.1 and Offline repository not work any more because it can not find metadata3 in repository folders.

As @ewong mentioned , It Seems that metadata3 is not generated with mirror tools . So Console 7.1 can not use offline repository in isolated networks right now.

right now there is 2 problem in repository :

1- Many 404 Error

##### Share on other sites

• Most Valued Members

Is there an update to this issue?

Thanks

##### Share on other sites

• ESET Moderators

Hello guys,

I had similar issues with them, but the latest works fine.

Regards, Peter

##### Share on other sites

• Most Valued Members

Edmund

##### Share on other sites

• ESET Moderators

Yes as the link is the same and it has "latest" in it, the question is what exact version do you have deployed.

As there is no switch to display the version, please share the date of the digital signature of the MirrorTool.exe.

Peter

##### Share on other sites

yes. local repo in not working.  I have checked already. bug in ESMC 7.1.

Developers know about it. but they didnt fix it still

##### Share on other sites

and here it is not the program version of mirrortool.

i dont know when they fix it..i wait)

##### Share on other sites

I have identical issue.

When I use MirrorTool without parameter "--useMetadataInVersion3" it finishes with "Exiting with success" and create repository with metadata. Unfortunately, ESMC 7.1 searches only "metadata3" files.

When I use MirrorTool with parameter  "--useMetadataInVersion3" it finish with "Error occured." and do not generate metadata3 files.

List of errors:

Error: Downloading file : hxxp://repository.eset.com/v1/com/eset/apps/business/ems/kerio/v6/6.5.16009.0/emsk_nt64_enu.msi failed with : GetFile: Object 'hxxp://repository.eset.com/v1/com/eset/apps/business/ems/kerio/v6/6.5.16009.0/emsk_nt64_enu.msi.eula/eulaENU.rtf' not found [error code: 20011]

Error occured.

If someone with relevant rights to ESET online repository, rename "eulaenu.rtf" files to "eulaENU.rtf" files, and "epi_enu.exe.eula-enu.html" file to "epi_enu.exe.EULA-ENU.html" file, I hope MirrorTool exit with success and finally generate metadata3.

Greetings

Edited by Mitazi
##### Share on other sites

Thanks, I've reported it to the appropriate person.

##### Share on other sites

Its not only mirror tool problem. Im troubleshooting update task and apache proxy from about week now. Im getting :

or

- GetFile: Failed to process HTTP request (error code: 20014, url: 'hxxp://repository.eset.com/v1/com/eset/apps/business/eea/windows/v7/7.2.2055.0/eea_nt64.msi')

##### Share on other sites

• Most Valued Members
On 12/3/2019 at 2:45 PM, Peter Randziak said:

Yes as the link is the same and it has "latest" in it, the question is what exact version do you have deployed.

As there is no switch to display the version, please share the date of the digital signature of the MirrorTool.exe.

Peter

md5 0c761f50b05658fa3932f464fd33f55f  MirrorTool

sha1 : 966cf086bcde148106b4e94d9be0e40f4ec35ca2  MirrorTool

Thanks!

Edmund

##### Share on other sites

Next issue.

After repairing case sensitive links (10x to @Marcos & the appropriate person) MirrorTool finish with status "Exiting with success" when use with parameter "--useMetadataInVersion3", generate directory structure in output directory, copy installation files, changelog.html files, eula.html files and eulaENU.rtf files, but not generate any metadata files, like info.meta, metadata, metadata3, manifest.erm and etc.

The command that I use is:

MirrorTool.exe >repo3.log ^
--repositoryServer AUTOSELECT ^
--intermediateRepositoryDirectory D:\repo3\in ^
--outputRepositoryDirectory D:\repo3\out ^
--languageFilterForRepository en_US

Any ideas how to resolve missing metadata3? And why metadata files missing?

🍺

##### Share on other sites

On 12/5/2019 at 4:07 PM, Mitazi said:

Next issue.

After repairing case sensitive links (10x to @Marcos & the appropriate person) MirrorTool finish with status "Exiting with success" when use with parameter "--useMetadataInVersion3", generate directory structure in output directory, copy installation files, changelog.html files, eula.html files and eulaENU.rtf files, but not generate any metadata files, like info.meta, metadata, metadata3, manifest.erm and etc.

The command that I use is:


MirrorTool.exe >repo3.log ^
--repositoryServer AUTOSELECT ^
--intermediateRepositoryDirectory D:\repo3\in ^
--outputRepositoryDirectory D:\repo3\out ^
--languageFilterForRepository en_US

Any ideas how to resolve missing metadata3? And why metadata files missing?

🍺

Same Problem ...

##### Share on other sites

• Most Valued Members

@Marcos, any chance there's a possibility that I can get the format of the metadata3 file from ESET so I can generate it myself?

Thanks

Edmund

##### Share on other sites

• ESET Staff

Unfortunately there is fatal problem in downloading metadata3 which results in this issue. I expect there will be new version available at least for testing during upcoming week.

Only possible workaround for now is to download metadata3 files manually - there should be one for each application and it is identical to file available on ESET servers = it is digitally signed. Great help would be output you already provided with list of metadata3 files downloaded by ESMC - only files for applications you are actually using is required to simplify things.

##### Share on other sites

• Most Valued Members

Hi @MartinK,

I managed to get some of the metadata3 files from ESET servers, but apparently we also need these manifest.erm files as well.  I'm guessing they are required for the eula folders?

Edmund

##### Share on other sites

On 12/7/2019 at 11:12 AM, MartinK said:

Unfortunately there is fatal problem in downloading metadata3 which results in this issue. I expect there will be new version available at least for testing during upcoming week.

Only possible workaround for now is to download metadata3 files manually - there should be one for each application and it is identical to file available on ESET servers = it is digitally signed. Great help would be output you already provided with list of metadata3 files downloaded by ESMC - only files for applications you are actually using is required to simplify things.

While we wait for the new version of MirrorTool, I follow your advice, and with little changes, it works. Finally I have operational offline repository. Thank you 🍺

##### Share on other sites

Still involved with this problem and waiting for New Version of Mirror Tool.

Any update right now ?

##### Share on other sites

I will try to explain how I created the offline repository. The explanation is for Windows, but you can easily adapt it for Linux.

I. The short way:

1. Download the "out3.zip" file. It contains the required directory structure but no files. Unzip it in "D:\repo1\". You should get "D:\repo1\out3\".
3. After performing point 2, you have the offline repository displayed in ESMC 7.1. To use it - with MirrorTool download the necessary files and copy them to "out3". Download the file "copy-rename.zip". It contains a cmd file to copy and rename the necessary files from English (see the long version).
After point 3 you have a fully functioning offline repository.

I. The Long Way:

For now (until a working version of MirrorTool is released), to create a working offline repository, we need to have all metadata3 and manifest.erm files available from the online repository. There are three points here:
1) ESMC 7.1 releases a predefined set of requests to the repository, and when any request is not executed, suspends and announces that there are no products in the repository;
2) We do not know the structure of the repository, we do not know the path to the required files and their number;

Solution for point 2: We launch MirrorTool with the following parameters until it "Exiting with success":

MirrorTool.exe --repositoryServer AUTOSELECT ^
--intermediateRepositoryDirectory D:\repo1\in ^
--outputRepositoryDirectory D:\repo1\out ^
--downloadLegacyForRepository

This will make a local copy of the repository with the structure we need. Its size is about 396 GB ("in" 199 GB + "out" 197 GB).
The last parameter "--downloadLegacyForRepository" is required because ESMC 7.1 searches the repository and metadata for old versions of products, and when it does not find it stops browsing and shows nothing about the searched product.

Decision on point 3:
After successful completion of point 2, we have the structure of the repository. We copy the structure to a new directory (for example, using "xcopy d:\repo1\out d:\repo1\out3 /I /T /E"), then download and save the metadata3 and manifest.erm files from the corresponding directories from the online directory. (IMPORTANT: Do not make any changes to the original outputRepositoryDirectory (D:\repo1\out), because on subsequent startup MirrorTool will give an error that the directory is not empty.)
Metadata3 files are located where there are metadata files. Manifest.erm files are located where there are eula files.
Additionally you need to download and save these 4 files (you need to create the corresponding directories "esa_nt32_nt64_enu.exe.eula"):

From hxxp://repository.eset.com/v1/com/eset/apps/business/esa/windows/v2/2.7.31.0/esa_nt32_nt64_enu.exe.eula/manifest.erm, save to D:\repo1\out3\com\eset\apps\business\esa\windows\v2\2.7.31.0\esa_nt32_nt64_enu.exe.eula\manifest.erm
From hxxp://repository.eset.com/v1/com/eset/apps/business/esa/windows/v2/2.8.23.0/esa_nt32_nt64_enu.exe.eula/manifest.erm, save to D:\repo1\out3\com\eset\apps\business\esa\windows\v2\2.8.23.0\esa_nt32_nt64_enu.exe.eula\manifest.erm

In the "D:\repo1\out3\" directory you already have an offline repository, which is listed by ESMC 7.1, but cannot yet be used to create installers. To do this, the following should be done:
Copy the contents of the "out" directory to the "out3" directory.
Additionally, you must have the following files:

D:\repo1\out3\com\eset\apps\business\eea\windows\v7\7.0.2100.4\eea_nt32.msi
D:\repo1\out3\com\eset\apps\business\es\ms_sharepoint\v7\7.1.15003.0\eshp_nt64.msi

You can create them by copying and renaming them from any of the existing files in the directory. Select the file in your preferred language and copy and rename it. Observe the bitness! For example, "copy eea_nt32_enu.msi eea_nt32.msi" and "copy eea_nt64_enu.msi eea_nt64.msi".

Congratulations. In the "D:\repo1\out3\" directory you already have a fully ready and functioning offline repository. Its size is about 201 GB.

For convenience, I attach the following files:
1 - MirrorTool-full-repository.zip - contains a cmd file to download the repository.
2 - out3.zip - The directory structure of the repository (no files).
4 - copy-rename.zip - contains a cmd file for copying and renaming English files. Change your preferred language as needed.

The attached files work in "D:\repo1\" and "D:\repo1\out3\". Modify as needed for your needs.

I hope this helps you
🍺

========================

##### Share on other sites

• ESET Staff

Just to let you know: please contact me privately (PM) in case you have interest in receiving "new" and not yet published version of MirrorTool which resolves this issue.

##### Share on other sites

• 3 weeks later...

I have the same issue with the Offline Repository and i'm not able to send MartinK a PM.

I wanted to ask if there is any news about the new MirrorTool?

Could you send me the Beta MirrorTool?