Tuesday, June 20, 2017

Building pgModeler

Building pgModeler

This apply to version 0.9.0 and Windows OS. Read first installer instruction on https://pgmodeler.com.br/support/installation; this just adding some clarifications, the instructions (mainly related to QT paths) are a little bit “confused”.

Download and install the prerequisites

Be sure to:

  • Download 32 bits versions for all prerequisites
  • Install them in paths without spaces, like D:\PostgreSQL32\9.6

Qt framework

Download the MingW32 bits version from http://download.qt.io/archive/qt/5.6/5.6.2/qt-opensource-windows-x86-mingw492–5.6.2.exe

Install it in default location; otherwise change the paths below accordingly.

Add C:/Qt/Qt5.6.2/Tools/mingw492_32/bin to system path; at some point the make process will invoke g++ and will not find it otherwise.

PostgreSQL

Download from EnterpriseDB the 32 bits version and install it in D:\PostgreSQL32; otherwise change the paths below accordingly.

If you already have a 64 bits version installed be sure to go services and stop/disable the 32 bits service.

Git

Install Git as instructed

Run the build

Download source code from https://github.com/pgmodeler/pgmodeler.git (watch out the path: no spaces…). Check-out version 0.9.0

Change the pgmodeler.pri acordingly:

windows {
  !defined(PGSQL_LIB, var): PGSQL_LIB = "D:/PostgreSQL32/9.6/lib/libpq.dll"
  !defined(PGSQL_INC, var): PGSQL_INC = "D:/PostgreSQL32/9.6/include"
  !defined(XML_INC, var): XML_INC = "D:/PostgreSQL32/9.6/include"
  !defined(XML_LIB, var): XML_LIB = "D:/PostgreSQL32/9.6/bin/libxml2.dll"
...

Start bash from a command window in pgmodeler directory.

At the command prompt run the commands:

C:/Qt/Qt5.6.2/5.6/mingw49_32/bin/qmake.exe pgmodeler.pro
C:/Qt/Qt5.6.2/Tools/mingw492_32/bin/mingw32-make.exe
C:/Qt/Qt5.6.2/Tools/mingw492_32/bin/mingw32-make.exe  install
cd build
C:/Qt/Qt5.6.2/5.6/mingw49_32/bin/windeployqt pgmodeler.exe

Please be patient, it might take more than 30 minutes…

In order to run build\pgmodeler.exe you have to copy in several libraries from:

  • C:/Qt/Qt5.6.2/5.6/mingw49_32/bin:
    • Qt5*.dll.
  • D:/PostgreSQL32/9.6/
    • lib/libpq.dll
    • bin/libxml2.dll

Now run build\pgmodeler.exe…fingers cross!

PGgxIGlkPSJidWlsZGluZ3BnbW9kZWxlciI+QnVpbGRpbmcgcGdNb2RlbGVyPC9oMT4NCg0K PHA+VGhpcyBhcHBseSB0byB2ZXJzaW9uIDAuOS4wIGFuZCBXaW5kb3dzIE9TLiBSZWFkIGZp cnN0IGluc3RhbGxlciBpbnN0cnVjdGlvbiBvbiA8YSBocmVmPSJodHRwczovL3BnbW9kZWxl ci5jb20uYnIvc3VwcG9ydC9pbnN0YWxsYXRpb24iPmh0dHBzOi8vcGdtb2RlbGVyLmNvbS5i ci9zdXBwb3J0L2luc3RhbGxhdGlvbjwvYT47IHRoaXMganVzdCBhZGRpbmcgc29tZSBjbGFy aWZpY2F0aW9ucywgdGhlIGluc3RydWN0aW9ucyAobWFpbmx5IHJlbGF0ZWQgdG8gUVQgcGF0 aHMpIGFyZSBhIGxpdHRsZSBiaXQgJiM4MjIwO2NvbmZ1c2VkJiM4MjIxOy48L3A+DQoNCjxo MiBpZD0iZG93bmxvYWRhbmRpbnN0YWxsdGhlcHJlcmVxdWlzaXRlcyI+RG93bmxvYWQgYW5k IGluc3RhbGwgdGhlIHByZXJlcXVpc2l0ZXM8L2gyPg0KDQo8cD5CZSBzdXJlIHRvOjwvcD4N Cg0KPHVsPg0KPGxpPkRvd25sb2FkIDMyIGJpdHMgdmVyc2lvbnMgZm9yIGFsbCBwcmVyZXF1 aXNpdGVzPC9saT4NCjxsaT5JbnN0YWxsIHRoZW0gaW4gcGF0aHMgd2l0aG91dCBzcGFjZXMs IGxpa2UgPGNvZGU+RDpcUG9zdGdyZVNRTDMyXDkuNjwvY29kZT48L2xpPg0KPC91bD4NCg0K PGgzIGlkPSJxdGZyYW1ld29yayI+UXQgZnJhbWV3b3JrPC9oMz4NCg0KPHA+RG93bmxvYWQg dGhlIE1pbmdXMzIgYml0cyB2ZXJzaW9uIGZyb20gPGEgaHJlZj0iaHR0cDovL2Rvd25sb2Fk LnF0LmlvL2FyY2hpdmUvcXQvNS42LzUuNi4yL3F0LW9wZW5zb3VyY2Utd2luZG93cy14ODYt bWluZ3c0OTItNS42LjIuZXhlIj5odHRwOi8vZG93bmxvYWQucXQuaW8vYXJjaGl2ZS9xdC81 LjYvNS42LjIvcXQtb3BlbnNvdXJjZS13aW5kb3dzLXg4Ni1taW5ndzQ5MiYjODIxMTs1LjYu Mi5leGU8L2E+IDwvcD4NCg0KPHA+SW5zdGFsbCBpdCBpbiBkZWZhdWx0IGxvY2F0aW9uOyBv dGhlcndpc2UgY2hhbmdlIHRoZSBwYXRocyBiZWxvdyBhY2NvcmRpbmdseS48L3A+DQoNCjxw PkFkZCA8Y29kZT5DOi9RdC9RdDUuNi4yL1Rvb2xzL21pbmd3NDkyXzMyL2JpbjwvY29kZT4g dG8gc3lzdGVtIHBhdGg7IGF0IHNvbWUgcG9pbnQgdGhlIG1ha2UgcHJvY2VzcyB3aWxsIGlu dm9rZSA8Y29kZT5nKys8L2NvZGU+IGFuZCB3aWxsIG5vdCBmaW5kIGl0IG90aGVyd2lzZS48 L3A+DQoNCjxoMyBpZD0icG9zdGdyZXNxbCI+UG9zdGdyZVNRTDwvaDM+DQoNCjxwPkRvd25s b2FkIGZyb20gRW50ZXJwcmlzZURCIHRoZSAzMiBiaXRzIHZlcnNpb24gYW5kIGluc3RhbGwg aXQgaW4gPGNvZGU+RDpcUG9zdGdyZVNRTDMyPC9jb2RlPjsgb3RoZXJ3aXNlIGNoYW5nZSB0 aGUgcGF0aHMgYmVsb3cgYWNjb3JkaW5nbHkuPC9wPg0KDQo8cD5JZiB5b3UgYWxyZWFkeSBo YXZlIGEgNjQgYml0cyB2ZXJzaW9uIGluc3RhbGxlZCBiZSBzdXJlIHRvIGdvIHNlcnZpY2Vz IGFuZCBzdG9wL2Rpc2FibGUgdGhlIDMyIGJpdHMgc2VydmljZS48L3A+DQoNCjxoMyBpZD0i Z2l0Ij5HaXQ8L2gzPg0KDQo8cD5JbnN0YWxsIEdpdCBhcyBpbnN0cnVjdGVkPC9wPg0KDQo8 aDIgaWQ9InJ1bnRoZWJ1aWxkIj5SdW4gdGhlIGJ1aWxkPC9oMj4NCg0KPHA+RG93bmxvYWQg c291cmNlIGNvZGUgZnJvbSA8Y29kZT5odHRwczovL2dpdGh1Yi5jb20vcGdtb2RlbGVyL3Bn bW9kZWxlci5naXQ8L2NvZGU+ICh3YXRjaCBvdXQgdGhlIHBhdGg6IG5vIHNwYWNlcyYjODIz MDspLiBDaGVjay1vdXQgdmVyc2lvbiAwLjkuMCA8L3A+DQoNCjxwPkNoYW5nZSB0aGUgPGNv ZGU+cGdtb2RlbGVyLnByaTwvY29kZT4gYWNvcmRpbmdseTo8L3A+DQoNCjxwcmU+PGNvZGU+ d2luZG93cyB7DQogICFkZWZpbmVkKFBHU1FMX0xJQiwgdmFyKTogUEdTUUxfTElCID0gJnF1 b3Q7RDovUG9zdGdyZVNRTDMyLzkuNi9saWIvbGlicHEuZGxsJnF1b3Q7DQogICFkZWZpbmVk KFBHU1FMX0lOQywgdmFyKTogUEdTUUxfSU5DID0gJnF1b3Q7RDovUG9zdGdyZVNRTDMyLzku Ni9pbmNsdWRlJnF1b3Q7DQogICFkZWZpbmVkKFhNTF9JTkMsIHZhcik6IFhNTF9JTkMgPSAm cXVvdDtEOi9Qb3N0Z3JlU1FMMzIvOS42L2luY2x1ZGUmcXVvdDsNCiAgIWRlZmluZWQoWE1M X0xJQiwgdmFyKTogWE1MX0xJQiA9ICZxdW90O0Q6L1Bvc3RncmVTUUwzMi85LjYvYmluL2xp YnhtbDIuZGxsJnF1b3Q7DQouLi4NCjwvY29kZT48L3ByZT4NCg0KPHA+U3RhcnQgPGNvZGU+ YmFzaDwvY29kZT4gZnJvbSBhIGNvbW1hbmQgd2luZG93IGluIDxzdHJvbmc+cGdtb2RlbGVy PC9zdHJvbmc+IGRpcmVjdG9yeS48L3A+DQoNCjxwPkF0IHRoZSBjb21tYW5kIHByb21wdCBy dW4gdGhlIGNvbW1hbmRzOjwvcD4NCg0KPHByZT48Y29kZT5DOi9RdC9RdDUuNi4yLzUuNi9t aW5ndzQ5XzMyL2Jpbi9xbWFrZS5leGUgcGdtb2RlbGVyLnBybw0KQzovUXQvUXQ1LjYuMi9U b29scy9taW5ndzQ5Ml8zMi9iaW4vbWluZ3czMi1tYWtlLmV4ZQ0KQzovUXQvUXQ1LjYuMi9U b29scy9taW5ndzQ5Ml8zMi9iaW4vbWluZ3czMi1tYWtlLmV4ZSAgaW5zdGFsbA0KY2QgYnVp bGQNCkM6L1F0L1F0NS42LjIvNS42L21pbmd3NDlfMzIvYmluL3dpbmRlcGxveXF0IHBnbW9k ZWxlci5leGUNCjwvY29kZT48L3ByZT4NCg0KPHA+UGxlYXNlIGJlIHBhdGllbnQsIGl0IG1p Z2h0IHRha2UgbW9yZSB0aGFuIDMwIG1pbnV0ZXMmIzgyMzA7PC9wPg0KDQo8cD5JbiBvcmRl ciB0byBydW4gPGNvZGU+YnVpbGRccGdtb2RlbGVyLmV4ZTwvY29kZT4geW91IGhhdmUgdG8g Y29weSBpbiBzZXZlcmFsIGxpYnJhcmllcyBmcm9tOjwvcD4NCg0KPHVsPg0KPGxpPkM6L1F0 L1F0NS42LjIvNS42L21pbmd3NDlfMzIvYmluOg0KDQo8dWw+DQo8bGk+UXQ1Ki5kbGwuPC9s aT4NCjwvdWw+PC9saT4NCjxsaT5EOi9Qb3N0Z3JlU1FMMzIvOS42Lw0KDQo8dWw+DQo8bGk+ bGliL2xpYnBxLmRsbDwvbGk+DQo8bGk+YmluL2xpYnhtbDIuZGxsPC9saT4NCjwvdWw+PC9s aT4NCjwvdWw+DQoNCjxwPk5vdyBydW4gPGNvZGU+YnVpbGRccGdtb2RlbGVyLmV4ZTwvY29k ZT4mIzgyMzA7ZmluZ2VycyBjcm9zcyE8L3A+DQo=

Wednesday, February 8, 2017

Jira SSO

This post applies to cloud hosted Jira, version v1000.747.0 and ADFS as included in Windows Server 2012.

Be sure to add first an administrator with an email outside your mycompany.com domain so that you can connect to Jira if SAML is not configured correctly

Step 1

In order to configure SSO integration we must first register our domain (SITE ADMINISTRATION->User Management), let’s say mycompany.com. A file generated by Jira must be made available over HTTPS at https://mycompany.com/atlassian-domain-verification.html. Plase notice the format of the URL, the right DNS redirection to https://www.mycompany.com/atlassian-domain-verification.html must be configured.

Step 2

Fill in the required information about our Identity Provider (exposed only in Intranet):

  • Identity provider Entity ID: http://ts-adfs.mycompany.local/adfs/services/trust
  • Identity provider SSO URL: https://ts-adfs.mycompany.local/adfs/ls/
  • Public x509 certificate

Step 3

In ADFS create a new Service Provider using the information provided by Jira SAML configuration page:

  • SP Entity ID: https://id.atlassian.com/login
  • SP Assertion Consumer Service URL: https://id.atlassian.com/login/saml/acs

As specified at https://confluence.atlassian.com/purchasing/saml-single-sign-on-for-atlassian-account–860002668.html edit the claim rules adding the following entries (using Active Directory as attribute store):

  • E-Mail-Addresses->E-Mail Addresses
  • Given-Name->Given Name
  • Surname->Surname
  • SAM-Account-Name->UPN

Step 4

Trying to login to Jira now will result in an error (not very specific). By looking into ADFS Windows Logs (Applications and Services Logs->AD FS Tracing->Debug) you will notice something about Name Id not supported format (email). I found the solution at http://wiki.servicenow.com/index.php?title=Configuring_ADFS_3.0_to_Communicate_with_SAML_2.0#ADFS_Relying_Party_Configuration&gsc.tab=0:

  • Add a new rule to existing claims rules, type Transform an Incoming Claim:
  • Select Incoming claim type: E-Mail Address
  • Select Outgoing claim type: Name ID
  • Outgoing name ID format: email

The resulted claim Rule language is:

c:[Type == "http://schemas.xmlsoap.org/ws/2005/05/identity/claims/emailaddress"]
 => issue(Type = "http://schemas.xmlsoap.org/ws/2005/05/identity/claims/nameidentifier", Issuer = c.Issuer, OriginalIssuer = c.OriginalIssuer, Value = c.Value, ValueType = c.ValueType, Properties["http://schemas.xmlsoap.org/ws/2005/05/identity/claimproperties/format"] = "urn:oasis:names:tc:SAML:1.1:nameid-format:emailAddress");

Step 5

Trying to login to Jira now will result in an error about resource not found, this time due by the IIS exposing the ADFS endpoint.

The cause is the default URL limitation of IIS. Perform the steps explaind in https://www.iis.net/configreference/system.webserver/security/requestfiltering/requestlimits:

  • Use IIS administration interface
  • Select Default Site and double click Request Filtering
  • Click on Edit Feature Settings
  • Change:
    • Maximum URL length to 8192
    • Maximum query string to 8000

Step 6

We get now another error due to the query string limitation in ASP.Net as controlled by web.config. Edit web.config as mentioned at https://msdn.microsoft.com/en-us/library/e1f13641(v=vs.100).aspx

  <system.web>
...
    <httpRuntime requestValidationMode="2.0" maxQueryStringLength = "8000" maxUrlLength ="8192"/>
  </system.web>

Finaly

You can login now by just providing email@mycompany.com (depending your browser configuration you will or not be prompted with authentication form by ADFS: see WIA configuration for IE/Chrome for instance).

PHA+VGhpcyBwb3N0IGFwcGxpZXMgdG8gY2xvdWQgaG9zdGVkIEppcmEsIHZlcnNpb24gdjEw MDAuNzQ3LjAgYW5kIEFERlMgYXMgaW5jbHVkZWQgaW4gV2luZG93cyBTZXJ2ZXIgMjAxMi48 L3A+DQoNCjxwPkJlIHN1cmUgdG8gYWRkIGZpcnN0IGFuIGFkbWluaXN0cmF0b3Igd2l0aCBh biBlbWFpbCBvdXRzaWRlIHlvdXIgPGNvZGU+bXljb21wYW55LmNvbTwvY29kZT4gZG9tYWlu IHNvIHRoYXQgeW91IGNhbiBjb25uZWN0IHRvIEppcmEgaWYgU0FNTCBpcyBub3QgY29uZmln dXJlZCBjb3JyZWN0bHk8L3A+DQoNCjxoMSBpZD0ic3RlcDEiPlN0ZXAgMTwvaDE+DQoNCjxw PkluIG9yZGVyIHRvIGNvbmZpZ3VyZSBTU08gaW50ZWdyYXRpb24gd2UgbXVzdCBmaXJzdCBy ZWdpc3RlciBvdXIgZG9tYWluIChTSVRFIEFETUlOSVNUUkFUSU9OLSZndDtVc2VyIE1hbmFn ZW1lbnQpLCBsZXQmIzgyMTc7cyBzYXkgPGNvZGU+bXljb21wYW55LmNvbTwvY29kZT4uIEEg ZmlsZSBnZW5lcmF0ZWQgYnkgSmlyYSBtdXN0IGJlIG1hZGUgYXZhaWxhYmxlIG92ZXIgSFRU UFMgYXQgPGNvZGU+aHR0cHM6Ly9teWNvbXBhbnkuY29tL2F0bGFzc2lhbi1kb21haW4tdmVy aWZpY2F0aW9uLmh0bWw8L2NvZGU+LiBQbGFzZSBub3RpY2UgdGhlIGZvcm1hdCBvZiB0aGUg VVJMLCB0aGUgcmlnaHQgRE5TIHJlZGlyZWN0aW9uIHRvIDxjb2RlPmh0dHBzOi8vd3d3Lm15 Y29tcGFueS5jb20vYXRsYXNzaWFuLWRvbWFpbi12ZXJpZmljYXRpb24uaHRtbDwvY29kZT4g bXVzdCBiZSBjb25maWd1cmVkLjwvcD4NCg0KPGgxIGlkPSJzdGVwMiI+U3RlcCAyPC9oMT4N Cg0KPHA+RmlsbCBpbiB0aGUgcmVxdWlyZWQgaW5mb3JtYXRpb24gYWJvdXQgb3VyIElkZW50 aXR5IFByb3ZpZGVyIChleHBvc2VkIG9ubHkgaW4gSW50cmFuZXQpOjwvcD4NCg0KPHVsPg0K PGxpPklkZW50aXR5IHByb3ZpZGVyIEVudGl0eSBJRDogPGNvZGU+aHR0cDovL3RzLWFkZnMu bXljb21wYW55LmxvY2FsL2FkZnMvc2VydmljZXMvdHJ1c3Q8L2NvZGU+PC9saT4NCjxsaT5J ZGVudGl0eSBwcm92aWRlciBTU08gVVJMOiA8Y29kZT5odHRwczovL3RzLWFkZnMubXljb21w YW55LmxvY2FsL2FkZnMvbHMvPC9jb2RlPjwvbGk+DQo8bGk+UHVibGljIHg1MDkgY2VydGlm aWNhdGU8L2xpPg0KPC91bD4NCg0KPGgxIGlkPSJzdGVwMyI+U3RlcCAzPC9oMT4NCg0KPHA+ SW4gQURGUyBjcmVhdGUgYSBuZXcgU2VydmljZSBQcm92aWRlciB1c2luZyB0aGUgaW5mb3Jt YXRpb24gcHJvdmlkZWQgYnkgSmlyYSBTQU1MIGNvbmZpZ3VyYXRpb24gcGFnZTo8L3A+DQoN Cjx1bD4NCjxsaT5TUCBFbnRpdHkgSUQ6IDxjb2RlPmh0dHBzOi8vaWQuYXRsYXNzaWFuLmNv bS9sb2dpbjwvY29kZT48L2xpPg0KPGxpPlNQIEFzc2VydGlvbiBDb25zdW1lciBTZXJ2aWNl IFVSTDogPGNvZGU+aHR0cHM6Ly9pZC5hdGxhc3NpYW4uY29tL2xvZ2luL3NhbWwvYWNzPC9j b2RlPjwvbGk+DQo8L3VsPg0KDQo8cD5BcyBzcGVjaWZpZWQgYXQgPGEgaHJlZj0iaHR0cHM6 Ly9jb25mbHVlbmNlLmF0bGFzc2lhbi5jb20vcHVyY2hhc2luZy9zYW1sLXNpbmdsZS1zaWdu LW9uLWZvci1hdGxhc3NpYW4tYWNjb3VudC04NjAwMDI2NjguaHRtbCI+aHR0cHM6Ly9jb25m bHVlbmNlLmF0bGFzc2lhbi5jb20vcHVyY2hhc2luZy9zYW1sLXNpbmdsZS1zaWduLW9uLWZv ci1hdGxhc3NpYW4tYWNjb3VudCYjODIxMTs4NjAwMDI2NjguaHRtbDwvYT4gZWRpdCB0aGUg Y2xhaW0gcnVsZXMgYWRkaW5nIHRoZSBmb2xsb3dpbmcgZW50cmllcyAodXNpbmcgQWN0aXZl IERpcmVjdG9yeSBhcyBhdHRyaWJ1dGUgc3RvcmUpOjwvcD4NCg0KPHVsPg0KPGxpPkUtTWFp bC1BZGRyZXNzZXMtJmd0O0UtTWFpbCBBZGRyZXNzZXM8L2xpPg0KPGxpPkdpdmVuLU5hbWUt Jmd0O0dpdmVuIE5hbWU8L2xpPg0KPGxpPlN1cm5hbWUtJmd0O1N1cm5hbWU8L2xpPg0KPGxp PlNBTS1BY2NvdW50LU5hbWUtJmd0O1VQTjwvbGk+DQo8L3VsPg0KDQo8aDEgaWQ9InN0ZXA0 Ij5TdGVwIDQ8L2gxPg0KDQo8cD5UcnlpbmcgdG8gbG9naW4gdG8gSmlyYSBub3cgd2lsbCBy ZXN1bHQgaW4gYW4gZXJyb3IgKG5vdCB2ZXJ5IHNwZWNpZmljKS4gQnkgbG9va2luZyBpbnRv IEFERlMgV2luZG93cyBMb2dzIChBcHBsaWNhdGlvbnMgYW5kIFNlcnZpY2VzIExvZ3MtJmd0 O0FEIEZTIFRyYWNpbmctJmd0O0RlYnVnKSB5b3Ugd2lsbCBub3RpY2Ugc29tZXRoaW5nIGFi b3V0IE5hbWUgSWQgbm90IHN1cHBvcnRlZCBmb3JtYXQgKGVtYWlsKS4NCkkgZm91bmQgdGhl IHNvbHV0aW9uIGF0IDxhIGhyZWY9Imh0dHA6Ly93aWtpLnNlcnZpY2Vub3cuY29tL2luZGV4 LnBocD90aXRsZT1Db25maWd1cmluZ19BREZTXzMuMF90b19Db21tdW5pY2F0ZV93aXRoX1NB TUxfMi4wI0FERlNfUmVseWluZ19QYXJ0eV9Db25maWd1cmF0aW9uJmFtcDtnc2MudGFiPTAi Pmh0dHA6Ly93aWtpLnNlcnZpY2Vub3cuY29tL2luZGV4LnBocD90aXRsZT1Db25maWd1cmlu Z19BREZTXzMuMF90b19Db21tdW5pY2F0ZV93aXRoX1NBTUxfMi4wI0FERlNfUmVseWluZ19Q YXJ0eV9Db25maWd1cmF0aW9uJmFtcDtnc2MudGFiPTA8L2E+OjwvcD4NCg0KPHVsPg0KPGxp PkFkZCBhIG5ldyBydWxlIHRvIGV4aXN0aW5nIGNsYWltcyBydWxlcywgdHlwZSA8Y29kZT5U cmFuc2Zvcm0gYW4gSW5jb21pbmcgQ2xhaW08L2NvZGU+OjwvbGk+DQo8bGk+U2VsZWN0IElu Y29taW5nIGNsYWltIHR5cGU6IEUtTWFpbCBBZGRyZXNzPC9saT4NCjxsaT5TZWxlY3QgT3V0 Z29pbmcgY2xhaW0gdHlwZTogTmFtZSBJRDwvbGk+DQo8bGk+T3V0Z29pbmcgbmFtZSBJRCBm b3JtYXQ6IGVtYWlsPC9saT4NCjwvdWw+DQoNCjxwPlRoZSByZXN1bHRlZCBjbGFpbSBSdWxl IGxhbmd1YWdlIGlzOjwvcD4NCg0KPHByZT48Y29kZT5jOltUeXBlID09ICZxdW90O2h0dHA6 Ly9zY2hlbWFzLnhtbHNvYXAub3JnL3dzLzIwMDUvMDUvaWRlbnRpdHkvY2xhaW1zL2VtYWls YWRkcmVzcyZxdW90O10NCiA9Jmd0OyBpc3N1ZShUeXBlID0gJnF1b3Q7aHR0cDovL3NjaGVt YXMueG1sc29hcC5vcmcvd3MvMjAwNS8wNS9pZGVudGl0eS9jbGFpbXMvbmFtZWlkZW50aWZp ZXImcXVvdDssIElzc3VlciA9IGMuSXNzdWVyLCBPcmlnaW5hbElzc3VlciA9IGMuT3JpZ2lu YWxJc3N1ZXIsIFZhbHVlID0gYy5WYWx1ZSwgVmFsdWVUeXBlID0gYy5WYWx1ZVR5cGUsIFBy b3BlcnRpZXNbJnF1b3Q7aHR0cDovL3NjaGVtYXMueG1sc29hcC5vcmcvd3MvMjAwNS8wNS9p ZGVudGl0eS9jbGFpbXByb3BlcnRpZXMvZm9ybWF0JnF1b3Q7XSA9ICZxdW90O3VybjpvYXNp czpuYW1lczp0YzpTQU1MOjEuMTpuYW1laWQtZm9ybWF0OmVtYWlsQWRkcmVzcyZxdW90Oyk7 DQoNCjwvY29kZT48L3ByZT4NCg0KPGgxIGlkPSJzdGVwNSI+U3RlcCA1PC9oMT4NCg0KPHA+ VHJ5aW5nIHRvIGxvZ2luIHRvIEppcmEgbm93IHdpbGwgcmVzdWx0IGluIGFuIGVycm9yIGFi b3V0IHJlc291cmNlIG5vdCBmb3VuZCwgdGhpcyB0aW1lIGR1ZSBieSB0aGUgSUlTIGV4cG9z aW5nIHRoZSBBREZTIGVuZHBvaW50LjwvcD4NCg0KPHA+VGhlIGNhdXNlIGlzIHRoZSBkZWZh dWx0IFVSTCBsaW1pdGF0aW9uIG9mIElJUy4gUGVyZm9ybSB0aGUgc3RlcHMgZXhwbGFpbmQg aW4gPGEgaHJlZj0iaHR0cHM6Ly93d3cuaWlzLm5ldC9jb25maWdyZWZlcmVuY2Uvc3lzdGVt LndlYnNlcnZlci9zZWN1cml0eS9yZXF1ZXN0ZmlsdGVyaW5nL3JlcXVlc3RsaW1pdHMiPmh0 dHBzOi8vd3d3Lmlpcy5uZXQvY29uZmlncmVmZXJlbmNlL3N5c3RlbS53ZWJzZXJ2ZXIvc2Vj dXJpdHkvcmVxdWVzdGZpbHRlcmluZy9yZXF1ZXN0bGltaXRzPC9hPjo8L3A+DQoNCjx1bD4N CjxsaT5Vc2UgSUlTIGFkbWluaXN0cmF0aW9uIGludGVyZmFjZTwvbGk+DQo8bGk+U2VsZWN0 IERlZmF1bHQgU2l0ZSBhbmQgZG91YmxlIGNsaWNrIFJlcXVlc3QgRmlsdGVyaW5nPC9saT4N CjxsaT5DbGljayBvbiBFZGl0IEZlYXR1cmUgU2V0dGluZ3M8L2xpPg0KPGxpPkNoYW5nZToN Cg0KPHVsPg0KPGxpPk1heGltdW0gVVJMIGxlbmd0aCB0byA4MTkyPC9saT4NCjxsaT5NYXhp bXVtIHF1ZXJ5IHN0cmluZyB0byA4MDAwPC9saT4NCjwvdWw+PC9saT4NCjwvdWw+DQoNCjxo MSBpZD0ic3RlcDYiPlN0ZXAgNjwvaDE+DQoNCjxwPldlIGdldCBub3cgYW5vdGhlciBlcnJv ciBkdWUgdG8gdGhlIHF1ZXJ5IHN0cmluZyBsaW1pdGF0aW9uIGluIEFTUC5OZXQgYXMgY29u dHJvbGxlZCBieSA8Y29kZT53ZWIuY29uZmlnPC9jb2RlPi4NCkVkaXQgPGNvZGU+d2ViLmNv bmZpZzwvY29kZT4gYXMgbWVudGlvbmVkIGF0IDxhIGhyZWY9Imh0dHBzOi8vbXNkbi5taWNy b3NvZnQuY29tL2VuLXVzL2xpYnJhcnkvZTFmMTM2NDEodj12cy4xMDApLmFzcHgiPmh0dHBz Oi8vbXNkbi5taWNyb3NvZnQuY29tL2VuLXVzL2xpYnJhcnkvZTFmMTM2NDEodj12cy4xMDAp LmFzcHg8L2E+PC9wPg0KDQo8cHJlPjxjb2RlIGNsYXNzPSJ4bWwiPiAgJmx0O3N5c3RlbS53 ZWImZ3Q7DQouLi4NCiAgICAmbHQ7aHR0cFJ1bnRpbWUgcmVxdWVzdFZhbGlkYXRpb25Nb2Rl PSZxdW90OzIuMCZxdW90OyBtYXhRdWVyeVN0cmluZ0xlbmd0aCA9ICZxdW90OzgwMDAmcXVv dDsgbWF4VXJsTGVuZ3RoID0mcXVvdDs4MTkyJnF1b3Q7LyZndDsNCiAgJmx0Oy9zeXN0ZW0u d2ViJmd0Ow0KPC9jb2RlPjwvcHJlPg0KDQo8aDEgaWQ9ImZpbmFseSI+RmluYWx5PC9oMT4N Cg0KPHA+WW91IGNhbiBsb2dpbiBub3cgYnkganVzdCBwcm92aWRpbmcgPGNvZGU+ZW1haWxA bXljb21wYW55LmNvbTwvY29kZT4gKGRlcGVuZGluZyB5b3VyIGJyb3dzZXIgY29uZmlndXJh dGlvbiB5b3Ugd2lsbCBvciBub3QgYmUgcHJvbXB0ZWQgd2l0aCBhdXRoZW50aWNhdGlvbiBm b3JtIGJ5IEFERlM6IHNlZSBXSUEgY29uZmlndXJhdGlvbiBmb3IgSUUvQ2hyb21lIGZvciBp bnN0YW5jZSkuPC9wPg0K

OTRS Too Many Connections

Running OTRS on MySQL you might get seldom ‘Too Many Connections’ Error.

This happened recently on my company’s OTRS implementation; I’m just recording findings, nothing to blame neither OTRS nor MySQL!

Facts

After several years of successfully running OTRS on CENTOS/MySQL (MyISAM storage engine) we suddenly started facing daily customers/agents complaining about not being able to use the system any more while getting ‘Too Many Connections’ error. Outage lasted tens of minutes and disappeared without any intervention.

During outage we were unable to open MySQL Workbrench to check through Client Connections what was happening.

Findings

After several such events we decided to leave open an instance of MySQL Workbrench with Client Connection active. When next event occurred we noticed that there was a client connection running a long lasting query with state ‘Copy data to tmp table’ while all other connections were in ‘Locked’ state. Please notice that MyISAM:

  • Has only full table lock granularity;
  • Caches only indexes, not data
  • Data cache is left at OS operating mercy

Running the query once again we noticed: - it took no time to complete - after clearing the query cache (RESET QUERY CACHE;) it took 5 seconds - after clearing OS disk cache (CentOS) through echo 3 > /proc/sys/vm/drop_caches (see Clear Disk Cache ) the query took over 180 seconds.

Conclusion

Due to some facts (…?) at some point there was a query triggered by a client action, query that lasts very long. During this period one of the most used table becomes locked so any subsequent queries will become locked waiting the initial query to finish. OTRS client, noticing no response from the system, will try refreshing the page or clicking once again some link which in turn will trigger server side opening of a new MySQL connection till the default 151 connections is hit.

Solution

After increasing the OS memory from 6 GB to 12 GB and key_buffer_size to 3 GB (a little bit to defensive) we encountered no more errors.

Some useful MySQL queries

SHOW STATUS LIKE 'key%';
SHOW VARIABLES LIKE 'key%';

SHOW VARIABLES LIKE 'max_heap_table_size';

SHOW STATUS LIKE '%tmp%';

RESET QUERY CACHE;

show engines;

PGgxIGlkPSJydW5uaW5nb3Ryc29ubXlzcWx5b3VtaWdodGdldHNlbGRvbXRvb21hbnljb25u ZWN0aW9uc2Vycm9yLiI+UnVubmluZyBPVFJTIG9uIE15U1FMIHlvdSBtaWdodCBnZXQgc2Vs ZG9tICYjODIxNjtUb28gTWFueSBDb25uZWN0aW9ucyYjODIxNzsgRXJyb3IuPC9oMT4NCg0K PHA+VGhpcyBoYXBwZW5lZCByZWNlbnRseSBvbiBteSBjb21wYW55JiM4MjE3O3MgT1RSUyBp bXBsZW1lbnRhdGlvbjsgSSYjODIxNzttIGp1c3QgcmVjb3JkaW5nIGZpbmRpbmdzLCBub3Ro aW5nIHRvIGJsYW1lIG5laXRoZXIgT1RSUyBub3IgTXlTUUwhPC9wPg0KDQo8aDIgaWQ9ImZh Y3RzIj5GYWN0czwvaDI+DQoNCjxwPkFmdGVyIHNldmVyYWwgeWVhcnMgb2Ygc3VjY2Vzc2Z1 bGx5IHJ1bm5pbmcgT1RSUyBvbiBDRU5UT1MvTXlTUUwgKE15SVNBTSBzdG9yYWdlIGVuZ2lu ZSkgd2Ugc3VkZGVubHkgc3RhcnRlZCBmYWNpbmcgZGFpbHkgY3VzdG9tZXJzL2FnZW50cyBj b21wbGFpbmluZyBhYm91dCBub3QgYmVpbmcgYWJsZSB0byB1c2UgdGhlIHN5c3RlbSBhbnkg bW9yZSB3aGlsZSBnZXR0aW5nICYjODIxNjtUb28gTWFueSBDb25uZWN0aW9ucyYjODIxNzsg ZXJyb3IuIE91dGFnZSBsYXN0ZWQgdGVucyBvZiBtaW51dGVzIGFuZCBkaXNhcHBlYXJlZCB3 aXRob3V0IGFueSBpbnRlcnZlbnRpb24uPC9wPg0KDQo8cD5EdXJpbmcgb3V0YWdlIHdlIHdl cmUgdW5hYmxlIHRvIG9wZW4gTXlTUUwgV29ya2JyZW5jaCB0byBjaGVjayB0aHJvdWdoIENs aWVudCBDb25uZWN0aW9ucyB3aGF0IHdhcyBoYXBwZW5pbmcuPC9wPg0KDQo8aDIgaWQ9ImZp bmRpbmdzIj5GaW5kaW5nczwvaDI+DQoNCjxwPkFmdGVyIHNldmVyYWwgc3VjaCBldmVudHMg d2UgZGVjaWRlZCB0byBsZWF2ZSBvcGVuIGFuIGluc3RhbmNlIG9mIE15U1FMIFdvcmticmVu Y2ggd2l0aCBDbGllbnQgQ29ubmVjdGlvbiBhY3RpdmUuIFdoZW4gbmV4dCBldmVudCBvY2N1 cnJlZCB3ZSBub3RpY2VkIHRoYXQgdGhlcmUgd2FzIGEgY2xpZW50IGNvbm5lY3Rpb24gcnVu bmluZyBhIGxvbmcgbGFzdGluZyBxdWVyeSB3aXRoIHN0YXRlICYjODIxNjtDb3B5IGRhdGEg dG8gdG1wIHRhYmxlJiM4MjE3OyB3aGlsZSBhbGwgb3RoZXIgY29ubmVjdGlvbnMgd2VyZSBp biAmIzgyMTY7TG9ja2VkJiM4MjE3OyBzdGF0ZS4NClBsZWFzZSBub3RpY2UgdGhhdCBNeUlT QU06PC9wPg0KDQo8dWw+DQo8bGk+SGFzIG9ubHkgZnVsbCB0YWJsZSBsb2NrIGdyYW51bGFy aXR5OzwvbGk+DQo8bGk+Q2FjaGVzIG9ubHkgaW5kZXhlcywgbm90IGRhdGE8L2xpPg0KPGxp PkRhdGEgY2FjaGUgaXMgbGVmdCBhdCBPUyBvcGVyYXRpbmcgbWVyY3k8L2xpPg0KPC91bD4N Cg0KPHA+UnVubmluZyB0aGUgcXVlcnkgb25jZSBhZ2FpbiB3ZSBub3RpY2VkOg0KLSBpdCB0 b29rIG5vIHRpbWUgdG8gY29tcGxldGUNCi0gYWZ0ZXIgY2xlYXJpbmcgdGhlIHF1ZXJ5IGNh Y2hlICg8Y29kZT5SRVNFVCBRVUVSWSBDQUNIRTs8L2NvZGU+KSBpdCB0b29rIDUgc2Vjb25k cw0KLSBhZnRlciBjbGVhcmluZyBPUyBkaXNrIGNhY2hlIChDZW50T1MpIHRocm91Z2ggPGNv ZGU+ZWNobyAzICZndDsgL3Byb2Mvc3lzL3ZtL2Ryb3BfY2FjaGVzPC9jb2RlPiAoc2VlIDxh IGhyZWY9Imh0dHA6Ly9zdGFja292ZXJmbG93LmNvbS9xdWVzdGlvbnMvOTU1MTgzOC9ob3ct dG8tcHVyZ2UtZGlzay1pLW8tY2FjaGVzLW9uLWxpbnV4IiB0aXRsZT0iQ2xlYXIgRGlzayBD YWNoZSI+Q2xlYXIgRGlzayBDYWNoZTwvYT4gKSB0aGUgcXVlcnkgdG9vayBvdmVyIDE4MCBz ZWNvbmRzLjwvcD4NCg0KPGgyIGlkPSJjb25jbHVzaW9uIj5Db25jbHVzaW9uPC9oMj4NCg0K PHA+RHVlIHRvIHNvbWUgZmFjdHMgKCYjODIzMDs/KSBhdCBzb21lIHBvaW50IHRoZXJlIHdh cyBhIHF1ZXJ5IHRyaWdnZXJlZCBieSBhIGNsaWVudCBhY3Rpb24sIHF1ZXJ5IHRoYXQgbGFz dHMgdmVyeSBsb25nLiBEdXJpbmcgdGhpcyBwZXJpb2Qgb25lIG9mIHRoZSBtb3N0IHVzZWQg dGFibGUgYmVjb21lcyBsb2NrZWQgc28gYW55IHN1YnNlcXVlbnQgcXVlcmllcyB3aWxsIGJl Y29tZSBsb2NrZWQgd2FpdGluZyB0aGUgaW5pdGlhbCBxdWVyeSB0byBmaW5pc2guIE9UUlMg Y2xpZW50LCBub3RpY2luZyBubyByZXNwb25zZSBmcm9tIHRoZSBzeXN0ZW0sIHdpbGwgdHJ5 IHJlZnJlc2hpbmcgdGhlIHBhZ2Ugb3IgY2xpY2tpbmcgb25jZSBhZ2FpbiBzb21lIGxpbmsg d2hpY2ggaW4gdHVybiB3aWxsIHRyaWdnZXIgc2VydmVyIHNpZGUgb3BlbmluZyBvZiBhIG5l dyBNeVNRTCBjb25uZWN0aW9uIHRpbGwgdGhlIGRlZmF1bHQgMTUxIGNvbm5lY3Rpb25zIGlz IGhpdC48L3A+DQoNCjxoMiBpZD0ic29sdXRpb24iPlNvbHV0aW9uPC9oMj4NCg0KPHA+QWZ0 ZXIgaW5jcmVhc2luZyB0aGUgT1MgbWVtb3J5IGZyb20gNiBHQiB0byAxMiBHQiBhbmQgPGNv ZGU+a2V5X2J1ZmZlcl9zaXplPC9jb2RlPiB0byAzIEdCIChhIGxpdHRsZSBiaXQgdG8gZGVm ZW5zaXZlKSB3ZSBlbmNvdW50ZXJlZCBubyBtb3JlIGVycm9ycy48L3A+DQoNCjxoMiBpZD0i c29tZXVzZWZ1bG15c3FscXVlcmllcyI+U29tZSB1c2VmdWwgTXlTUUwgcXVlcmllczwvaDI+ DQoNCjxwcmU+PGNvZGUgY2xhc3M9InNxbCI+U0hPVyBTVEFUVVMgTElLRSAna2V5JSc7DQpT SE9XIFZBUklBQkxFUyBMSUtFICdrZXklJzsNCg0KU0hPVyBWQVJJQUJMRVMgTElLRSAnbWF4 X2hlYXBfdGFibGVfc2l6ZSc7DQoNClNIT1cgU1RBVFVTIExJS0UgJyV0bXAlJzsNCg0KUkVT RVQgUVVFUlkgQ0FDSEU7DQoNCnNob3cgZW5naW5lczsNCg0KPC9jb2RlPjwvcHJlPg0K

Piwik Installation

This applies to Ubuntu 16.04 LTS.

Compiled from https://www.howtoforge.com/tutorial/installing-nginx-with-php7-fpm-and-mysql-on-ubuntu–16.04-lts-lemp/

Install MySQL

See also https://support.rackspace.com/how-to/configuring-mysql-server-on-ubuntu/

Run the following and provide the appropriate answers to subsequent prompts: apt-get -y install mysql-server mysql_secure_installation If you want to manage your MySQL instance from external computers choose No to the question Disallow root login remotely? and change the mysql.conf (usually found in /etc/mysql/mysql.conf.d/mysqld.cnf) and set the bind-address parameter to 0.0.0.0. To find the actual path for the configuration file run /usr/sbin/mysqld --help --verbose If you install Piwik on the same machine this is not required.

Create database/user for Piwik

$ mysql -u root -p
mysql> CREATE DATABASE piwik;
mysql> CREATE USER 'piwik'@'localhost' IDENTIFIED BY 'change_to_real_password';
mysql> GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP, ALTER, CREATE TEMPORARY TABLES, LOCK TABLES ON piwik.* TO 'piwik'@'localhost';
mysql> EXIT

Install Nginx

If you have already installed Apache, remove it:

service apache2 stop
update-rc.d -f apache2 remove
apt-get remove apache2
sudo -i
apt-get update
apt-get -y install nginx

Check the status of the firewall

Nginx registers itself with ufw so:

  • Check of ufw is enabled: ufw status
  • If enabled then register one of the Nginx registered profiles (found out by running ufw app list) like:
    • ufw allow 'Nginx HTTP'

Check Nginx

From within a browser try http://\<IP\>

Install PHP 7

apt-get -y install php7.0-fpm

Modify default site configuration file /etc/nginx/sites-available/default by de-commenting the following lines:

...
    location ~ \.php$ {
        include snippets/fastcgi-php.conf;
...
        fastcgi_pass unix:/run/php/php7.0-fpm.sock;
    }

...
    location ~ /\.ht {
        deny all;
    }

Reload Nginx:

service nginx reload

Open /etc/php/7.0/fpm/php.ini and set cgi.fix_pathinfo=0: Restart php:

service php7.0-fpm reload

Check the installation

Create info.php in /var/www/html/info.php with the following content:

<?php
phpinfo();
?>

Watch out for CRLFs on Windows (end of line should be \n regularly in Linux).

Try now http://<IP>/info.php

Install additional packages required by Piwik

apt-get -y install php7.0-curl php7.0-gd php7.0-cli php-geoip php7.0-mysql
apt-get -y install php-mbstring php7.0-mbstring
apt-get -y install php-xml

Install Piwik

Run:

cd /tmp
apt-get install unzip
wget https://builds.piwik.org/piwik.zip && unzip piwik.zip
mkdir /var/www//html/piwik
cp -R ./piwik/* /var/www/html/piwik
chown -R www-data:www-data /var/www/html/piwik
chmod -R 0755 /var/www/html/piwik/tmp

Now browse to http://<FQDN>/piwik/index.php

Configure your Piwik instance. The following script-let should be included in each page of your site (as specified by the setup:Make sure this code is on every page of your website. We recommend to paste it immediately before the closing </head> tag.). Be sure to change the <FQDN> with the appropriate value.

<!-- Piwik -->
<script type="text/javascript">
  var _paq = _paq || [];
  // tracker methods like "setCustomDimension" should be called before "trackPageView"
  _paq.push(['trackPageView']);
  _paq.push(['enableLinkTracking']);
  (function() {
    var u="//<FQDN>/piwik/";
    _paq.push(['setTrackerUrl', u+'piwik.php']);
    _paq.push(['setSiteId', '1']);
    var d=document, g=d.createElement('script'), s=d.getElementsByTagName('script')[0];
    g.type='text/javascript'; g.async=true; g.defer=true; g.src=u+'piwik.js'; s.parentNode.insertBefore(g,s);
  })();
</script>
<!-- End Piwik Code -->

Publishing Problem

The monitored site had some peculiarities:

  • It is used from intranet or from internet, published through a reverse proxy
  • It can be used over plain HTTP or over HTTPS (through SSO or from internet); when used over HTTP from intranet it worked fine but over HTTPS (also from intranet) the request to Piwik (due to security reasons) was also done over HTTPS which obviously failed (the //<FQDN>/piwik/ syntax indicates to the browser to make the request over the same protocol as the referral page was loaded)

So overall the default Piwik installation didn’t work since it was not accessible through HTTPS nor from internet.

The first step was to publish the site through the same reverse proxy, both HTTP and HTTPS (with the tunnel being terminated at proxy level) with Forward Original HOST Header set to Off. Trying to access the administrative interface through the public FQDN led to a security error (something with actual Referral not matching the expected one).

Next step was to change the proxy settings so that the original HOST header was forwarded to Piwik. Another error popped up stating (as a conclusion, the error text was rather stupid like Piwik was accessed from [URL] but it was configured to be accessed from [URL]) that the value of the HOST header is not registered as safe in config\config.ini.php.

By adding the FQDN in [General] section as:

trusted_hosts[] = "FQDN"

the integration works just fine.

PHA+VGhpcyBhcHBsaWVzIHRvIFVidW50dSAxNi4wNCBMVFMuPC9wPg0KDQo8cD5Db21waWxl ZCBmcm9tIDxhIGhyZWY9Imh0dHBzOi8vd3d3Lmhvd3RvZm9yZ2UuY29tL3R1dG9yaWFsL2lu c3RhbGxpbmctbmdpbngtd2l0aC1waHA3LWZwbS1hbmQtbXlzcWwtb24tdWJ1bnR1LTE2LjA0 LWx0cy1sZW1wLyI+aHR0cHM6Ly93d3cuaG93dG9mb3JnZS5jb20vdHV0b3JpYWwvaW5zdGFs bGluZy1uZ2lueC13aXRoLXBocDctZnBtLWFuZC1teXNxbC1vbi11YnVudHUmIzgyMTE7MTYu MDQtbHRzLWxlbXAvPC9hPjwvcD4NCg0KPGgxIGlkPSJpbnN0YWxsbXlzcWwiPkluc3RhbGwg TXlTUUw8L2gxPg0KDQo8cD5TZWUgYWxzbyA8YSBocmVmPSJodHRwczovL3N1cHBvcnQucmFj a3NwYWNlLmNvbS9ob3ctdG8vY29uZmlndXJpbmctbXlzcWwtc2VydmVyLW9uLXVidW50dS8i Pmh0dHBzOi8vc3VwcG9ydC5yYWNrc3BhY2UuY29tL2hvdy10by9jb25maWd1cmluZy1teXNx bC1zZXJ2ZXItb24tdWJ1bnR1LzwvYT48L3A+DQoNCjxwPlJ1biB0aGUgZm9sbG93aW5nIGFu ZCBwcm92aWRlIHRoZSBhcHByb3ByaWF0ZSBhbnN3ZXJzIHRvIHN1YnNlcXVlbnQgcHJvbXB0 czoNCjxjb2RlPg0KYXB0LWdldCAteSBpbnN0YWxsIG15c3FsLXNlcnZlcg0KbXlzcWxfc2Vj dXJlX2luc3RhbGxhdGlvbg0KPC9jb2RlPg0KSWYgeW91IHdhbnQgdG8gbWFuYWdlIHlvdXIg TXlTUUwgaW5zdGFuY2UgZnJvbSBleHRlcm5hbCBjb21wdXRlcnMgY2hvb3NlIE5vIHRvIHRo ZSBxdWVzdGlvbiA8Y29kZT5EaXNhbGxvdyByb290IGxvZ2luIHJlbW90ZWx5PzwvY29kZT4g YW5kIGNoYW5nZSB0aGUgPGNvZGU+bXlzcWwuY29uZjwvY29kZT4gKHVzdWFsbHkgZm91bmQg aW4gPGNvZGU+L2V0Yy9teXNxbC9teXNxbC5jb25mLmQvbXlzcWxkLmNuZjwvY29kZT4pIGFu ZCBzZXQgdGhlIDxjb2RlPmJpbmQtYWRkcmVzczwvY29kZT4gcGFyYW1ldGVyIHRvIDxjb2Rl PjAuMC4wLjA8L2NvZGU+Lg0KVG8gZmluZCB0aGUgYWN0dWFsIHBhdGggZm9yIHRoZSBjb25m aWd1cmF0aW9uIGZpbGUgcnVuIDxjb2RlPi91c3Ivc2Jpbi9teXNxbGQgLS1oZWxwIC0tdmVy Ym9zZTwvY29kZT4NCklmIHlvdSBpbnN0YWxsIFBpd2lrIG9uIHRoZSBzYW1lIG1hY2hpbmUg dGhpcyBpcyBub3QgcmVxdWlyZWQuPC9wPg0KDQo8aDIgaWQ9ImNyZWF0ZWRhdGFiYXNldXNl cmZvcnBpd2lrIj5DcmVhdGUgZGF0YWJhc2UvdXNlciBmb3IgUGl3aWs8L2gyPg0KDQo8cHJl Pjxjb2RlPiQgbXlzcWwgLXUgcm9vdCAtcA0KbXlzcWwmZ3Q7IENSRUFURSBEQVRBQkFTRSBw aXdpazsNCm15c3FsJmd0OyBDUkVBVEUgVVNFUiAncGl3aWsnQCdsb2NhbGhvc3QnIElERU5U SUZJRUQgQlkgJ2NoYW5nZV90b19yZWFsX3Bhc3N3b3JkJzsNCm15c3FsJmd0OyBHUkFOVCBT RUxFQ1QsIElOU0VSVCwgVVBEQVRFLCBERUxFVEUsIENSRUFURSwgRFJPUCwgQUxURVIsIENS RUFURSBURU1QT1JBUlkgVEFCTEVTLCBMT0NLIFRBQkxFUyBPTiBwaXdpay4qIFRPICdwaXdp aydAJ2xvY2FsaG9zdCc7DQpteXNxbCZndDsgRVhJVA0KPC9jb2RlPjwvcHJlPg0KDQo8aDEg aWQ9Imluc3RhbGxuZ2lueCI+SW5zdGFsbCBOZ2lueDwvaDE+DQoNCjxwPklmIHlvdSBoYXZl IGFscmVhZHkgaW5zdGFsbGVkIEFwYWNoZSwgcmVtb3ZlIGl0OjwvcD4NCg0KPHByZT48Y29k ZT5zZXJ2aWNlIGFwYWNoZTIgc3RvcA0KdXBkYXRlLXJjLmQgLWYgYXBhY2hlMiByZW1vdmUN CmFwdC1nZXQgcmVtb3ZlIGFwYWNoZTINCjwvY29kZT48L3ByZT4NCg0KPHByZT48Y29kZT5z dWRvIC1pDQphcHQtZ2V0IHVwZGF0ZQ0KYXB0LWdldCAteSBpbnN0YWxsIG5naW54DQo8L2Nv ZGU+PC9wcmU+DQoNCjxoMiBpZD0iY2hlY2t0aGVzdGF0dXNvZnRoZWZpcmV3YWxsIj5DaGVj ayB0aGUgc3RhdHVzIG9mIHRoZSBmaXJld2FsbDwvaDI+DQoNCjxwPjxjb2RlPk5naW54PC9j b2RlPiByZWdpc3RlcnMgaXRzZWxmIHdpdGggPGNvZGU+dWZ3PC9jb2RlPiBzbzo8L3A+DQoN Cjx1bD4NCjxsaT5DaGVjayBvZiA8Y29kZT51Znc8L2NvZGU+IGlzIGVuYWJsZWQ6IDxjb2Rl PnVmdyBzdGF0dXM8L2NvZGU+PC9saT4NCjxsaT5JZiBlbmFibGVkIHRoZW4gcmVnaXN0ZXIg b25lIG9mIHRoZSA8Y29kZT5OZ2lueDwvY29kZT4gcmVnaXN0ZXJlZCBwcm9maWxlcyAoZm91 bmQgb3V0IGJ5IHJ1bm5pbmcgPGNvZGU+dWZ3IGFwcCBsaXN0PC9jb2RlPikgbGlrZToNCg0K PHVsPg0KPGxpPjxjb2RlPnVmdyBhbGxvdyAnTmdpbnggSFRUUCc8L2NvZGU+PC9saT4NCjwv dWw+PC9saT4NCjwvdWw+DQoNCjxoMiBpZD0iY2hlY2tuZ2lueCI+Q2hlY2sgTmdpbng8L2gy Pg0KDQo8cD5Gcm9tIHdpdGhpbiBhIGJyb3dzZXIgdHJ5IDxjb2RlPmh0dHA6Ly9cJmx0O0lQ XCZndDs8L2NvZGU+PC9wPg0KDQo8aDEgaWQ9Imluc3RhbGxwaHA3Ij5JbnN0YWxsIFBIUCA3 PC9oMT4NCg0KPHByZT48Y29kZT5hcHQtZ2V0IC15IGluc3RhbGwgcGhwNy4wLWZwbQ0KPC9j b2RlPjwvcHJlPg0KDQo8cD5Nb2RpZnkgZGVmYXVsdCBzaXRlIGNvbmZpZ3VyYXRpb24gZmls ZSA8Y29kZT4vZXRjL25naW54L3NpdGVzLWF2YWlsYWJsZS9kZWZhdWx0PC9jb2RlPiBieSBk ZS1jb21tZW50aW5nIHRoZSBmb2xsb3dpbmcgbGluZXM6PC9wPg0KDQo8cHJlPjxjb2RlPi4u Lg0KICAgIGxvY2F0aW9uIH4gXC5waHAkIHsNCiAgICAgICAgaW5jbHVkZSBzbmlwcGV0cy9m YXN0Y2dpLXBocC5jb25mOw0KLi4uDQogICAgICAgIGZhc3RjZ2lfcGFzcyB1bml4Oi9ydW4v cGhwL3BocDcuMC1mcG0uc29jazsNCiAgICB9DQoNCi4uLg0KICAgIGxvY2F0aW9uIH4gL1wu aHQgew0KICAgICAgICBkZW55IGFsbDsNCiAgICB9DQo8L2NvZGU+PC9wcmU+DQoNCjxwPlJl bG9hZCBOZ2lueDo8L3A+DQoNCjxwcmU+PGNvZGU+c2VydmljZSBuZ2lueCByZWxvYWQNCjwv Y29kZT48L3ByZT4NCg0KPHA+T3BlbiA8Y29kZT4vZXRjL3BocC83LjAvZnBtL3BocC5pbmk8 L2NvZGU+IGFuZCBzZXQgPGNvZGU+Y2dpLmZpeF9wYXRoaW5mbz0wOjwvY29kZT4NClJlc3Rh cnQgcGhwOjwvcD4NCg0KPHByZT48Y29kZT5zZXJ2aWNlIHBocDcuMC1mcG0gcmVsb2FkDQo8 L2NvZGU+PC9wcmU+DQoNCjxoMiBpZD0iY2hlY2t0aGVpbnN0YWxsYXRpb24iPkNoZWNrIHRo ZSBpbnN0YWxsYXRpb248L2gyPg0KDQo8cD5DcmVhdGUgPGNvZGU+aW5mby5waHA8L2NvZGU+ IGluIDxjb2RlPi92YXIvd3d3L2h0bWwvaW5mby5waHA8L2NvZGU+IHdpdGggdGhlIGZvbGxv d2luZyBjb250ZW50OjwvcD4NCg0KPHByZT48Y29kZT4mbHQ7P3BocA0KcGhwaW5mbygpOw0K PyZndDsNCjwvY29kZT48L3ByZT4NCg0KPHA+V2F0Y2ggb3V0IGZvciBDUkxGcyBvbiBXaW5k b3dzIChlbmQgb2YgbGluZSBzaG91bGQgYmUgXG4gcmVndWxhcmx5IGluIExpbnV4KS48L3A+ DQoNCjxwPlRyeSBub3cgPGNvZGU+aHR0cDovLyZsdDtJUCZndDsvaW5mby5waHA8L2NvZGU+ PC9wPg0KDQo8aDIgaWQ9Imluc3RhbGxhZGRpdGlvbmFscGFja2FnZXNyZXF1aXJlZGJ5cGl3 aWsiPkluc3RhbGwgYWRkaXRpb25hbCBwYWNrYWdlcyByZXF1aXJlZCBieSBQaXdpazwvaDI+ DQoNCjxwcmU+PGNvZGU+YXB0LWdldCAteSBpbnN0YWxsIHBocDcuMC1jdXJsIHBocDcuMC1n ZCBwaHA3LjAtY2xpIHBocC1nZW9pcCBwaHA3LjAtbXlzcWwNCmFwdC1nZXQgLXkgaW5zdGFs bCBwaHAtbWJzdHJpbmcgcGhwNy4wLW1ic3RyaW5nDQphcHQtZ2V0IC15IGluc3RhbGwgcGhw LXhtbA0KPC9jb2RlPjwvcHJlPg0KDQo8aDEgaWQ9Imluc3RhbGxwaXdpayI+SW5zdGFsbCBQ aXdpazwvaDE+DQoNCjxwPlJ1bjo8L3A+DQoNCjxwcmU+PGNvZGU+Y2QgL3RtcA0KYXB0LWdl dCBpbnN0YWxsIHVuemlwDQp3Z2V0IGh0dHBzOi8vYnVpbGRzLnBpd2lrLm9yZy9waXdpay56 aXAgJmFtcDsmYW1wOyB1bnppcCBwaXdpay56aXANCm1rZGlyIC92YXIvd3d3Ly9odG1sL3Bp d2lrDQpjcCAtUiAuL3Bpd2lrLyogL3Zhci93d3cvaHRtbC9waXdpaw0KY2hvd24gLVIgd3d3 LWRhdGE6d3d3LWRhdGEgL3Zhci93d3cvaHRtbC9waXdpaw0KY2htb2QgLVIgMDc1NSAvdmFy L3d3dy9odG1sL3Bpd2lrL3RtcA0KPC9jb2RlPjwvcHJlPg0KDQo8cD5Ob3cgYnJvd3NlIHRv IDxjb2RlPmh0dHA6Ly8mbHQ7RlFETiZndDsvcGl3aWsvaW5kZXgucGhwPC9jb2RlPjwvcD4N Cg0KPHA+Q29uZmlndXJlIHlvdXIgUGl3aWsgaW5zdGFuY2UuIFRoZSBmb2xsb3dpbmcgc2Ny aXB0LWxldCBzaG91bGQgYmUgaW5jbHVkZWQgaW4gZWFjaCBwYWdlIG9mIHlvdXIgc2l0ZSAo YXMgc3BlY2lmaWVkIGJ5IHRoZSBzZXR1cDo8Y29kZT5NYWtlIHN1cmUgdGhpcyBjb2RlIGlz IG9uIGV2ZXJ5IHBhZ2Ugb2YgeW91ciB3ZWJzaXRlLiBXZSByZWNvbW1lbmQgdG8gcGFzdGUg aXQgaW1tZWRpYXRlbHkgYmVmb3JlIHRoZSBjbG9zaW5nICZsdDsvaGVhZCZndDsgdGFnLjwv Y29kZT4pLg0KQmUgc3VyZSB0byBjaGFuZ2UgdGhlIDxjb2RlPiZsdDtGUUROJmd0OzwvY29k ZT4gd2l0aCB0aGUgYXBwcm9wcmlhdGUgdmFsdWUuPC9wPg0KDQo8cHJlPjxjb2RlPiZsdDsh LS0gUGl3aWsgLS0mZ3Q7DQombHQ7c2NyaXB0IHR5cGU9JnF1b3Q7dGV4dC9qYXZhc2NyaXB0 JnF1b3Q7Jmd0Ow0KICB2YXIgX3BhcSA9IF9wYXEgfHwgW107DQogIC8vIHRyYWNrZXIgbWV0 aG9kcyBsaWtlICZxdW90O3NldEN1c3RvbURpbWVuc2lvbiZxdW90OyBzaG91bGQgYmUgY2Fs bGVkIGJlZm9yZSAmcXVvdDt0cmFja1BhZ2VWaWV3JnF1b3Q7DQogIF9wYXEucHVzaChbJ3Ry YWNrUGFnZVZpZXcnXSk7DQogIF9wYXEucHVzaChbJ2VuYWJsZUxpbmtUcmFja2luZyddKTsN CiAgKGZ1bmN0aW9uKCkgew0KICAgIHZhciB1PSZxdW90Oy8vJmx0O0ZRRE4mZ3Q7L3Bpd2lr LyZxdW90OzsNCiAgICBfcGFxLnB1c2goWydzZXRUcmFja2VyVXJsJywgdSsncGl3aWsucGhw J10pOw0KICAgIF9wYXEucHVzaChbJ3NldFNpdGVJZCcsICcxJ10pOw0KICAgIHZhciBkPWRv Y3VtZW50LCBnPWQuY3JlYXRlRWxlbWVudCgnc2NyaXB0JyksIHM9ZC5nZXRFbGVtZW50c0J5 VGFnTmFtZSgnc2NyaXB0JylbMF07DQogICAgZy50eXBlPSd0ZXh0L2phdmFzY3JpcHQnOyBn LmFzeW5jPXRydWU7IGcuZGVmZXI9dHJ1ZTsgZy5zcmM9dSsncGl3aWsuanMnOyBzLnBhcmVu dE5vZGUuaW5zZXJ0QmVmb3JlKGcscyk7DQogIH0pKCk7DQombHQ7L3NjcmlwdCZndDsNCiZs dDshLS0gRW5kIFBpd2lrIENvZGUgLS0mZ3Q7DQo8L2NvZGU+PC9wcmU+DQoNCjxoMSBpZD0i cHVibGlzaGluZ3Byb2JsZW0iPlB1Ymxpc2hpbmcgUHJvYmxlbTwvaDE+DQoNCjxwPlRoZSBt b25pdG9yZWQgc2l0ZSBoYWQgc29tZSBwZWN1bGlhcml0aWVzOjwvcD4NCg0KPHVsPg0KPGxp Pkl0IGlzIHVzZWQgZnJvbSBpbnRyYW5ldCBvciBmcm9tIGludGVybmV0LCBwdWJsaXNoZWQg dGhyb3VnaCBhIHJldmVyc2UgcHJveHk8L2xpPg0KPGxpPkl0IGNhbiBiZSB1c2VkIG92ZXIg cGxhaW4gSFRUUCBvciBvdmVyIEhUVFBTICh0aHJvdWdoIFNTTyBvciBmcm9tIGludGVybmV0 KTsgd2hlbiB1c2VkIG92ZXIgSFRUUCBmcm9tIGludHJhbmV0IGl0IHdvcmtlZCBmaW5lIGJ1 dCBvdmVyIEhUVFBTIChhbHNvIGZyb20gaW50cmFuZXQpIHRoZSByZXF1ZXN0IHRvIFBpd2lr IChkdWUgdG8gc2VjdXJpdHkgcmVhc29ucykgd2FzIGFsc28gZG9uZSBvdmVyIEhUVFBTIHdo aWNoIG9idmlvdXNseSBmYWlsZWQgKHRoZSA8Y29kZT4vLyZsdDtGUUROJmd0Oy9waXdpay88 L2NvZGU+IHN5bnRheCBpbmRpY2F0ZXMgdG8gdGhlIGJyb3dzZXIgdG8gbWFrZSB0aGUgcmVx dWVzdCBvdmVyIHRoZSBzYW1lIHByb3RvY29sIGFzIHRoZSByZWZlcnJhbCBwYWdlIHdhcyBs b2FkZWQpPC9saT4NCjwvdWw+DQoNCjxwPlNvIG92ZXJhbGwgdGhlIGRlZmF1bHQgUGl3aWsg aW5zdGFsbGF0aW9uIGRpZG4mIzgyMTc7dCB3b3JrIHNpbmNlIGl0IHdhcyBub3QgYWNjZXNz aWJsZSB0aHJvdWdoIEhUVFBTIG5vciBmcm9tIGludGVybmV0LjwvcD4NCg0KPHA+VGhlIGZp cnN0IHN0ZXAgd2FzIHRvIHB1Ymxpc2ggdGhlIHNpdGUgdGhyb3VnaCB0aGUgc2FtZSByZXZl cnNlIHByb3h5LCBib3RoIEhUVFAgYW5kIEhUVFBTICh3aXRoIHRoZSB0dW5uZWwgYmVpbmcg dGVybWluYXRlZCBhdCBwcm94eSBsZXZlbCkgd2l0aCA8Y29kZT5Gb3J3YXJkIE9yaWdpbmFs IEhPU1QgSGVhZGVyPC9jb2RlPiBzZXQgdG8gT2ZmLiBUcnlpbmcgdG8gYWNjZXNzIHRoZSBh ZG1pbmlzdHJhdGl2ZSBpbnRlcmZhY2UgdGhyb3VnaCB0aGUgcHVibGljIEZRRE4gbGVkIHRv IGEgc2VjdXJpdHkgZXJyb3IgKHNvbWV0aGluZyB3aXRoIGFjdHVhbCBSZWZlcnJhbCBub3Qg bWF0Y2hpbmcgdGhlIGV4cGVjdGVkIG9uZSkuPC9wPg0KDQo8cD5OZXh0IHN0ZXAgd2FzIHRv IGNoYW5nZSB0aGUgcHJveHkgc2V0dGluZ3Mgc28gdGhhdCB0aGUgb3JpZ2luYWwgSE9TVCBo ZWFkZXIgd2FzIGZvcndhcmRlZCB0byBQaXdpay4gQW5vdGhlciBlcnJvciBwb3BwZWQgdXAg c3RhdGluZyAoYXMgYSBjb25jbHVzaW9uLCB0aGUgZXJyb3IgdGV4dCB3YXMgcmF0aGVyIHN0 dXBpZCBsaWtlIDxzdHJvbmc+UGl3aWsgd2FzIGFjY2Vzc2VkIGZyb20gW1VSTF0gYnV0IGl0 IHdhcyBjb25maWd1cmVkIHRvIGJlIGFjY2Vzc2VkIGZyb20gW1VSTF08L3N0cm9uZz4pIHRo YXQgdGhlIHZhbHVlIG9mIHRoZSBIT1NUIGhlYWRlciBpcyBub3QgcmVnaXN0ZXJlZCBhcyBz YWZlIGluIDxjb2RlPmNvbmZpZ1xjb25maWcuaW5pLnBocDwvY29kZT4uPC9wPg0KDQo8cD5C eSBhZGRpbmcgdGhlIEZRRE4gaW4gPGNvZGU+W0dlbmVyYWxdPC9jb2RlPiBzZWN0aW9uIGFz OjwvcD4NCg0KPHByZT48Y29kZT50cnVzdGVkX2hvc3RzW10gPSAmcXVvdDtGUUROJnF1b3Q7 DQo8L2NvZGU+PC9wcmU+DQoNCjxwPnRoZSBpbnRlZ3JhdGlvbiB3b3JrcyBqdXN0IGZpbmUu PC9wPg0K

Monitoring WildFly with VisualVM

Monitoring Wildfly 10 with JVisual VM

We have a performance problem on our Wildfly server (running as a Windows service) and we want to use jVisualVM (VisualVM actually).

  • Download the latest version from https://visualvm.github.io/
  • Unpack the archieve
  • Create the following batch in the root folder of the unpacked archieve(change the path to jboss-client.jar acordingly): cd bin visualvm.exe -cp:a C:\Java\wildfly-10.0.0.Final\bin\client\jboss-client.jar
  • Run the batch; you will not see (most probably) the Wildfly server in the identified applications because it is running as a different user (see http://stackoverflow.com/questions/32281266/why-java-visualvm-is-not-showing-wildfly-when-it-is-started-as-a-service)
  • Add a JMX connection by specifying the connection as service:jmx:remote+http://127.0.0.1:9990; be sure you have creted an admin user on your Wildfly instance
  • Open the connection
PGgxIGlkPSJtb25pdG9yaW5nd2lsZGZseTEwd2l0aGp2aXN1YWx2bSI+TW9uaXRvcmluZyBX aWxkZmx5IDEwIHdpdGggSlZpc3VhbCBWTTwvaDE+DQoNCjxwPldlIGhhdmUgYSBwZXJmb3Jt YW5jZSBwcm9ibGVtIG9uIG91ciBXaWxkZmx5IHNlcnZlciAocnVubmluZyBhcyBhIFdpbmRv d3Mgc2VydmljZSkgYW5kIHdlIHdhbnQgdG8gdXNlIGpWaXN1YWxWTSAoVmlzdWFsVk0gYWN0 dWFsbHkpLjwvcD4NCg0KPHVsPg0KPGxpPkRvd25sb2FkIHRoZSBsYXRlc3QgdmVyc2lvbiBm cm9tIDxhIGhyZWY9Imh0dHBzOi8vdmlzdWFsdm0uZ2l0aHViLmlvLyI+aHR0cHM6Ly92aXN1 YWx2bS5naXRodWIuaW8vPC9hPjwvbGk+DQo8bGk+VW5wYWNrIHRoZSBhcmNoaWV2ZTwvbGk+ DQo8bGk+Q3JlYXRlIHRoZSBmb2xsb3dpbmcgYmF0Y2ggaW4gdGhlIHJvb3QgZm9sZGVyIG9m IHRoZSB1bnBhY2tlZCBhcmNoaWV2ZShjaGFuZ2UgdGhlIHBhdGggdG8gamJvc3MtY2xpZW50 LmphciBhY29yZGluZ2x5KToNCjxjb2RlPg0KY2QgYmluDQp2aXN1YWx2bS5leGUgLWNwOmEg QzpcSmF2YVx3aWxkZmx5LTEwLjAuMC5GaW5hbFxiaW5cY2xpZW50XGpib3NzLWNsaWVudC5q YXINCjwvY29kZT48L2xpPg0KPGxpPlJ1biB0aGUgYmF0Y2g7IHlvdSB3aWxsIG5vdCBzZWUg KG1vc3QgcHJvYmFibHkpIHRoZSBXaWxkZmx5IHNlcnZlciBpbiB0aGUgaWRlbnRpZmllZCBh cHBsaWNhdGlvbnMgYmVjYXVzZSBpdCBpcyBydW5uaW5nIGFzIGEgZGlmZmVyZW50IHVzZXIg KHNlZSA8YSBocmVmPSJodHRwOi8vc3RhY2tvdmVyZmxvdy5jb20vcXVlc3Rpb25zLzMyMjgx MjY2L3doeS1qYXZhLXZpc3VhbHZtLWlzLW5vdC1zaG93aW5nLXdpbGRmbHktd2hlbi1pdC1p cy1zdGFydGVkLWFzLWEtc2VydmljZSI+aHR0cDovL3N0YWNrb3ZlcmZsb3cuY29tL3F1ZXN0 aW9ucy8zMjI4MTI2Ni93aHktamF2YS12aXN1YWx2bS1pcy1ub3Qtc2hvd2luZy13aWxkZmx5 LXdoZW4taXQtaXMtc3RhcnRlZC1hcy1hLXNlcnZpY2U8L2E+KTwvbGk+DQo8bGk+QWRkIGEg Sk1YIGNvbm5lY3Rpb24gYnkgc3BlY2lmeWluZyB0aGUgY29ubmVjdGlvbiBhcyA8Y29kZT5z ZXJ2aWNlOmpteDpyZW1vdGUraHR0cDovLzEyNy4wLjAuMTo5OTkwPC9jb2RlPjsgYmUgc3Vy ZSB5b3UgaGF2ZSBjcmV0ZWQgYW4gYWRtaW4gdXNlciBvbiB5b3VyIFdpbGRmbHkgaW5zdGFu Y2U8L2xpPg0KPGxpPk9wZW4gdGhlIGNvbm5lY3Rpb248L2xpPg0KPC91bD4NCg==

SSH Port Forwarding S2C

Server2Client (S2C) Port Forwarding

Server install

  • Install a Linux virtual machine (Ubuntu 16.04 in my case).
  • Install ssh server apt-get install openssh-server.
  • Edit /etc/ssh/sshd_config and add the following line (otherwise ssh will publish the forwarding port only on local host nevermind the client’s rule):
    • GatewayPorts clientspecified
  • Restart ssh service or the whole server (shutdown -r now); watch out that restarting ssh service (like service ssh restart or service ssh stop+service ssh start will not kill existing established ssh sessions because they are run as separate sshd processes
  • Configure the client
  • Check that the ssh service listens on 3389 by running lsof -i :3389 (we target RDP protocol, see Client Install section)
  • Check all sshd processes lsof -i -n | egrep '\<sshd\>'

Client Install

Download and install Bitvise Tunnelier client https://www.bitvise.com/ssh-client-download

Run Bitvise SSH Client:

  • Create/save a profile by specifying:
    • Login tab
      • Host
      • Username (SSH user)
      • Initial Method password
      • Password
      • Store encrypted password in profile
    • Options tab:
      • Allways reconnect automatically
      • Un-check the On-login options
    • S2C tab:
      • Add as many rules as required by specifying:
        • Enabled
        • Listen interface: 0.0.0.0 (this means that the SSH server will accept connections on all interfaces)
        • Listen port: 3389 (for instance, SSH server will wait connections on this port)
        • Destination host (where on the client’s side the connection will be redirected):
          • localhost for the local computer
          • IP/FQDN for another computer
        • Destination port: 3389, to redirect to a local computer RDP requests
  • Press Login

Use the Forwarded Port

Suppose that our Linux machine is called sshs2c we can now open a RDP connection on the remote host (the one specified in <Destination host:Destination port>) by connecting to sshs2c:<Listen port>

Windows ssh servers

Remark: I haven’t fully tried the below mentioned OpenSSH approaches but I just would mention them in case you are interested in bypassing the installation of the Linux virtual machine (which actually brings an additional layer of security since you are not exposing your workstation directly over internet on highly sensitive port 22)

PGgxIGlkPSJzZXJ2ZXIyY2xpZW50czJjcG9ydGZvcndhcmRpbmciPlNlcnZlcjJDbGllbnQg KFMyQykgUG9ydCBGb3J3YXJkaW5nPC9oMT4NCg0KPGgyIGlkPSJzZXJ2ZXJpbnN0YWxsIj5T ZXJ2ZXIgaW5zdGFsbDwvaDI+DQoNCjx1bD4NCjxsaT5JbnN0YWxsIGEgTGludXggdmlydHVh bCBtYWNoaW5lIChVYnVudHUgMTYuMDQgaW4gbXkgY2FzZSkuPC9saT4NCjxsaT5JbnN0YWxs IHNzaCBzZXJ2ZXIgPGNvZGU+YXB0LWdldCBpbnN0YWxsIG9wZW5zc2gtc2VydmVyPC9jb2Rl Pi48L2xpPg0KPGxpPkVkaXQgPGNvZGU+L2V0Yy9zc2gvc3NoZF9jb25maWc8L2NvZGU+IGFu ZCBhZGQgdGhlIGZvbGxvd2luZyBsaW5lIChvdGhlcndpc2Ugc3NoIHdpbGwgcHVibGlzaCB0 aGUgZm9yd2FyZGluZyBwb3J0IG9ubHkgb24gbG9jYWwgaG9zdCBuZXZlcm1pbmQgdGhlIGNs aWVudCYjODIxNztzIHJ1bGUpOg0KDQo8dWw+DQo8bGk+R2F0ZXdheVBvcnRzIGNsaWVudHNw ZWNpZmllZDwvbGk+DQo8L3VsPjwvbGk+DQo8bGk+UmVzdGFydCBzc2ggc2VydmljZSBvciB0 aGUgd2hvbGUgc2VydmVyICg8Y29kZT5zaHV0ZG93biAtciBub3c8L2NvZGU+KTsgd2F0Y2gg b3V0IHRoYXQgcmVzdGFydGluZyBzc2ggc2VydmljZSAobGlrZSA8Y29kZT5zZXJ2aWNlIHNz aCByZXN0YXJ0PC9jb2RlPiBvciA8Y29kZT5zZXJ2aWNlIHNzaCBzdG9wPC9jb2RlPis8Y29k ZT5zZXJ2aWNlIHNzaCBzdGFydDwvY29kZT4gd2lsbCBub3Qga2lsbCBleGlzdGluZyBlc3Rh Ymxpc2hlZCBzc2ggc2Vzc2lvbnMgYmVjYXVzZSB0aGV5IGFyZSBydW4gYXMgc2VwYXJhdGUg PGNvZGU+c3NoZDwvY29kZT4gcHJvY2Vzc2VzPC9saT4NCjxsaT5Db25maWd1cmUgdGhlIGNs aWVudDwvbGk+DQo8bGk+Q2hlY2sgdGhhdCB0aGUgc3NoIHNlcnZpY2UgbGlzdGVucyBvbiAz Mzg5IGJ5IHJ1bm5pbmcgPGNvZGU+bHNvZiAtaSA6MzM4OTwvY29kZT4gKHdlIHRhcmdldCBS RFAgcHJvdG9jb2wsIHNlZSBDbGllbnQgSW5zdGFsbCBzZWN0aW9uKTwvbGk+DQo8bGk+Q2hl Y2sgYWxsIHNzaGQgcHJvY2Vzc2VzIDxjb2RlPmxzb2YgLWkgLW4gfCBlZ3JlcCAnXCZsdDtz c2hkXCZndDsnPC9jb2RlPjwvbGk+DQo8L3VsPg0KDQo8aDIgaWQ9ImNsaWVudGluc3RhbGwi PkNsaWVudCBJbnN0YWxsPC9oMj4NCg0KPHA+RG93bmxvYWQgYW5kIGluc3RhbGwgQml0dmlz ZSBUdW5uZWxpZXIgY2xpZW50IDxhIGhyZWY9Imh0dHBzOi8vd3d3LmJpdHZpc2UuY29tL3Nz aC1jbGllbnQtZG93bmxvYWQiPmh0dHBzOi8vd3d3LmJpdHZpc2UuY29tL3NzaC1jbGllbnQt ZG93bmxvYWQ8L2E+PC9wPg0KDQo8cD5SdW4gQml0dmlzZSBTU0ggQ2xpZW50OjwvcD4NCg0K PHVsPg0KPGxpPkNyZWF0ZS9zYXZlIGEgcHJvZmlsZSBieSBzcGVjaWZ5aW5nOg0KDQo8dWw+ DQo8bGk+TG9naW4gdGFiDQoNCjx1bD4NCjxsaT5Ib3N0PC9saT4NCjxsaT5Vc2VybmFtZSAo U1NIIHVzZXIpPC9saT4NCjxsaT5Jbml0aWFsIE1ldGhvZCA8Y29kZT5wYXNzd29yZDwvY29k ZT48L2xpPg0KPGxpPlBhc3N3b3JkPC9saT4NCjxsaT5TdG9yZSBlbmNyeXB0ZWQgcGFzc3dv cmQgaW4gcHJvZmlsZTwvbGk+DQo8L3VsPjwvbGk+DQo8bGk+T3B0aW9ucyB0YWI6DQoNCjx1 bD4NCjxsaT5BbGx3YXlzIHJlY29ubmVjdCBhdXRvbWF0aWNhbGx5PC9saT4NCjxsaT5Vbi1j aGVjayB0aGUgT24tbG9naW4gb3B0aW9uczwvbGk+DQo8L3VsPjwvbGk+DQo8bGk+UzJDIHRh YjoNCg0KPHVsPg0KPGxpPkFkZCBhcyBtYW55IHJ1bGVzIGFzIHJlcXVpcmVkIGJ5IHNwZWNp Znlpbmc6DQoNCjx1bD4NCjxsaT5FbmFibGVkPC9saT4NCjxsaT5MaXN0ZW4gaW50ZXJmYWNl OiAwLjAuMC4wICh0aGlzIG1lYW5zIHRoYXQgdGhlIFNTSCBzZXJ2ZXIgd2lsbCBhY2NlcHQg Y29ubmVjdGlvbnMgb24gYWxsIGludGVyZmFjZXMpPC9saT4NCjxsaT5MaXN0ZW4gcG9ydDog MzM4OSAoZm9yIGluc3RhbmNlLCBTU0ggc2VydmVyIHdpbGwgd2FpdCBjb25uZWN0aW9ucyBv biB0aGlzIHBvcnQpPC9saT4NCjxsaT5EZXN0aW5hdGlvbiBob3N0ICh3aGVyZSBvbiB0aGUg Y2xpZW50JiM4MjE3O3Mgc2lkZSB0aGUgY29ubmVjdGlvbiB3aWxsIGJlIHJlZGlyZWN0ZWQp Og0KDQo8dWw+DQo8bGk+bG9jYWxob3N0IGZvciB0aGUgbG9jYWwgY29tcHV0ZXI8L2xpPg0K PGxpPklQL0ZRRE4gZm9yIGFub3RoZXIgY29tcHV0ZXI8L2xpPg0KPC91bD48L2xpPg0KPGxp PkRlc3RpbmF0aW9uIHBvcnQ6IDMzODksIHRvIHJlZGlyZWN0IHRvIGEgbG9jYWwgY29tcHV0 ZXIgUkRQIHJlcXVlc3RzPC9saT4NCjwvdWw+PC9saT4NCjwvdWw+PC9saT4NCjwvdWw+PC9s aT4NCjxsaT5QcmVzcyBMb2dpbjwvbGk+DQo8L3VsPg0KDQo8aDIgaWQ9InVzZXRoZWZvcndh cmRlZHBvcnQiPlVzZSB0aGUgRm9yd2FyZGVkIFBvcnQ8L2gyPg0KDQo8cD5TdXBwb3NlIHRo YXQgb3VyIExpbnV4IG1hY2hpbmUgaXMgY2FsbGVkIHNzaHMyYyB3ZSBjYW4gbm93IG9wZW4g YSBSRFAgY29ubmVjdGlvbiBvbiB0aGUgcmVtb3RlIGhvc3QgKHRoZSBvbmUgc3BlY2lmaWVk IGluICZsdDtEZXN0aW5hdGlvbiBob3N0OkRlc3RpbmF0aW9uIHBvcnQmZ3Q7KSBieSBjb25u ZWN0aW5nIHRvIHNzaHMyYzombHQ7TGlzdGVuIHBvcnQmZ3Q7PC9wPg0KDQo8aDIgaWQ9Indp bmRvd3Nzc2hzZXJ2ZXJzIj5XaW5kb3dzIHNzaCBzZXJ2ZXJzPC9oMj4NCg0KPHA+UmVtYXJr OiBJIGhhdmVuJiM4MjE3O3QgZnVsbHkgdHJpZWQgdGhlIGJlbG93IG1lbnRpb25lZCBPcGVu U1NIIGFwcHJvYWNoZXMgYnV0IEkganVzdCB3b3VsZCBtZW50aW9uIHRoZW0gaW4gY2FzZSB5 b3UgYXJlIGludGVyZXN0ZWQgaW4gYnlwYXNzaW5nIHRoZSBpbnN0YWxsYXRpb24gb2YgdGhl IExpbnV4IHZpcnR1YWwgbWFjaGluZSAod2hpY2ggYWN0dWFsbHkgYnJpbmdzIGFuIGFkZGl0 aW9uYWwgbGF5ZXIgb2Ygc2VjdXJpdHkgc2luY2UgeW91IGFyZSBub3QgZXhwb3NpbmcgeW91 ciB3b3Jrc3RhdGlvbiBkaXJlY3RseSBvdmVyIGludGVybmV0IG9uIGhpZ2hseSBzZW5zaXRp dmUgcG9ydCAyMik8L3A+DQoNCjx1bD4NCjxsaT5XaW5TQ1AgbWVudGlvbmVkIE1pY3Jvc29m dCAoISkgaW1wbGVtZW50YXRpb24gb2Ygc3NoIHNlcnZlciAoPGEgaHJlZj0iaHR0cHM6Ly93 aW5zY3AubmV0L2VuZy9kb2NzL2d1aWRlX3dpbmRvd3Nfb3BlbnNzaF9zZXJ2ZXIiPmh0dHBz Oi8vd2luc2NwLm5ldC9lbmcvZG9jcy9ndWlkZV93aW5kb3dzX29wZW5zc2hfc2VydmVyPC9h Pik6DQoNCjx1bD4NCjxsaT5IYXZlIGEgbG9vayBvbiBnaXRodWIgcHJvamVjdCB3aWtpPC9s aT4NCjxsaT5XaW5kb3dzIHVzZXJzIHVzZWQgZm9yIHVzZXIvcGFzc3dvcmQgYXV0aGVudGlj YXRpb24vYXV0aG9yaXphdGlvbiBhcmUgbG9jYWwgdXNlcnMsIG5vdCBkb21haW4gdXNlcnM8 L2xpPg0KPC91bD48L2xpPg0KPGxpPjxhIGhyZWY9Imh0dHA6Ly93d3cubWxzLXNvZnR3YXJl LmNvbS9vcGVuc3NoZC5odG1sI2JvdHBhZ2UiPmh0dHA6Ly93d3cubWxzLXNvZnR3YXJlLmNv bS9vcGVuc3NoZC5odG1sI2JvdHBhZ2U8L2E+PC9saT4NCjwvdWw+DQo=

Install ApacheDS

sudo -i
cd /tmp
wget http://apache.javapipe.com//directory/apacheds/dist/2.0.0-M23/apacheds-2.0.0-M23-amd64.deb
chmod +x apacheds-2.0.0-M23-amd64.deb
dpkg -i apacheds-2.0.0-M23-amd64.deb
update-rc.d apacheds-2.0.0-M23-default defaults
shutdown -r now

  • Check the log in /var/lib/apacheds…/default/log/apacheds.log for successful start-up; a single line should be present (something like [13:19:14] WARN [org.apache.directory.server.core.DefaultDirectoryService] - You didn't change the admin password of directory service instance 'default'. Please update the admin password as soon as possible to prevent a possible security breach.
  • Download latest ApacheDS Studio and install it
    • Create a new connection specifying:
      • Network parameters:
        • Connection name
        • Hostname
        • Port: 10389
        • Press "Check Network Parameters’
      • Authentication
        • Bind dn ou user : uid=admin,ou=system
        • Bind password : secret
        • Press ‘Check Authetication’
      • Finish
    • Change adminstrator’s password by editing ou=system->uid=admin and choosing anything else than plain text
      • SSHA, for instance
    • Close the connection, reconfigure the connection’s stored password and reopen it
    • Create a new partition by selecting ‘Open Configuration’ in the contextual menu (right click) of the newly created connection:
      • Advanced Partition Configuration…
      • Add..
        • Specify ID (like mycompany)and partition suffix like dc=mycompany)
        • Save
      • Restart the service service apacheds restart
    • Refresh the browser tree by selecting Reload from contextual menu
    • Perform any data import as required (from LDIF files for instance)

Important remark: Please notice that ldapsearch or the data export from ApacheDS Studio do not save info in the right sequence for importing (dependent objects after the objects they depend on)

PHByZT48Y29kZT5zdWRvIC1pDQpjZCAvdG1wDQp3Z2V0IGh0dHA6Ly9hcGFjaGUuamF2YXBp cGUuY29tLy9kaXJlY3RvcnkvYXBhY2hlZHMvZGlzdC8yLjAuMC1NMjMvYXBhY2hlZHMtMi4w LjAtTTIzLWFtZDY0LmRlYg0KY2htb2QgK3ggYXBhY2hlZHMtMi4wLjAtTTIzLWFtZDY0LmRl Yg0KZHBrZyAtaSBhcGFjaGVkcy0yLjAuMC1NMjMtYW1kNjQuZGViDQp1cGRhdGUtcmMuZCBh cGFjaGVkcy0yLjAuMC1NMjMtZGVmYXVsdCBkZWZhdWx0cw0Kc2h1dGRvd24gLXIgbm93DQoN CjwvY29kZT48L3ByZT4NCg0KPHVsPg0KPGxpPkNoZWNrIHRoZSBsb2cgaW4gL3Zhci9saWIv YXBhY2hlZHMmIzgyMzA7L2RlZmF1bHQvbG9nL2FwYWNoZWRzLmxvZyBmb3Igc3VjY2Vzc2Z1 bCBzdGFydC11cDsgYSBzaW5nbGUgbGluZSBzaG91bGQgYmUgcHJlc2VudCAoc29tZXRoaW5n IGxpa2UgPGNvZGU+WzEzOjE5OjE0XSBXQVJOIFtvcmcuYXBhY2hlLmRpcmVjdG9yeS5zZXJ2 ZXIuY29yZS5EZWZhdWx0RGlyZWN0b3J5U2VydmljZV0gLSBZb3UgZGlkbid0IGNoYW5nZSB0 aGUgYWRtaW4gcGFzc3dvcmQgb2YgZGlyZWN0b3J5IHNlcnZpY2UgaW5zdGFuY2UgJ2RlZmF1 bHQnLiAgUGxlYXNlIHVwZGF0ZSB0aGUgYWRtaW4gcGFzc3dvcmQgYXMgc29vbiBhcyBwb3Nz aWJsZSB0byBwcmV2ZW50IGEgcG9zc2libGUgc2VjdXJpdHkgYnJlYWNoLjwvY29kZT48L2xp Pg0KPGxpPkRvd25sb2FkIGxhdGVzdCBBcGFjaGVEUyBTdHVkaW8gYW5kIGluc3RhbGwgaXQN Cg0KPHVsPg0KPGxpPkNyZWF0ZSBhIG5ldyBjb25uZWN0aW9uIHNwZWNpZnlpbmc6DQoNCjx1 bD4NCjxsaT5OZXR3b3JrIHBhcmFtZXRlcnM6DQoNCjx1bD4NCjxsaT5Db25uZWN0aW9uIG5h bWU8L2xpPg0KPGxpPkhvc3RuYW1lPC9saT4NCjxsaT5Qb3J0OiAxMDM4OTwvbGk+DQo8bGk+ UHJlc3MgJnF1b3Q7Q2hlY2sgTmV0d29yayBQYXJhbWV0ZXJzJiM4MjE3OzwvbGk+DQo8L3Vs PjwvbGk+DQo8bGk+QXV0aGVudGljYXRpb24NCg0KPHVsPg0KPGxpPkJpbmQgZG4gb3UgdXNl ciA6IDxjb2RlPnVpZD1hZG1pbixvdT1zeXN0ZW08L2NvZGU+PC9saT4NCjxsaT5CaW5kIHBh c3N3b3JkIDogPGNvZGU+c2VjcmV0PC9jb2RlPjwvbGk+DQo8bGk+UHJlc3MgJiM4MjE2O0No ZWNrIEF1dGhldGljYXRpb24mIzgyMTc7PC9saT4NCjwvdWw+PC9saT4NCjxsaT5GaW5pc2g8 L2xpPg0KPC91bD48L2xpPg0KPGxpPkNoYW5nZSBhZG1pbnN0cmF0b3ImIzgyMTc7cyBwYXNz d29yZCBieSBlZGl0aW5nIDxjb2RlPm91PXN5c3RlbTwvY29kZT4tJmd0Ozxjb2RlPnVpZD1h ZG1pbjwvY29kZT4gYW5kIGNob29zaW5nIGFueXRoaW5nIGVsc2UgdGhhbiBwbGFpbiB0ZXh0 DQoNCjx1bD4NCjxsaT5TU0hBLCBmb3IgaW5zdGFuY2U8L2xpPg0KPC91bD48L2xpPg0KPGxp PkNsb3NlIHRoZSBjb25uZWN0aW9uLCByZWNvbmZpZ3VyZSB0aGUgY29ubmVjdGlvbiYjODIx NztzIHN0b3JlZCBwYXNzd29yZCBhbmQgcmVvcGVuIGl0PC9saT4NCjxsaT5DcmVhdGUgYSBu ZXcgcGFydGl0aW9uIGJ5IHNlbGVjdGluZyAmIzgyMTY7T3BlbiBDb25maWd1cmF0aW9uJiM4 MjE3OyBpbiB0aGUgY29udGV4dHVhbCBtZW51IChyaWdodCBjbGljaykgb2YgdGhlIG5ld2x5 IGNyZWF0ZWQgY29ubmVjdGlvbjoNCg0KPHVsPg0KPGxpPkFkdmFuY2VkIFBhcnRpdGlvbiBD b25maWd1cmF0aW9uJiM4MjMwOzwvbGk+DQo8bGk+QWRkLi4NCg0KPHVsPg0KPGxpPlNwZWNp ZnkgSUQgKGxpa2UgPGNvZGU+bXljb21wYW55PC9jb2RlPilhbmQgcGFydGl0aW9uIHN1ZmZp eCBsaWtlIDxjb2RlPmRjPW15Y29tcGFueTwvY29kZT4pPC9saT4NCjxsaT5TYXZlPC9saT4N CjwvdWw+PC9saT4NCjxsaT5SZXN0YXJ0IHRoZSBzZXJ2aWNlIDxjb2RlPnNlcnZpY2UgYXBh Y2hlZHMgcmVzdGFydDwvY29kZT48L2xpPg0KPC91bD48L2xpPg0KPGxpPlJlZnJlc2ggdGhl IGJyb3dzZXIgdHJlZSBieSBzZWxlY3RpbmcgUmVsb2FkIGZyb20gY29udGV4dHVhbCBtZW51 PC9saT4NCjxsaT5QZXJmb3JtIGFueSBkYXRhIGltcG9ydCBhcyByZXF1aXJlZCAoZnJvbSBM RElGIGZpbGVzIGZvciBpbnN0YW5jZSk8L2xpPg0KPC91bD48L2xpPg0KPC91bD4NCg0KPHA+ PHN0cm9uZz5JbXBvcnRhbnQgcmVtYXJrPC9zdHJvbmc+OiBQbGVhc2Ugbm90aWNlIHRoYXQg PGNvZGU+bGRhcHNlYXJjaDwvY29kZT4gb3IgdGhlIGRhdGEgZXhwb3J0IGZyb20gQXBhY2hl RFMgU3R1ZGlvIGRvIG5vdCBzYXZlIGluZm8gaW4gdGhlIHJpZ2h0IHNlcXVlbmNlIGZvciBp bXBvcnRpbmcgKGRlcGVuZGVudCBvYmplY3RzIGFmdGVyIHRoZSBvYmplY3RzIHRoZXkgZGVw ZW5kIG9uKTwvcD4NCg==