Cloudflare bot protection blocks the mod

[grous0]

I use LiveAtlas.

This is the error in log. Is there are a way to get more detailed error log? Becasue "Error while connecting to the web map." is not really a good error message.

[19:29:07] [pool-7-thread-2/ERROR]: Error while connecting to the web map.
java.net.UnknownHostException: https
	at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(DirectConstructorHandleAccessor.java:62) ~[?:?]
	at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:502) ~[?:?]
	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:486) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:2070) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:2065) ~[?:?]
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:571) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:2064) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1634) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1614) ~[?:?]
	at knot/de.the_build_craft.maplink.common.HTTP.makeTextHttpRequest(HTTP.java:126) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	at knot/de.the_build_craft.maplink.common.connections.LiveAtlasConnection.setupConnections(LiveAtlasConnection.java:72) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	at knot/de.the_build_craft.maplink.common.connections.LiveAtlasConnection.<init>(LiveAtlasConnection.java:59) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	at knot/de.the_build_craft.maplink.common.UpdateTask.runUpdate(UpdateTask.java:144) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	at knot/de.the_build_craft.maplink.common.UpdateTask.run(UpdateTask.java:61) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:358) ~[?:?]
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
Caused by: java.net.UnknownHostException: https
	at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:567) ~[?:?]
	at java.base/java.net.Socket.connect(Socket.java:751) ~[?:?]
	at java.base/sun.net.NetworkClient.doConnect(NetworkClient.java:178) ~[?:?]
	at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:531) ~[?:?]
	at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:636) ~[?:?]
	at java.base/sun.net.www.http.HttpClient.<init>(HttpClient.java:280) ~[?:?]
	at java.base/sun.net.www.http.HttpClient.New(HttpClient.java:386) ~[?:?]
	at java.base/sun.net.www.http.HttpClient.New(HttpClient.java:408) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1319) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1252) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1138) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:1067) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1690) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1614) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getHeaderField(HttpURLConnection.java:3250) ~[?:?]
	at java.base/java.net.URLConnection.getContentType(URLConnection.java:522) ~[?:?]
	at knot/de.the_build_craft.maplink.common.HTTP.getResponseCharset(HTTP.java:60) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	at knot/de.the_build_craft.maplink.common.HTTP.makeTextHttpRequest(HTTP.java:124) ~[maplink-fabric-4.2.1-1.21.9-1.21.10.jar:?]
	... 10 more

[grous0]

The server i connect uses something like Velocity that transfers me to another server. The servers have the same IP address so i believe this is not the issue?

[thebuildcraft]

you can try debug mode in the config and send the config. but I dont have time to really debug sth right now. maybe try to remove the https infront of the link or add http.

[grous0]

Debug mode didn't give more detailed logs but i will try restarting the game. Here is the general config.

{
	"enabled": true,
	"serverEntries": [
		{
			"maptype": "LiveAtlas",
			"ip": "oyna.atlantikmc.com",
			"link": "https://map.atlantikmc.com/#towny;flat;0,64,-32;0",
			"markerVisibilityMode": "Auto",
			"markerLayers": [],
			"individualMarkerMode": "BlackList",
			"markers": [],
			"areaMarkerVisibilityMode": "Auto",
			"areaMarkerLayers": [],
			"individualAreaMarkerMode": "BlackList",
			"areaMarkers": [],
			"iconMarkerVisibilityMode": "Auto",
			"iconMarkerLayers": [],
			"individualIconMode": "BlackList",
			"icons": []
		}
	],
	"maxUpdateDelay": 2000,
	"defaultY": 64,
	"minimapWaypointsRenderBelow": "WHEN_PLAYER_LIST_SHOWN",
	"enablePlayerWaypoints": true,
	"showPlayerWaypointsAsTrackedPlayers": true,
	"interpolationTime": 100,
	"enablePlayerIconWaypoints": true,
	"useMcHeadsPlayerNameIcons": false,
	"playerWaypointColor": "Black",
	"showAfkInTabList": true,
	"timeUntilAfk": 120,
	"showAfkTimeInTabList": true,
	"hideAfkMinutes": false,
	"AfkColor": 16733440,
	"unknownAfkStateColor": 6316128,
	"enableMarkerWaypoints": true,
	"enableMarkerIcons": true,
	"showDefaultMarkerIcons": true,
	"markerWaypointColor": "Gray",
	"enableAreaMarkerOverlay": true,
	"areaFillAlphaMul": 100,
	"areaFillAlphaMin": 0,
	"areaFillAlphaMax": 42,
	"areaLineAlphaMul": 100,
	"areaLineAlphaMin": 0,
	"areaLineAlphaMax": 100,
	"blocksPerChunkThreshold": 128,
	"maxChunkArea": 500000,
	"excludeOPAC": true,
	"ignoredServers": [],
	"ignoreMarkerMessage": false,
	"hideAllChatErrors": false,
	"debugMode": true,
	"chatLogInDebugMode": true,
	"ignoreCertificatesUseAtYourOwnRisk": false,
	"configVersionDoNotEdit": 2
}

[grous0]

Also does it require XaeroLib in server?

[19:42:40] [Render thread/WARN]: Server side doesn't have XaeroLib installed! Resetting.

[grous0]

I got java.io.IOException: Server returned HTTP response code: 403 for URL: http://map.atlantikmc.com with HTTP. But in my browser web page opens just fine (cache is off).

[thebuildcraft]

I just opened the map. The problem is the cloudflare bot protection. My mod acts like a bot. Im sorry, but as long as the server owner uses Cloudflare bot and DDOS protection you will not be able to use my mod on that server.

[grous0]

I did a little bit research, maybe it is possible to make request "act" like a normal user which is maybe ton of work.

Instead, mod can let user paste or scrape a cookie called cf_clearance internally -we can copy this script's logic- and use it to make requests.

Letting user paste their cookie is probably a bad idea since the user agent and IP address in the cf_clearance cookie must be the same with the client that makes the request.

I may try to implement this soon to test it.

[thebuildcraft]

Thank you for you dedication! :)
I dont have any time to test or implement sth right now. But if you get sth working please let me know.
very appreciated

[grous0]

Thank you for you dedication! :) I dont have any time to test or implement sth right now. But if you get sth working please let me know. very appreciated

I did some addition but how can i compile it to a specific version? I changed mcVer to 1.21.10 but it still defaults to 1.20.4 which is default in settings.gradle.

[thebuildcraft]

Thats strange ... but I usually only set it in gradle.properties, launch from IntelliJ and then compile all versions at once. You can look how the buildall scripts call gradle and use that command.

[grous0]

Even with .\gradlew.bat build -PmcVer="1.21.10" --no-daemon just produced 1.20.3 and 1.20.4 versions. I tried manually overwriting settings.gradle but it just gives error.

[thebuildcraft]

Oh wait.. you need to set it to 1.21.9
thats how the version file is called. I didnt rename it. It will compile to 1.21.10.
(I would have had to rename all Manafold IFs in the code otherwise)