Problem with starting fake mongo engine

[Oskarovsky]

I can't start Embedded MongoDB because I'm getting information about a problem downloading a file.

Java: 17
spring-boot-gradle-plugin: 2.5.13

Error related to this problem:
_2023-05-16T11:17:49.353+02:00 thread=Test worker level=ERROR logger=c.nordea.rfr.controller.FakeMongoDb : Failed to start FakeMongoDb @ localhost:27017
java.lang.RuntimeException: error on transition to State(de.flapdoodle.embed.process.types.Archive), rollback

Caused by: java.lang.IllegalStateException: could not download https://fastdl.mongodb.org/win32/mongodb-win32-x86_64-2008plus-ssl-3.6.22.zip (if this issue persist, you can download it manually to C:\Users\M020042.embedmongo\archives\https-fastdl-mongodb-org\56cb3d10404e5b9df5358ac4ee83efcb\win32mongodb-win32-x86-64-2008plus-ssl-3-6-22-zip\ab48ed577013b05d5e0105c6fd6d757ee1760b3313c0f5a578f79ff8ddfa59cd\archive.zip)_

Of course I can download it manually when I'm testing it on my local machine, but what if I want to run tests on an external server?

[michaelmosmann]

@Oskarovsky can you provide an more detailed stack trace? This error message should help the user to get back to work.. :)

What looks a little bit strange is that it looks like a missing '' in the archive path.. is c:\Users\M020042 the home directory of this user?

[Oskarovsky]

Yes, it is home directory for my user.

Caused by: java.net.UnknownHostException: fastdl.mongodb.org
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:499)
at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:480)

[Oskarovsky]

I was able to solve this problem by using my own data source. After changing the configuration, the mongoDB package was successfully downloaded.

DownloadConfig downloadConfig() {
    return ImmutableDownloadConfig
            .builder()
            .fileNaming(new UserTempNaming())
            .progressListener(new StandardConsoleProgressListener())
            .artifactStorePath(new UserHome(""))
            .downloadPath((__) -> ARTIFACTORY_PATH)
            .downloadPrefix("MongoFile")
            .userAgent("")
            .packageResolver(new PlatformPackageResolver(de.flapdoodle.embed.mongo.packageresolver.Command.MongoD))
            .build();
}

From what I found, we can also try to do it with HTTP proxy configuration.

[michaelmosmann]

@Oskarovsky hmm,.. i wonder which version of flapdoodle embed mongodb you are using.. the error message in the first part does not match with the code in your fix. And "Caused by: java.net.UnknownHostException: fastdl.mongodb.org" is maybe the root cause that the download failed..

can you tell me which spring version and which flapdoodle.embed.mongodb version you use?

[Oskarovsky]

@michaelmosmann

dependency 'de.flapdoodle.embed:de.flapdoodle.embed.mongo:3.4.11'
classpath "org.springframework.boot:spring-boot-gradle-plugin:2.5.13"

now i get the common error all the time:

Caused by: java.lang.RuntimeException: Could not start process: <EOF>
	at de.flapdoodle.embed.mongo.AbstractMongoProcess.onAfterProcessStart(AbstractMongoProcess.java:82)
	at de.flapdoodle.embed.process.runtime.AbstractProcess.<init>(AbstractProcess.java:115)
	at de.flapdoodle.embed.mongo.AbstractMongoProcess.<init>(AbstractMongoProcess.java:55)
	at de.flapdoodle.embed.mongo.MongodProcess.<init>(MongodProcess.java:50)
	at de.flapdoodle.embed.mongo.MongodExecutable.start(MongodExecutable.java:44)
	at de.flapdoodle.embed.mongo.MongodExecutable.start(MongodExecutable.java:34)
	at de.flapdoodle.embed.process.runtime.Executable.start(Executable.java:109)

[michaelmosmann]

@Oskarovsky is there a way to switch to spring 2.6 or spring 2.7? Then you can use a more recent version of this library..

[Oskarovsky]

Yes, I can.
I will try and give you feedback soon

[Oskarovsky]

@michaelmosmann
I see that for spring26 I will have to use a higher version (4.X.X)

[Oskarovsky]

@michaelmosmann
This is very strange. During one run of the method (for the same configuration as I wrote above) the Embedded Mongo started correctly. I tried a dozen times after that - it crashed again.

[michaelmosmann]

hmm.. my best guess is a class path issue .. so more than one version if the same library is finally present and strange things happen..
can you see if this works on your machine:

/~https://github.com/flapdoodle-oss/de.flapdoodle.embed.mongo.canary

[Oskarovsky]

@michaelmosmann
I tried debugging the internal structures of the flapdoodle library and found the following information in logWatch:

2023-05-22T13:21:36.984+0200 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
2023-05-22T13:21:36.985+0200 I CONTROL  [main] note: noprealloc may hurt performance in many applications
2023-05-22T13:21:36.996+0200 W -        [main] Failed to adjust token privilege for privilege 'SeIncreaseWorkingSetPrivilege'
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] MongoDB starting : pid=25304 port=27017 dbpath=C:\Users\Oskar\AppData\Local\Temp\embedmongo-db-f247e48a-c217-49f1-89dc-74293b559574 64-bit host=WMPF3Z9GAP
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] targetMinOS: Windows 7/Windows Server 2008 R2
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] db version v4.0.2
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] git version: fc1573ba18aee42f97a3bb13b67af7d837826b47
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] allocator: tcmalloc
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] modules: none
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] build environment:
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten]     distmod: 2008plus-ssl
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten]     distarch: x86_64
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten]     target_arch: x86_64
2023-05-22T13:21:37.051+0200 I CONTROL  [initandlisten] options: { net: { bindIp: "127.0.0.1", port: 27017 }, security: { authorization: "disabled" }, storage: { dbPath: "C:\Users\Oskar\AppData\Local\Temp\embedmongo-db-f247e48a-c217-49f1-89dc-74293b559574", journal: { enabled: false }, mmapv1: { preallocDataFiles: false, smallFiles: true }, syncPeriodSecs: 0.0 } }
2023-05-22T13:21:37.053+0200 E STORAGE  [initandlisten] Failed to set up listener: SocketException: An attempt was made to access a socket in a way forbidden by its access permissions.
2023-05-22T13:21:37.053+0200 I CONTROL  [initandlisten] now exiting
2023-05-22T13:21:37.053+0200 I CONTROL  [initandlisten] shutting down with code:48

[michaelmosmann]

@Oskarovsky oh.. ok. so there is still a running mongodb? Does this happen all the time? Or just sometimes?

[Oskarovsky]

@michaelmosmann
Well, it must finally be said that I have come to the final result that I have been working on.

One session was not closed, so no subsequent operations would start. At least I managed to get to know this library thoroughly :D

I will try to prepare a guide for this on my website in my free time - I think a lot of people use your tool and have a problem with it. I must honestly say that I'm a bit lacking in normal documentation or a guide here, because without it it's really hard to find some things.

Of course, I don't want to criticize it, because the implementation of the code itself is a great job

[michaelmosmann]

@Oskarovsky your welcome:) you can also make pull request or just comments to improve the existing documentation ... anything that you think might help:)

[Oskarovsky]

@michaelmosmann
I'm preparing a presentation and tutorial about flapdoodle. Would you find some time to meet soon? I have a few questions that would be worth discussing f2f

[michaelmosmann]

meet: you mean via zoom or something like that?

[michaelmosmann]

@Oskarovsky .. still an issue? reopen if needed..