Microcks error: $objectToArray requires a document input, found: missing

[etumwizere21]

Hi everyone,
I'm trying to use Microcks create a mock server from my asyncapi definition file but whenever I upload the file I get this type of error and it does not create mocks though it shows the operations. I'm not sure if I'm missing anything. any thought?

failed to handle {"aggregate" : "service", "pipeline" : [ { "$project" : { "labels" : { "$objectToArray" : "$metadata.labels" } } }, { "$unwind" : "$labels" }, { "$sort" : { "labels.v" : -1 } }, { "$group" : { "_id" : "$labels.k", "values" : { "$addToSet" : "$labels.v" }, "key" : { "$first" : "$labels.k" } } } ], "cursor" : {}, "allowDiskUse" : false, "$db" : "test"}

de.bwaldvogel.mongo.backend.aggregation.Aggregation$PlanExecutorError: [Error 40390] PlanExecutor error during aggregation :: caused by :: $objectToArray requires a document input, found: missing
at de.bwaldvogel.mongo.backend.aggregation.Aggregation.computeResult(Aggregation.java:242)
at de.bwaldvogel.mongo.backend.AbstractMongoDatabase.commandAggregate(AbstractMongoDatabase.java:623)
at de.bwaldvogel.mongo.backend.AbstractMongoDatabase.handleCommand(AbstractMongoDatabase.java:132)
at de.bwaldvogel.mongo.backend.AbstractMongoBackend.handleCommand(AbstractMongoBackend.java:340)
at de.bwaldvogel.mongo.backend.AbstractMongoBackend.handleMessage(AbstractMongoBackend.java:413)
at de.bwaldvogel.mongo.wire.MongoDatabaseHandler.handleMessage(MongoDatabaseHandler.java:73)
at de.bwaldvogel.mongo.wire.MongoDatabaseHandler.channelRead0(MongoDatabaseHandler.java:62)
at de.bwaldvogel.mongo.wire.MongoDatabaseHandler.channelRead0(MongoDatabaseHandler.java:27)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at [email protected]/java.lang.Thread.run(Thread.java:840)
at org.graalvm.nativeimage.builder/com.oracle.svm.core.thread.PlatformThreads.threadStartRoutine(PlatformThreads.java:915)
at org.graalvm.nativeimage.builder/com.oracle.svm.core.thread.PlatformThreads.threadStartRoutine(PlatformThreads.java:890)
Caused by: de.bwaldvogel.mongo.exception.MongoServerError: [Error 40390] $objectToArray requires a document input, found: missing
at de.bwaldvogel.mongo.backend.aggregation.Expression$50.apply(Expression.java:1033)
at de.bwaldvogel.mongo.backend.aggregation.Expression$50.apply(Expression.java:1028)
at de.bwaldvogel.mongo.backend.aggregation.Expression.apply(Expression.java:1746)
at de.bwaldvogel.mongo.backend.aggregation.Expression.evaluateDocumentExpression(Expression.java:1833)
at de.bwaldvogel.mongo.backend.aggregation.Expression.evaluate(Expression.java:1811)
at de.bwaldvogel.mongo.backend.aggregation.Expression.evaluateDocument(Expression.java:1752)
at de.bwaldvogel.mongo.backend.aggregation.stage.ProjectStage.projectDocument(ProjectStage.java:82)
at [email protected]/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
at [email protected]/java.util.ArrayList$Itr.forEachRemaining(ArrayList.java:1003)
at [email protected]/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1845)
at [email protected]/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
at [email protected]/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
at [email protected]/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
at [email protected]/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
at [email protected]/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at [email protected]/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
at de.bwaldvogel.mongo.backend.aggregation.stage.GroupStage.apply(GroupStage.java:43)
at de.bwaldvogel.mongo.backend.aggregation.Aggregation.runStagesAsStream(Aggregation.java:204)
at de.bwaldvogel.mongo.backend.aggregation.Aggregation.runStages(Aggregation.java:196)
at de.bwaldvogel.mongo.backend.aggregation.Aggregation.runStages(Aggregation.java:192)
at de.bwaldvogel.mongo.backend.aggregation.Aggregation.computeResult(Aggregation.java:235)
... 30 common frames omitted

here is our asyncapi definition attached

message_new_v3.zip

[lbroudoux]

Hello @etumwizere21

From what I see you're using the Uber distribution of Microcks. When using this distribution, the stacktrace above is "normal" and due to the embedded striped-down version of MongoDB we're using. For some reason, it fails to aggregate information where no label are present (that's the case where you're starting an instance). Once a label has been put on an API or Service, this error disappears from the logs.

Now it looks like this is not related at all to the import error you encounter. I'll have to take a look at your AsyncAPI file definition to see what's going wrong.

Final thought: using the uber image for doing asynchronous mocks is not the easiest path to go with when starting with Microcks. I would rather recommend using the Docker compose development mode (see https://microcks.io/documentation/guides/installation/docker-compose/#development-mode) for easier startup.

[etumwizere21]

Hi Laurent,
yeah I'm using sudo because I haven't added my user to the docker group to have non-root users permission.by default docker command requires elevated permissions.

I was able to get the page up and after uploading the asyncapi the thing of mocks are disabled disappeared. now the challenge I have is in testing. I'm not sure if I'm doing it wrong but I'm not getting the result. attached are the screenshot of what I'm doing and what I'm getting. if I'm doing wrong or putting wrong data please advise what to be done. Thank you

I tried using kafka-console but I can't see the sample message from the asyncapi example. attached is the kafka-console screenshot.

[lbroudoux]

Hi @etumwizere21,

I had another look at your AsyncAPI file, and it appears that it misses information to get mocking working.

Your channel definition is suing a parameter like that:

  telemetry:
    address: '{vehicle_guid}/telemetry'
    messages:
      telemetry:
        $ref: '#/components/messages/Telemetry'
    description: AutoDrive asset telemetry information
    parameters:
      vehicle_guid:
        $ref: '#/components/parameters/vehicle_guid'

but your parameter definition does have a location definition on line 509. You should update it to something like:

  parameters:
    vehicle_guid:
      description: The vehicle guid.
      location: $message.payload#/header/vehId_num

Otherwise, Microcks doesn't know how to retrieve values for this parameter and tries pushing messages to a Kafka topic named TerraLinkConnectDataFlowAPI-0.0.1-{vehicle_guid}-mobility and because {} are invalid characters in Kafka, this fails.

After applying the fix on the parameter, I can now read the messages on local Kafka topic:

$ kcat -b localhost:9092 -t TerraLinkConnectDataFlowAPI-0.0.1-0-mobility
--- OUTPUT ---
% Auto-selecting Consumer mode (use -P or -C to override)
{"header":{"absolute_time_sec":0,"absolute_time_nsec":0,"relative_time_sec":0,"relative_time_nsec":0,"vehId_make":"string","vehId_model":"string","vehId_num":0,"message_counter":"string"},"trajectory":[{"x":0,"y":0,"bearing":0,"speed_m_p_sec":0,"conditions":"STOP","time":"string"}],"autonomy_mode":"STOPPED","autonomy_status":"string","trailer_status":"HITCHED","brake_percent":0,"throttle_percent":0,"regen_brake_percent":0,"steering_wheel_angle_rad":0,"abs_pos":{"lat_long_deg":{"latitude":0,"longitude":0},"elevation_m":0,"ellipsoid":"string","utm_pos_northing_m":0,"utm_pos_easting_m":0,"utm_zone_number_m":0,"bearing_rad":0,"absolute_position_stddev_m":0},"mission_id":"string","mission_status":"MISSION_STATUS_UNKNOWN","task_id":["string"],"task_status":["TASK_STATUS_UNKNOWN"],"task_time_secs":[0],"speed":0}

[etumwizere21]

if I understood you well you are saying that I miss
location: $message.payload#/header/vehId_num
right?

[lbroudoux]

Yes exactly!

[etumwizere21]

Hi Laurent,
Now I have the async mock server with kafka working. Thank you so much for your support!
I want to do the POC for async mock server with MQTT since it would be our first preference to use.

referring to your above reply saying:
"
Regarding MQTT, we don't provide an MQTT as such, so you have to use/start one on your own. You used to have https://github.com/microcks/microcks/blob/master/minions/async/artemis.sh for test purpose but I'm not sure what is it's current status. Once you have a MQTT broker running at hand, you then have to edit the config/application.properties under the install/docker-compose folder to tell Microcks how to connect it.

You first have to add MQTT to the list of supported bindings and then add the connection properties like below:
%docker-compose.minion.supported-bindings=KAFKA,WS,MQTT

%docker-compose.mqtt.server=localhost:1883
%docker-compose.mqtt.username=microcks
%docker-compose.mqtt.password=microcks
"
Attached are the screenshots of what I tried by follow your Instructions but I'm unable to read the topic message.
Please advise me what I'm missing, or I misunderstood.
Thank you