Integration in mineflayer

[rom1504]

Related #65
Things to do :

• Use Minecraft data #115 use Minecraft data
• pchunk bedrock support
• pblock and pitem support
• Actual implementation in mineflayer, 2 choices. I prefer the first choice, but it depends on how difficult it would be in practice
  • 1. Build an abstraction layer for java and bedrock packets, build new mineflayer plugins relying on these stable clean and nice packets instead of raw packets
  • 2. Build mineflayer plugins for bedrock raw packets

[extremeheat]

Progress Report, (trying to finally get this bedrock stuff out of the way)

• Add bedrock protocol data minecraft-data#445 has been opened to move the protocol data to minecraft-data, Use Minecraft data #115 will implement it here in bedrock-protocol, with Update bedrock item and version handling node-minecraft-data#110
  • Web documentation generation #98 will be done in Add bedrock data to pages minecraft-data#454
• prismarine-block support in Bedrock updates prismarine-block#40
• prismarine-item is blocked by Release 1.10.1 prismarine-item#38 to avoid a conflict
• the easy approach to pchunk for now I think is to depend on bedrock-provider (it doesn't depend on leveldb anymore), I'll have something to update it to update it to 1.17.10 + new prismarine-block later this week
• prismarine-recipes support for bedrock recipe schema in Add bedrock support prismarine-recipe#9
  • main difference in the schema is "ingredients" is always set as a flat array, with indexes for the shapes in the "inputs" field.
  • This also uses strings when addressing items as there are no hardcoded item IDs on bedrock.
  • We could make it more conformant to the PC schema (it was just easier to code with this schema), but after implementing it in prismarine-recipie imo I think it's alot easier keeping it this way

For consideration:

• New lib to do inventories and/or expand scope of p-windows ?
  • Inventory logic needs to be shared between the client and the server, and nickelpro is also working on revamping java edition inventories for pc 1.17.
  • https://extremeheat.github.io/bedrock-protocol/protocol/1.16.220.html#ItemStackRequest - on bedrock, the inventory actions are high level instead of being click based, so actions like take, place, swap, etc. are sent instead of individual clicks.
  • Clients can also batch inventory requests (e.g. click spreading in one packet), so it needs to be able to simulate these requests from the server. If the server rejects, client needs to discard and undo the batch.

[u9g]

In terms of inventory, nickelpro was talking about a similar way to do high level actions with p-window where you would be able to say window.swap(itemOne, itemTwo) and everything with slots would be handled by p-window

[extremeheat]

Yeah, that could be joined along with a transaction group API to batch many actions at once. Something like this is also needed for GUI inventories in Minecraft, and I've implemented it into minecraft-inventory-gui for creative mode (just not connected to network APIs) : https://github.com/extremeheat/minecraft-inventory-gui/blob/bedrock/web/CW2.js

For example, doing spread operations in the inventory, then cancelling it requires the client to simulate the spread, then if not cancelled, send the group to the server for confirmation (or rejection).

For the mineflayer side an API like this :

interface Inventory {
  // take from slot and put count into hand
  take({ from?: string, fromSlot?: number, count?: number })
  // take item from slot and put count into hand
  take({ from?: string, item?: ItemName, count?: number })
  // place from hand to slot specific if slot is specified, else distribute
  place({ toSlot?: number, count?: number })
  // move from slot to another slot
  move({ from?: string, fromSlot?: number, to?: string, toSlot?: number })
  // from item from one place to another place (specific slot if specified)
  move({ from?: string, item?: number, to?: string, toSlot?: number })
}

const tx = bot.inventory.startTransaction()
tx.take({ fromSlot: 0, count }) // put into hand
tx.place({ toSlot: 0, count }) // put from hand into slot
tx.swap({ fromSlot: 0, toSlot: 1 })
tx.move({ from: 'chest', fromSlot: 2, to: 'hand' })
tx.send()

There some duplicates APIs which do the same thing, I just added them from the bedrock protocol. For automation in agents, the action space can be simplified to just moving x item to y.

[u9g]

prismarine-item pr has been merged

[RUGMJ]

Any updates?

[extremeheat]

Remaining work backlog

• prismarine-registry - implementation needed for protocol runtime ID mapping
• prismarine-item - needs to use the runtime ID mapping
• prismarine-chunk - move bedrock-provider chunk implementation to prismarine-chunk MCPE 1.18 prismarine-chunk#152

What's done

• 1.17.30/1.18 update bedrock-provider#9 - support for 1.18 level format
• mc-data updated with most essential data, biomes, blocks, items, collisions, etc.
• prismarine-viewer kind of works, but needs some updates to block model mapping

Non-essential backlog

• Add bedrock support prismarine-recipe#9 - bedrock recipes

[neohunter]

PrismarineJS/mineflayer#2411

How to make mineflayer use bedrock-protocol instead of minecraft-protocol?

[rom1504]

by finishing this task, if you want to help @neohunter feel free to join #bedrock-protocol in discord and ask what you can do at this time to make things easier