Yes that is possible - You can find a sutiable Minecraft Server on that list. Note down the IP and port - use the button on a server page (Click to Join this Minecraft Server)
In Minecraft, simply click Multiplayer -> Direct connect -> Enter the IP:Port and connect
Do this from both computers and your kids can play in the same world together.