Often the ListPlots are not the best approach. A more general and intuitive method is just to Map the graphics primitive (Point, Arrow, Line, whatever) onto the list of points defining it. In your example the plot gets too cluttered so I selected a random sample of 20 vectors from your test2 list. And I also reversed the direction of the Arrows because it looks nicer.
While ListVectorPlot3D[test] works. The ListVectorPlot3D[test2] just gives a Box without any error message. Any insight why this is not working and comments or ideas to make workable would be highly appreciated. Cheers !