The server is plugged into that port but I don't think its interface is vlan aware.
Very simple - you can't do it if the server on port 24 is not VLAN aware. In order to get multiple VLANs on the same physical interface, they must be VLAN tagged - one VLAN can be untagged. If the server does not understand VLAN tagging, it wont receive the VLAN tagged traffic.
For a workaround, if you have (or can install a second Ethernet port) on the server, configure two ports on the switch (one for each VLAN but NOT TAGGED), Configure the two ports on the service for the appropriate LAN configurations.