Yes you can, but it involves working with the layout files.
You can use this guide to help create your layout:
ag_UnitFrames:Creating your own theme
I would suggest copying an existing layout file and practice editing on that first.
Just put your font file in "Interface\AddOns\ag_UnitFrames\fonts" folder and then edit your layout file to use it:
Code:
NameLabel = {
Type = "string",
Font = L["Interface\\AddOns\\ag_UnitFrames\\fonts\\YOURFONT.ttf"],
FontSize = 10,
Point = "LEFT",
RelativeTo = "HealthBar",
RelativePoint = "LEFT",
x = 1.5,
y =0,
EndPoint = "RIGHT",
EndRelativeTo = "HealthText",
EndRelativePoint = "LEFT",
Endx=2,
Endy=0,
Height = 1,
},